ASC adjust clipboard May 20, 2019

(*
  This applescript converts clipboard input into a format suited for pasting into an ASC
  reply.  I observed that my copies into an ASC reply were not formated that well.
  I observed that copies from a web browser were formated much better.  I went about
   adjusting the clipboard copy to the format expected by a web browser for best results.

 This applescript accepts the clipboard in either
 -- plain text upon which the text is converted to HTML.  Conversion is limitted to inserting paragraph tags for blank lines and inserting links where http or https text appears. The page title is substituted for the link.
 -- HTML source code identified by text containing HTML markup.
         Caveat emptor.

 to use:
 1) copy command + c what data you want to convert
 2) run this applascript by double clicking on the app.
 3) paste command + V into an ASC reply

 I have tested in Waterfox 56.2.9 in Yosemite.  I assume the process will work with other web browsers and other versions of macOS.

 Save as an Application Bundle.  Don't check any of the boxes.

Should you experience a problem, run in the Script Editor.
   Shows how to debug via on run path. Shows items added to folder. Shows log statement.
   It is easier to diagnose problems with debug information. I suggest adding log statements to your script to see what is going on.  Here is an example.

  For testing, run in the Script Editor.
         1) Click on the Event Log tab to see the output from the log statement
      2) Click on Run

change log
may 1, 2019   -- skip 403 forbidding title
may 2, 2019   -- convert \" to ".  the \" mysteriously appears in HTML source code input.  Probably some TextEdit artifact.
                copy to TextEdit copy out of TextEdit.
may 7, 2019   -- regressed May 2nd update.  Applescript was inserting \" for display purposes into output.
may 8, 2019   -- special processing for html class on clipboard
                         https://pastebin.com/raw/Yg138YqT
may 16,2019  -- fixed hexDumpFormatOne bugs and improved output
may 16,2019  -- added hexDumpFormatZero
may 19,2019  -- eliminate line breaks outside the <pre>...</pre> tags in HTML. ASC intrepreting line
                         breaks as meaningful <br>
                         instead of white space.simplified line break code.
                       https://pastebin.com/raw/Nq08cFYH


enhancements:
  -- get pdf title


Author: rccharles

 Copyright 2019 rccharles

       Permission is hereby granted, free of charge, to any person obtaining a copy
       of this software and associated documentation files (the "Software"), to deal
       in the Software without restriction, including without limitation the rights
       to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
       copies of the Software, and to permit persons to whom the Software is
       furnished to do so, subject to the following conditions:

       The above copyright notice and this permission notice shall be included in all
       copies or substantial portions of the Software.

       THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
       IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
       FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
       AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
       LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
       OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
       SOFTWARE.


    example text document: remember to edit out the returns.
    set the clipboard to «data HTML3C68746D6C3E3C686561643E3C6D65746120687474702D65717569763D22636
    F6E74656E742D747970652220636F6E74656E743D22746578742F68746D6C3B206368617273657
    43D7574662D38223E3C2F686561643E3C626F64793E3C62723E0A202020203C62207374
    796C653D22636F6C6F723A677265656E3B223E506172616C6C656C733C2F623E3A3C62723E0A2
    0202020467265652076657273696F6E206F6620506172616C6C656C7320666F7220696E6
    46976696475616C207573653A3C62723E0A68747470733A2F2F6974756E65732E6170706C652E
    636F6D2F75732F6170702F706172616C6C656C732D6465736B746F702D6C6974652F696
    4313038353131343730393F6D743D31323C62723E0A2020202046756C6C2076657273696F6E3C6
    2723E0A202020203C6120687265663D22687474703A2F2F7777772E706172616C6C656C
    732E636F6D2F656E2F70726F64756374732F6465736B746F702F223E687474703A2F2F7777772E7
    06172616C6C656C732E636F6D2F656E2F70726F64756374732F6465736B746F702F3C2F6
    13E3C62723E0A202020203C62723E0A202020203C623E564D7761726520467573696F6E3C2F62
    3E3C62723E0A202020205769746820564D7761726520467573696F6E2C2072756E20746
    865206D6F73742064656D616E64696E67204D616320616E642057696E646F77730A20202020617
    0706C69636174696F6E7320730A6964652D62792D73696465206174206D6178696D756
    D2073706565647320776974686F7574207265626F6F74696E673C62723E0A20202020687474703A
    2F2F7777772E766D776172652E636F6D2F70726F64756374732F667573696F6E2F3C2F62
    6F64793E3C2F68746D6C3E»

    Translated text is:
    Full version<br>
    <a href="http://www.parallels.com/en/products/desktop/">http://www.parallels.com/en/products/desktop/</a><br>
    <br>
    <b>VMware Fusion</b><br>

    set the clipboard to «data HTML2020202046756C6C2076657273696F6E3C62723E0A202020203C612068726566
    3D22687474703A2F2F7777772E706172616
    C6C656C732E636F6D2F656E2F70726F64756374732F6465736B746F702F223E687474703
    A2F2F7777772E706172616C6C656C732E63
    6F6D2F656E2F70726F64756374732F6465736B746F702F3C2F613E3C62723E0A20202020
    3C62723E0A202020203C623E564D7761726520467573696F6E3C2F623E3C62723E0A»

set the clipboard to "Saturday, September 7, 2019
Live streamed
https://www.omf.ngo/community-symposium-2/"

set the clipboard to "\"Effective defenses 111 threats\" by John Galt
https://discussions.apple.com/docs/DOC-8841
\"Avoid phishing emails 222 and other scams\""

https://support.apple.com/en-ca/HT204759

blank lines
also,see:http://www.google.com/ seeing again:http://www.google.com"

 *)

(* For whatever reason, this segment doesn't work when moved above.
    set the clipboard to "<p>Simple put, Apple attempts to provide all the malware detection and removal you need in Mac OS X.</p>
<p>\"Effective defenses against malware and other threats\" by John Galt
<a href=\"https://discussions.apple.com/docs/DOC-8841\" target=\"_blank\">Effective
defenses against malware and ot… - Apple Community</a>
</p><p> </p>"
   *)
(*
set the clipboard to "<p>Simple put, Apple attempts to provide all the malware detection and removal you need in Mac OS X.</p>
<p>\"Effective defenses against malware and other threats\" by John Galt
<a href=\"https://discussions.apple.com/docs/DOC-8841\" target=\"_blank\">Effective
defenses against malware and to… - Apple Community</a>
</p><p> </p>"
*)
(*
    set the clipboard to "Saturday, September 7, 2019
Live streamed
https://www.omf.ngo/community-symposium-2/"
*)

(*
set the clipboard to "<p>Simple put, Apple attempts to provide all the malware detection and removal you need in Mac OS X.</p>
<p>\"Effective defenses against malware and other threats\" by John Galt
<a href=\"https://discussions.apple.com/docs/DOC-8841\" target=\"_blank\">Effective
defenses against malware and ot… - Apple Community</a>
</p><pre>
code line #a
code line #b
code line #c
</pre><p> </p><p>\"Avoid phishing emails, fake 'virus' alerts, phony support calls, and other scams\"
<a href=\"https://support.apple.com/en-ca/HT204759\" target=\"_blank\">Avoid phishing emails, fake
'virus' alerts, phony support calls, and other scams - Apple Support</a>
<pre>
code line #1
code line #2
code line #3
</pre>
</p><p> </p><p></p>Run etrecheck.  The first five runs are free. Provided a report on your
machines hardware and software.  Great for diagnosing your system.  Click on the download
link at the bottom of the screen.
<a href=\"http://etrecheck.com/\" target=\"_blank\">EtreCheck</a></p><p></p>
<p></p><p>
<ol>
<li>point 1</li>
<li>point 2</li>
<li>point 3</li>
</ol>
 </p>
<p>the end</p>"
*)
(*
    set the clipboard to "<p>Simple put, Apple attempts to provide all the malware detection and removal you need in Mac OS X.</p>
<pre>
code line #a
code line #b
code line #c
</pre><p> </p><p>\"Avoid phishing emails, fake 'virus' alerts, phony support calls, and other scams\"
<pre>
code line #1
code line #2
code line #3
</pre>
</p><p> </p><p>Run etrecheck.</p> "

*)
(*
    set the clipboard to "<p>Simple put, Apple attempts to provide all the malware detection and removal you need in Mac OS X.</p>
<p>\"Effective defenses against malware and other threats\" by John Galt
<a href=\"https://discussions.apple.com/docs/DOC-8841\" target=\"_blank\">Effective
defenses against malware and ot… - Apple Community</a>
</p><pre>
code line #a
code line #b
code line #c
</pre><p> </p><p>\"Avoid phishing emails, fake 'virus' alerts, phony support calls, and other scams\"
<a href=\"https://support.apple.com/en-ca/HT204759\" target=\"_blank\">Avoid phishing emails, fake
'virus' alerts, phony support calls, and other scams - Apple Support</a>
<pre>
code line #1
code line #2
code line #3
</pre>
</p><p> </p><p></p>Run etrecheck.  The first five runs are free. Provided a report on your
machines hardware and software.  Great for diagnosing your system.  Click on the download
link at the bottom of the screen.
<a href=\"http://etrecheck.com/\" target=\"_blank\">EtreCheck</a></p><p></p>
<p></p><p>
<ol>
<li>point 1</li>
<li>point 2</li>
<li>point 3</li>
</ol>
 </p>
<p>the end</p>"
*)

-- Gets invoked here when you run in AppleScript editor or double click on the app icon.
on run
    global debug

    -- Write a message into the event log.
    log "  --- Starting on " & ((current date) as string) & " --- "

    set debug to 4
    -- 0 no debugging
    -- 1 displays input and output to this routine
    -- 2 moderate
    -- 3 display important "on" blocks
    -- 4 display end of important "on" blocks
    -- 5 display minor "on" blocks
    -- 6 intense
    set lf to character id 10

    if debug ≥ 3 then log "in --- run ---"


    (*
    set the clipboard to "<html><p>As you are using a non-Apple app to access your email or other  facilities, you are now required to use an 'app-specific' password in place of your normal iCloud password. In order to do this you need to set up two-factor authentication for your Apple ID, and for this you need to have either a Mac running El Capitan or above, or an iOS device running iOS9 or above.</p><p> </p><p><a href=\"https://support.apple.com/HT204915\" target=\"_blank\">Two-factor authentication for Apple ID - Apple Support</a></p><p> </p><p><a href=\"https://support.apple.com/HT204397\" target=\"_blank\">Using app-specific passwords - Apple Support</a></p><p> </p><p>If you are unable to set up two-factor authentication you should set up 2-step \"




Run etrecheck.  The
first five runs are free. Provided a report on your
machines hardware and software.  Great for diagnosing your system.  Click on the download
link at the bottom of the screen.
<a href=\"http://etrecheck.com/\" target=\"_blank\">EtreCheck</a></p><p></p>
<p></p><p>
<ol>
<li>point 1</li>
<li>point 2</li>
<li>point 3</li>
</ol>
 </p>
<p>the end</p>
"
    *)
    (*  set the clipboard to "<p>Simple put, Apple attempts
to provide all the
malware detection and removal you need in Mac OS X.</p>
<p></p><p></p><p></p>
<p>\"Effective defenses against malware and other threats\" by John Galt
<a href=\"https://discussions.apple.com/docs/DOC-8841\" target=\"_blank\">Effective
defenses against malware and ot… - Apple Community</a>
</p><pre>
code line #a
code line #b
code line #c
</pre><p> </p><p>\"Avoid phishing emails, fake 'virus' alerts, phony support calls, and other scams\"
<a href=\"https://support.apple.com/en-ca/HT204759\">Avoid phishing emails, fake
'virus' alerts, phony support calls, and other scams - Apple Support</a>
<pre>
code line #1
code line #2
code line #3
</pre>"
*)
    set theList to clipboard info
    if debug ≥ 2 then printClipboardInfo(theList)

    set cbInfo to get (clipboard info) as string

    -- Most likely, if we have HTML data in the clipboard it will be from a web browser or Word.
    if cbInfo contains "HTML" then

        if debug ≥ 2 then log "Working with HTML Class data from clipboard."
        set theBoard to the clipboard as «class HTML»

        set normalHtml to do shell script "osascript -e 'try' -e 'get the clipboard as «class HTML»' -e 'end try' | awk '{sub(/«data HTML/, \"\") sub(/»/, \"\")} {print}' | xxd -r -p "
        if debug ≥ 1 then
            log "...Print out plain text version of inputed HTML data from the clipboard..." & return & normalHtml
            hexDumpFormatOne("after converting to printable, normalHtml", normalHtml)
        end if

        -- don't let Windoze confuse us. convert Return LineFeed to lf
        set normalHtml to alterString(normalHtml, return & lf, lf)
        -- might as will convert classic macOS return to lf. We will have to look for less things.
        set normalHtml to alterString(normalHtml, return, lf)
        if debug ≥ 2 then hexDumpFormatOne("after altering line ends to LFs normalHtml", normalHtml)

        set returnedData to adjustBrowserHTML(normalHtml)
        if debug ≥ 2 then
            log "...Print out plain text version of adjusted HTML data ..." & return & returnedData
            log "...just printed plain text version"
            log "printed in hex"
            hexDumpFormatOne("returnedData", returnedData)
        end if

        set returnedData to convertToHTML(returnedData)
        try
            if debug ≥ 2 then log "returnedData is " & returnedData
        on error errStr number errorNumber
            log "===> We didn't find HTML data.   errStr is " & errStr & " errorNumber is " & errorNumber
            return 1
        end try
    else
        -- will work with a plain html or plain text.
        try
            if debug ≥ 2 then log "Working with plain html or plain text"
            set clipboardData to (the clipboard as text)
            if debug ≥ 2 then
                log "class clipboardData is " & class of clipboardData
                log "continuing plain html or plain text"
            end if

            if debug ≥ 1 then
                log "inputted clipboardData is " & clipboardData
                hexDumpFormatOne("inputted clipboardData", clipboardData)
            end if
        on error errStr number errorNumber
            log "===> We didn't find data on the clipboard.   errStr is " & errStr & " errorNumber is " & errorNumber
            display dialog "We didn't find HTML source code nor plain text on the clipboard." & return & "Please copy from a different source." giving up after 15
            return 1
        end try
        if debug ≥ 2 then log "calling common"
        set returnedData to common(clipboardData)
    end if
    if debug ≥ 2 then log "place on the clipboard returnedData is " & returnedData
    postToCLipboard(returnedData)
    -- return code
    return 0

end run

-- Folder actions.
-- Gets invoked here when something is dropped on the folder that this script is monitoring.
-- Right click on the folder to be monitored. services > Folder Action Settup...
on adding folder items to this_folder after receiving added_items
    -- Write a message into the event log.
    log "  --- Starting on " & ((current date) as string) & " --- "
    display dialog "TBD, some assembly required."
end adding folder items to



-- Gets invoked here when something is dropped on this AppleScript icon
on open dropped_items
    global debug
    set debug to 2
    -- Write a message into the event log.
    log "  --- Starting on " & ((current date) as string) & " --- "
    if debug ≥ 3 then log "in --- open ---"

    (*
    -- Debug code.
      set fileName to choose file with prompt "get file"
      set dropped_items to {fileName}
    *)
    if debug ≥ 2 then log "class of dropped_items is " & class of dropped_items
    display dialog "You dropped " & (count of dropped_items) & " item or items." & return & "  Caveat emptor. You have been warned." giving up after 6

    set totalFileData to ""
    repeat with droppedItem in dropped_items
        if debug ≥ 2 then
            log "The droppedItem is "
            -- display dialog "processing file " & (droppedItem as string) giving up after 3
            log droppedItem
            log "class = " & class of droppedItem
        end if
        set extIs to findExtension(droppedItem)
        set extIsU to makeCaseUpper(extIs)
        if extIsU is "HTML" or extIsU is "HTM" or extIsU is "TEXT" or extIsU is "TXT" then
            try
                set theFile to droppedItem as string
                set theFile to open for access file theFile
                set allOfFile to read theFile
                close access theFile
            on error theErrorMessage number theErrorNumber
                log "==> " & theErrorMessage & "error number " & theErrorNumber
                close access theFile
            end try
            if debug ≥ 2 then printHeader("read from file ( allOfFile )", allOfFile)
            set totalFileData to totalFileData & common(allOfFile)
        else
            -- we do not support this extension
            display dialog "We only support files with extenstion of html, htm, text or txt in either case. Your file had a " & extIs & " extention. Skipping" giving up after 10
        end if
    end repeat

    postToCLipboard(totalFileData)
    -- return code
    return 0

end open


-- ------------------------------------------------------
on common(clipboardData)
    global debug
    if debug ≥ 3 then log "in --- common ---"
    set ht to character id 9
    set lf to character id 10

    set cbInfo to get (clipboard info) as string
    (*
    Symbol  Meaning                 Hex     Used
        CR      Carriage Return         0d      classic Macintosh
        LF      Line Feed                       0a      UNIX
        CR/LF   Carriage Return/Line Feed   0d0a    MS-DOS, Windows, OS/2

    *)
    -- for some crazy reason, I found hex "090a" (HT LF) in a html file.
    set clipboardData to alterString(clipboardData, ht & lf, lf)
    -- don't let Windoze confuse us. convert Return LineFeed to lf
    set clipboardData to alterString(clipboardData, return & lf, lf)
    -- might as will convert classic macOS return to lf. We will have to look for less things.
    set clipboardData to alterString(clipboardData, return, lf)
    if debug ≥ 2 then hexDumpFormatOne("change various line ends to a LF. clipboardData", clipboardData)

    -- figure out what type of data we have: plain text or html source code text.
    set paraCount to count of textToList(clipboardData, "<p")
    set endparaCount to count of textToList(clipboardData, "</p>")
    set titleCount to count of textToList(clipboardData, "<title")
    set endTitleCount to count of textToList(clipboardData, "</title>")
    set aLinkCount to count of textToList(clipboardData, "href=\"http")
    -- mangled href="http
    set mangledLinkCount to count of textToList(clipboardData, "href=\\\"http")
    set brCount to count of textToList(clipboardData, "<br>")
    if debug ≥ 2 then
        log "Values used to distinguis HTML source code from plain text."
        log "paraCount  is " & paraCount
        log "endparaCount is " & endparaCount
        log "titleCount is " & titleCount
        log "endTitleCount is " & endTitleCount
        log "aLinkCount is " & aLinkCount
        log "brCount is " & brCount
        log "mangledLinkCount is " & mangledLinkCount
    end if

    -- note, textToList returns a count one greater than the actual because item one is the data before the first found entry.
    if paraCount ≥ 4 and endparaCount ≥ 3 or brCount ≥ 4 or ((titleCount is endTitleCount) and titleCount ≥ 2) or aLinkCount ≥ 3 or mangledLinkCount ≥ 3 then
        -- ASC tends to convert line-ends to either <p></p> or <p><br></p>. Isn't desireable for HTML input
        if debug ≥ 2 then log "... found HTML input ... (in plain text format )."
        set clipboardData to adjustBrowserHTML(clipboardData)

    else
        if debug ≥ 2 then log "... found plain Text input ..."
        set clipboardData to typeText(clipboardData)
    end if
    set readyData to convertToHTML(clipboardData)
    if debug ≥ 4 then log "bye from  -.- common -.-"
    return readyData
end common

-- ------------------------------------------------------
(* add paragraphs *)
on addParagraphs(theOutputBuffer)
    global debug
    if debug ≥ 3 then log "in --- addParagraphs ---"
    set lf to character id 10

    -- start the theOutputBuffer with a paragraph tag.  We are taking a simple approach at this time.
    set theOutputBuffer to "<p>" & theOutputBuffer
    --  LF
    -- Remember CRLF was changed to LF above and CR was chanaged to LF above.
    -- we don't want no Windoze problems
    set theOutputBuffer to alterString(theOutputBuffer, lf & lf, "</p><p> </p><p>")

    -- Does the string end with a dangling paragraph?
    if debug ≥ 5 then
        log "length of theOutputBuffer is " & length of theOutputBuffer
    end if
    if (length of theOutputBuffer) > (length of "</p>") then
        if text ((length of theOutputBuffer) - 2) thru (length of theOutputBuffer) of theOutputBuffer is "<p>" then
            set theOutputBuffer to text 1 thru ((length of theOutputBuffer) - 3) of theOutputBuffer
        else if text ((length of theOutputBuffer) - 2) thru (length of theOutputBuffer) of theOutputBuffer is not "</p>" then
            set theOutputBuffer to theOutputBuffer & "</p>"
        end if
    end if
    if debug ≥ 4 then log "bye from  -.- addParagraphs -.-"
    return theOutputBuffer
end addParagraphs

-- ------------------------------------------------------
(*
  We received HTML class data on the clipboard.  This is the manager.
  At this point, we expect only LFs in the text.
 *)
on adjustBrowserHTML(normalHtml)
    global debug
    if debug ≥ 3 then log "in --- adjustBrowserHTML ---"
    set lf to character id 10

    set alteredHTML to adjustURLs(normalHtml)
    set alteredHTML to adjustToAscHTML(alteredHTML)
    if debug ≥ 4 then log "bye from  -.- adjustBrowserHTML -.-"
    return alteredHTML
end adjustBrowserHTML

-- ------------------------------------------------------
on adjustLF(theBuffer)
    global debug
    set lf to character id 10
    if debug ≥ 3 then log "in --- adjustLF() ---"
    if debug ≥ 2 then hexDumpFormatOne("input from theBuffer", theBuffer)
    set numberOfLf to 1 -- for debuggin so we can display loop count

    set inputLfBuffer to theBuffer -- now, input data
    set outputBuildLf to "" -- output data
    -- copy & change
    -- ditch leading LFs
    repeat while length of inputLfBuffer ≥ 2 and text 1 thru 1 of inputLfBuffer is lf
        if debug ≥ 2 then log "found leading lf. current length of inputLfBuffer is " & getIntegerAndHex(length of inputLfBuffer)
        -- just lob off LF
        set inputLfBuffer to text 2 thru -1 of inputLfBuffer

        log "next text character is " & text 1 thru 1 of inputLfBuffer
    end repeat
    (*
    -- not sure that this is helpful.
    -- preserve spacing
    if debug ≥ 2 then log "converting 4, 3 and 2 LFs to <p>'s."
    set inputLfBuffer to alterString(inputLfBuffer, lf & lf & lf & lf, "<p><br></p><p>~3~</p><p><br></p>")
    set inputLfBuffer to alterString(inputLfBuffer, lf & lf & lf, "<p><br></p><p>~2~</p>")
    set inputLfBuffer to alterString(inputLfBuffer, lf & lf, "<p><br></p><p>~1~</p>")
    if debug ≥ 2 then hexDumpFormatOne("after ditching and changing multiple LFs inputLfBuffer", inputLfBuffer)
    *)

    repeat until inputLfBuffer is ""

        set whereLfOffset to offset of lf in inputLfBuffer
        if debug ≥ 2 then log "whereLfOffset is " & whereLfOffset & " in hex " & integerToHex(whereLfOffset)

        -- get before and after characters if present.
        if whereLfOffset ≥ 2 then
            set priorCharacter to (text (whereLfOffset - 1) thru (whereLfOffset - 1) in inputLfBuffer)
        else
            set priorCharacter to ""
        end if
        if whereLfOffset ≥ (length of inputLfBuffer) then
            -- no following character
            set followingCharacter to ""
        else
            set followingCharacter to (text (whereLfOffset + 1) thru (whereLfOffset + 1) in inputLfBuffer)
        end if
        if debug ≥ 2 then log "priorCharacter is >" & priorCharacter & "< followingCharacter is >" & followingCharacter & "<"

        -- process the LF.
        if (whereLfOffset is 1) and ((length of inputLfBuffer) ≥ 2) then
            set inputLfBuffer to text 2 thru -1 of inputLfBuffer
            if debug ≥ 2 then log "leading lf.  Got rid of it."
            -- nothing to move to outputBuildLf
        else if (whereLfOffset is 1) and ((length of inputLfBuffer) is 1) then
            -- we have found all theLFs to find.
            set inputLfBuffer to ""
            if debug ≥ 2 then log "only one character left.  Got rid of it."
        else if followingCharacter is "" then
            if debug ≥ 2 then log "null"
            -- didn't we just check this? Yes, but we need to iterate somehow.
            set {inputLfBuffer, outputBuildLf} to trimLf(inputLfBuffer, outputBuildLf, whereLfOffset, " ")
            -- just skip it, so we don't have to put anything on outputBuildLf
        else if priorCharacter is ">" then
            --  LF after HTML tag. no real need for lf here.  asc tends to make these into <p></p>
            if debug ≥ 2 then log "found a tag"
            -- copy prior stuff
            set {inputLfBuffer, outputBuildLf} to trimLf(inputLfBuffer, outputBuildLf, whereLfOffset, "")
        else if followingCharacter is lf then
            -- prevent double LFs.
            if debug ≥ 2 then log "prevent double LFs at" & getIntegerAndHex(whereLfOffset)
            set {inputLfBuffer, outputBuildLf} to trimLf(inputLfBuffer, outputBuildLf, whereLfOffset, "")
            -- middle of text
        else if (whereLfOffset < (length of inputLfBuffer)) and followingCharacter is " " then
            -- we need to avoid double blanks
            -- purge
            if debug ≥ 2 then log "getting rid of lf at " & getIntegerAndHex(whereLfOffset)
            -- skip lf.
            set {inputLfBuffer, outputBuildLf} to trimLf(inputLfBuffer, outputBuildLf, whereLfOffset, "")
        else
            -- assume there are character before and after the LF.
            if debug ≥ 2 then log "punt."
            -- replace with blank
            set {inputLfBuffer, outputBuildLf} to trimLf(inputLfBuffer, outputBuildLf, whereLfOffset, " ")
        end if

        if debug ≥ 2 then
            hexDumpFormatOne("outputBuildLf of " & numberOfLf, outputBuildLf)
            hexDumpFormatOne("inputLfBuffer of " & numberOfLf, inputLfBuffer)
        end if
        -- next pass will be
        set numberOfLf to numberOfLf + 1
    end repeat
    if debug ≥ 4 then log "bye from  -.- adjustLF() -.-"
    return outputBuildLf
end adjustLF

-- ------------------------------------------------------
(* ASC likes to insert lots of white space into a page.
  This routine attempt to fix up the html to avoid
  all the extra white-space.

   Minimize the amount of white space inserted.
 *)

on adjustToAscHTML(ascHtml)
    global debug
    if debug ≥ 3 then log "in --- adjustToAscHtml ---"
    set lf to character id 10
    set numberOfPres to 1
    -- In the context of HTML, LF should mostly be insignificant.
    -- Would be bad to change a LF inside the <pre>  tag.
    --skip changing lf in "<pre>.
    set buildHtml to "" -- will contain the output
    if debug ≥ 2 then log "find <pre>s"
    -- copy & change
    if (offset of "</pre>" in ascHtml) is not 0 then
        repeat while (offset of "</pre>" in ascHtml) is not 0
            -- get text before "<pre" tag
            set splitString to item 1 of splitTextToList(ascHtml, "<pre")
            if debug ≥ 2 then
                log "splitString is " & splitString
                hexDumpFormatOne("buildHtml *before* adjustLF()", buildHtml)
            end if
            set buildHtml to buildHtml & adjustLF(splitString)
            hexDumpFormatOne("buildHtml after adjustLF()", buildHtml)

            -- lob off header text we processed
            -- while we found the text before "<pre", we still need to get it out
            -- of ascHtml
            --  & gets rid of the token ("<pre"), so fix
            set ascHtml to "<pre" & chompLeftAndTag(ascHtml, "<pre")

            -- any more <pre> tags?
            if ascHtml is "" then
                display dialog "HTML missing </pre> tag. possible logic error." giving up after 10
                -- none. We have already adjusted buildHtml
                exit repeat -- ------ done processing ascHtml ------>
            end if
            if debug ≥ 2 then hexDumpFormatOne("remaining ascHtml is ", ascHtml)

            -- tack on the unaltered <pre>..</pre> stuff
            set buildHtml to buildHtml & (item 1 of splitTextToList(ascHtml, "</pre>")) & "</pre>"
            if debug ≥ 2 then hexDumpFormatOne("buildHtml after finding </pre>", buildHtml)

            set ascHtml to chompLeftAndTag(ascHtml, "</pre>")
            if debug ≥ 2 then hexDumpFormatOne("ascHtml end of " & numberOfPres & " pass", ascHtml)
            set numberOfPres to numberOfPres + 1

        end repeat
        -- remainder
        set buildHtml to buildHtml & adjustLF(ascHtml)
        set ascHtml to ""
    else
        -- lf's are only signigicant in <pre>...</pre>
        if debug ≥ 2 then log "didn't find a <pre>"
        -- all others are white space.
        set buildHtml to adjustLF(ascHtml)
        set ascHtml to "" -- input text processed
    end if


    (*
    Hack about to fix ASC interpretation of HTML.

    ASC alters the definition of a paragraph to have not space before or after the paragraph.
    A paragraph like <p></p> works like a <br>.

    Consequently, ASC converts <p> </p> to <p><br></p>, that is a
    space only paragraph to a paragraph with a <br> in it.

    the code converts one tag on a line to a line of tags.
    </ol>
    </p>
    <p>
    converted form
    </ol></p><p>

    so that means a change on </ol></p><p> converts both the multi-lines form and the single line form.

    *)
    set buildHtml to alterString(buildHtml, "<br> ", "<br>")
    -------------------- failure???
    --set buildHtml to alterString(buildHtml, "<p> ", "<p>")

    -- asc paragraphs don't generate space before and after the paragraph.
    set buildHtml to alterString(buildHtml, "</p><p></p><p></p>", "</p><p> </p><p></p>")

    set buildHtml to alterString(buildHtml, "</p><p></p><p></p>", "</p><p> </p><p></p>")

    set buildHtml to alterString(buildHtml, "</ol></p><p>", "</ol><p> </p></p><p>")
    (*
    surprisingly ASC converts <p> </p> to <p><br></p>, that is a
    space only paragraph to a paragraph with a <br> in it.

    the code converts one tag on a line to a line of tags.
    </ol>
    </p>
    <p>
    converted form
    </ol></p><p>

    so that means a change on </ol></p><p> converts both the multi-lines form and the single line form.

    *)
    --set buildHtml to alterString(buildHtml, "<p> </p>", "<p></p>")
    if debug ≥ 2 then hexDumpFormatOne("complete buildHtml ", buildHtml)
    if debug ≥ 4 then log "bye from  -.- adjustToAscHTML -.-"
    return buildHtml
end adjustToAscHTML

-- ------------------------------------------------------
(*
example:
  Free version of Parallels for individual use:</p><p><br></p>
  <p>https://itunes.apple.com/us/app/parallels-desktop-lite/id1085114709?mt=12</p>
  <p><br></p>
  <p>Full version</p><p><a href="http://www.parallels.com/en/products/desktop/" target="_blank">
     http://www.parallels.com/en/products/desktop/</a>

If asc find a URL outside of an a tag, it will place blank lines around the URL. No, it will not go the
full nine yards and place an a tag around the url.

*)
on adjustURLs(theOriginalInputBuffer)
    global debug
    if debug ≥ 3 then log "in --- adjustURLs ---"
    set alteredBuffer to false
    set lf to character id 10
    set theInputBuffer to theOriginalInputBuffer
    if debug ≥ 2 then hexDumpFormatOne("theInputBuffer", theInputBuffer)

    -- we end up in a lot of grief when the buffer ends without
    -- a line-end
    if text (length of theInputBuffer) thru (length of theInputBuffer) of theInputBuffer is not lf then
        -- tack LF at the end
        set alteredBuffer to true
        set theInputBuffer to theInputBuffer & lf
        if debug ≥ 2 then hexDumpFormatOne("theInputBuffer", theInputBuffer)
    end if

    set buildHtml to ""
    if debug ≥ 5 then log "buildHTML [ should be empty string ] is " & buildHtml
    set countI to 1 -- variable is used for debuging.
    -- do until we have processed theInputBuffer
    repeat until theInputBuffer is ""
        if debug ≥ 2 then log "at the top of theInputBuffer ........."

        set foundWhere to {}
        repeat with lookCharacters in {"https://", "http://", "<a "}
            copy (offset of lookCharacters in theInputBuffer) to the end of the foundWhere
            try
                set tempLoc to (offset of lookCharacters in theInputBuffer)
                if debug ≥ 2 then log "searching for " & lookCharacters & " found at offset  " & tempLoc & " contains " & text tempLoc thru (tempLoc + ((length of lookCharacters) - 1)) of theInputBuffer
            end try
        end repeat
        if debug ≥ 2 then log foundWhere
        set foundMarkerOffset to (minimumPositiveNumber from foundWhere)
        -- figure out what type of marker we got?

        -- None.  Reached the end of the data without finding one.
        if foundMarkerOffset ≤ 0 then
            -- we are done
            if debug ≥ 2 then log "Found all links."
            set buildHtml to buildHtml & theInputBuffer
            if debug ≥ 2 then printHeader("buildHTML", buildHtml)
            set theInputBuffer to ""
            exit repeat -- ------ done processing theInputBuffer ------>
        end if

        -- find which of three markers we found.
        if (text foundMarkerOffset thru (foundMarkerOffset + 2) of theInputBuffer) is "<a " then
            set actualMarker to "<a "
        else if text foundMarkerOffset thru (foundMarkerOffset + 6) of theInputBuffer is "http://" then
            set actualMarker to "http://"
        else
            -- just assume it's the remaining "https://" since we looked for just three.
            set actualMarker to "https://"
        end if
        set actualMarkerOffsetLength to ((length of actualMarker) - 1)
        if debug ≥ 2 then
            log "actualMarker is " & actualMarker & " actualMarkerOffsetLength is " & actualMarkerOffsetLength
            log "foundMarkerOffset is " & getIntegerAndHex(foundMarkerOffset) & "  verify marker text is " & text foundMarkerOffset thru (foundMarkerOffset + actualMarkerOffsetLength) of theInputBuffer
        end if


        if foundMarkerOffset ≥ 2 then
            -- collect and strip off characters that are before the marker.
            if debug ≥ 2 then
                log "buildHTML is " & buildHtml & " length is " & getIntegerAndHex(length of buildHtml)
                hexDumpFormatOne("theInputBuffer", theInputBuffer)
                log " (foundMarkerOffset - 1) is " & getIntegerAndHex((foundMarkerOffset - 1))
            end if
            -- get the proceding text
            set buildHtml to buildHtml & text 1 thru (foundMarkerOffset - 1) of theInputBuffer
            if debug ≥ 2 then
                log "buildHTML is " & buildHtml
                hexDumpFormatOne("buildHTML", buildHtml)
            end if

            -- https://apple.stackexchange.com/a/20135/44531

            set theInputBuffer to text foundMarkerOffset thru -1 of theInputBuffer --trim off character before what we found
            if debug ≥ 2 then
                printHeader("theInputBuffer", theInputBuffer)
                hexDumpFormatOne("theInputBuffer", theInputBuffer)
            end if
        else
            log "==> no proceeding data."
        end if

        repeat 1 times -- interate loop

            -- example" the url is also the display text
            -- <a href="https://discussions.apple.com/docs/DOC-8841" target="_blank">https://discussions.apple.com/docs/DOC-8841</a>
            if debug ≥ 2 then hexDumpFormatOne("theInputBuffer", theInputBuffer)

            -- check for the <a> tag
            if text 1 thru (length of "<a ") of theInputBuffer is "<a " then
                -- found <a> tag
                if debug ≥ 2 then log "processing <a> tag"
                -- ASC consider a line-end as a <br> when when firefox considers it a blank
                -- change a possible line-end before an <a> tag to a " "
                if debug ≥ 2 then hexDumpFormatOne("before lf check buildHTML", buildHtml)
                if text (length of buildHtml) thru (length of buildHtml) of buildHtml is lf then
                    if debug ≥ 2 then log "we need to delete a line-end before the <a> tag"
                    set buildHtml to text 1 thru ((length of buildHtml) - 1) of buildHtml
                    set buildHtml to buildHtml & " "
                    if debug ≥ 2 then hexDumpFormatOne("after lf deletion buildHTML", buildHtml)
                end if
                -- find ending </a> tag
                set whereEnds to offset of "</a>" in theInputBuffer
                if whereEnds ≤ 0 then
                    if debug ≥ 2 then log "==> found an error in the HTML.  no ending </a>"
                    set buildHtml to buildHtml & theInputBuffer
                    printHeader("buildHTML", buildHtml)
                    set theInputBuffer to ""
                    display dialog "Found an error in the HTML.  No ending </a>.  Will skip." giving up after 10
                    exit repeat -- ------ next ------>
                end if
                set lastOffsetLength to ((length of "</a>") - 1)
                if debug ≥ 2 then log "lastOffsetLength is " & lastOffsetLength
                set lastCharacterOffset to whereEnds + lastOffsetLength
                if debug ≥ 2 then log "lastCharacterOffset is " & lastCharacterOffset
                -- needs to copy the ending ">"
                set anchorString to text 1 thru lastCharacterOffset of theInputBuffer
                -- don't let Windoze confuse us. convert Return LineFeed to lf
                -- Correct absure ASC bug where there is a line-end in the <a> text.
                if debug ≥ 2 then hexDumpFormatOne("before adjusting anchorString", anchorString)
                set anchorString to alterString(anchorString, lf, " ")
                if debug ≥ 2 then hexDumpFormatOne("anchorString", anchorString)
                set buildHtml to buildHtml & anchorString
                if debug ≥ 2 then hexDumpFormatOne("buildHTML", buildHtml)
                -- https://apple.stackexchange.com/a/20135/44531
                -- We want first character of the "next" portion of theInputBuffer so add one
                set theInputBuffer to text (lastCharacterOffset + 1) thru -1 of theInputBuffer --trim out <a>
                if debug ≥ 2 then hexDumpFormatOne("theInputBuffer", theInputBuffer)
                -- Web Browsers like Firefox convert a line-end in text to a space.
                if text 1 thru 1 of theInputBuffer is lf then
                    if (length of theInputBuffer) is 1 then
                        set theInputBuffer to " "
                    else
                        set theInputBuffer to " " & (text 2 thru (length of theInputBuffer) of theInputBuffer)
                        if debug ≥ 2 then hexDumpFormatOne("after lf deletion; theInputBuffer", theInputBuffer)
                    end if
                end if
                exit repeat -- ------ next ------>
            end if

            -- find the end of the HTML URL by splitting on blank or return
            -- unsafe characters  <blank> " < > # % { } | \ ^ ~ [ ] `
            -- and line-end
            -- while # is listed as unsafe, it does appear in a url as a marker of some sort.
            -- leave it out as an ending character.
            -- https://perishablepress.com/stop-using-unsafe-characters-in-urls/
            -- the end of the clipboard string my end after the url, hence no " ", LF or CR
            -- Rember, CRLF was converted to LF above
            set endsWhere to {}
            -- the end of the url ends with one of the not allowed characters + line-end
            repeat with unsafeCharacter in {" ", "\"", lf, "<", ">", "%", "{", "}", "|", "\\", "^", "~", "[", "]"}
                copy (offset of unsafeCharacter in theInputBuffer) to the end of the endsWhere
            end repeat
            if debug ≥ 2 then log endsWhere
            set endOfURL to (minimumPositiveNumber from endsWhere) - 1

            if debug ≥ 2 then log "endOfURL is " & endOfURL

            if endOfURL ≤ 0 then
                -- We have reached the end of the input
                set theURL to theInputBuffer
                set theInputBuffer to ""
            else
                set theURL to text 1 thru endOfURL of theInputBuffer
                if debug ≥ 2 then log "from middle theURL is " & theURL

                set theInputBuffer to text (endOfURL + 1) thru -1 of theInputBuffer -- trim off url in front.
            end if
            printHeader("printHeader", theInputBuffer)
            if debug ≥ 1 then log "----------------------- " & theURL & " -----------------------"
            (*
            retrieve the file pointed to by the URL so we can
            get the title. Note: <title> can have attributes.  Example:

            <title data-test-page-title="Parallels Desktop Lite on the Mac App Store"
            >‎Parallels Desktop Lite on the Mac App Store</title>

            *)

            -- Example:
            -- curl --silent --location --max-time 10 <URL>
            set toUnix to "curl --silent --location --max-time 10 " & quoted form of theURL
            if debug ≥ 2 then log "what we will use to retrieve the Url. toUnix  is " & return & "  " & toUnix
            try
                if debug ≥ 2 then log "reading link file to get title"
                set fromUnix to do shell script toUnix
                --log "fromUnix:"
                if debug ≥ 2 then
                    printHeader("fromUnix", fromUnix)
                    -- may not be working with an HTLM document, so thefound title may be too long or confused.
                    log "how far?..."
                end if
                -- there could be some bagage with the <title
                set actualTagData to tagContent(fromUnix, "<title", "</title>")
                -- Find what we will actually display in the title.
                -- Fix up gotchas.
                if debug ≥ 2 then log "actualTagData  is " & printHeader("actualTagData", actualTagData)
                if actualTagData is "" then
                    set actualTagData to theURL
                else if length of actualTagData > 140 then
                    if debug ≥ 2 then log "length of actualTagData is " & length of actualTagData & "which is too long.  Truncated."
                    set actualTagData to theURL
                    -- curl https://appleid.apple.com returns <title>403 Forbidden</title>
                    -- which is misleading.
                else if actualTagData contains "403" and actualTagData contains "Forbidden" then
                    set actualTagData to theURL
                else
                    -- there could be some attributes within the <title> tag.
                    -- or there could not be
                    -- an attribute could have a > in it. ignoring that for now.
                    try
                        -- find where <title ends
                        set whereToEnd to (offset of ">" in actualTagData)
                        if debug ≥ 2 then log "whereToEnd is " & whereToEnd
                        set whereToBegin to whereToEnd + (length of ">")
                        if debug ≥ 2 then log "whereToBegin is " & whereToBegin
                        hexDumpFormatOne("actualTagData", actualTagData)
                        set actualTagData to text whereToBegin thru (length of actualTagData) of actualTagData
                        if debug ≥ 2 then log "actualTagData is " & actualTagData
                    on error theErrorMessage number theErrorNumber
                        log "==>No ending greater than (>) for title. Badly contructed html." & return & "message is " & theErrorMessage & "error number " & theErrorNumber
                        set actualTagData to actualTagData
                        -- no need to repair.  It's not our page.
                    end try

                    -- found line-end in title.  caused confustion.
                    -- note: this is new data and the multiple line-ends have not been
                    -- filtered out.
                    -- some joker had a line-end in the title!
                    set actualTagData to alterString(actualTagData, return & lf, "  ")
                    set actualTagData to alterString(actualTagData, return, " ")
                    set actualTagData to alterString(actualTagData, lf, "  ")
                    if debug ≥ 2 then log "actualTagData has been chanaged which is  " & actualTagData
                    hexDumpFormatOne("actualTagData", actualTagData)
                end if
            on error errMsg number n
                if debug ≥ 2 then log "==> Error occured when looking for title. " & errMsg & " with number " & n
                set actualTagData to theURL
            end try
            -- why the _blank in the <a>?
            set assembled to "<a href=\"" & theURL & "\" target=\"_blank\">" & actualTagData & "</a>"
            if debug ≥ 2 then log "assembled  is " & assembled

            if (length of theInputBuffer) ≤ 0 then
                -- We have reached the end of the input
                if debug ≥ 2 then log "we have reached the end of the input."
                set buildHtml to buildHtml & assembled
            else
                if debug ≥ 2 then log "more input to process"
                set buildHtml to buildHtml & assembled
            end if

            -- wrap up
            --log "transformed text from buildHTML is  " & return & buildHTML
            if debug ≥ 2 then log "#" & countI & " transformed text from buildHTML is  " & return & buildHtml
            -- number of links found
            set countI to countI + 1

        end repeat -- used to interate
    end repeat -- processing links in the input text
    if alteredBuffer is true then
        -- chop off the lf we added above.
        set buildHtml to text 1 thru ((length of buildHtml) - 1) of buildHtml
        set alteredBuffer to false -- somewhat redundant
    end if
    if debug ≥ 4 then log "bye from  -.- adjustURLs -.-"
    return the buildHtml

end adjustURLs

-- ------------------------------------------------------
(*
alterString
  thisText is the input string to change
  delim is what string to change.  It doesn't have to be a single character.
  replacement is the new string

  returns the changed string.
*)

on alterString(thisText, delim, replacement)
    global debug
    if debug ≥ 5 then log "in ~~~ alterString ~~~"
    set resultList to {}
    set {tid, my text item delimiters} to {my text item delimiters, delim}
    try
        set resultList to every text item of thisText
        set text item delimiters to replacement
        set resultString to resultList as string
        set my text item delimiters to tid
    on error
        set my text item delimiters to tid
    end try
    return resultString
end alterString

-- ------------------------------------------------------
(*
  Return the text to the right of theToken.
*)
on answerAndChomp(theString, theToken)
    global debug
    if debug ≥ 5 then log "in ~~~ answerAndChomp ~~~"
    set debugging to false
    set theOffset to offset of theToken in theString
    if debug ≥ 6 then log "theOffset is " & theOffset
    set theLength to length of theString
    if theOffset > 0 then
        set beginningPart to text 1 thru (theOffset - 1) of theString
        if debug ≥ 6 then log "beginningPart is " & beginningPart

        set chompped to text theOffset thru theLength of theString
        if debug ≥ 6 then log "chompped is " & chompped
        return {chompped, beginningPart}
    else
        set beginningPart to ""
        return {theString, beginningPart}
    end if

end answerAndChomp

-- ------------------------------------------------------
(*
  Delete the leading part of the string until and including theToken.
*)
on chompLeftAndTag(theString, theToken)
    global debug
    if debug ≥ 6 then log "in --- chompLeftAndTag ---"
    if debug ≥ 5 then
        log "theToken is " & theToken
        hexDumpFormatOne("theString", theString)
    end if
    set theOffset to offset of theToken in theString
    if debug ≥ 5 then log "theOffset is " & theOffset & " in hex is " & integerToHex(theOffset)
    set theLength to length of theString
    if debug ≥ 5 then log "theLength is " & theLength & " in hex is " & integerToHex(theLength)

    if theOffset > 0 then
        -- Do we have any more of the string to return?
        if (theOffset + (length of theToken)) ≤ length of theString then
            set chompped to text (theOffset + (length of theToken)) thru theLength of theString
        else
            set chompped to ""
        end if
        if debug ≥ 5 then log "length of chompped is " & length of chompped & "chompped is " & chompped
        return chompped
    else
        return ""
    end if
end chompLeftAndTag

-- ------------------------------------------------------
on convertToHTML(theData)
    global debug
    if debug ≥ 3 then log "in --- convertToHTML ---" & return & "  Try to send back HTML. the processed data in variable theData is " & theData
    try
        set clipboardDataQuoted to quoted form of theData

        if debug ≥ 1 then
            log "------ data soon to be returned -------" & return & "clipboardDataQuoted is " & return & clipboardDataQuoted
            hexDumpFormatOne("clipboardDataQuoted", clipboardDataQuoted)
        end if
        -- make hex string as required for HTML data on the clipboard
        set toUnix to "/bin/echo -n " & clipboardDataQuoted & " | hexdump -ve '1/1 \"%.2x\"'"
        if debug ≥ 5 then printHeader("toUnix to convert to hex", toUnix)
        set fromUnix to do shell script toUnix

        if debug ≥ 5 then printHeader("fromUnix", fromUnix)

        if debug ≥ 5 then
            log "displaying original string --- so we can tell if it converted successfully. "
            --hexDumpFormatOne("fromUnix", fromUnix)
        end if
    on error errMsg number n
        log "==> convert to hex string failed. " & errMsg & " with number " & n
        set fromUnix to ""
    end try
    if debug ≥ 4 then log "bye from  -.- convertToHTML -.-"
    return fromUnix
end convertToHTML

-- ------------------------------------------------------
(*
Yvan Koenig
https://macscripter.net/viewtopic.php?id=43133
*)
on findExtension(inputFileName)
    global debug
    if debug ≥ 5 then log "in ~~~ indExtension ~~~"
    set fileName to inputFileName as string
    set saveTID to AppleScript's text item delimiters
    set AppleScript's text item delimiters to {"."}
    set theExt to last text item of fileName
    set AppleScript's text item delimiters to saveTID
    --log "theExt is " & theExt
    if theExt ends with ":" then set theExt to text 1 thru -2 of theExt
    if debug ≥ 5 then log "theExt is " & theExt
    return theExt
end findExtension

-- ------------------------------------------------------
(*
length of inputLfBuffer & " in hex " & integerToHex(length of inputLfBuffer)
*)
on getIntegerAndHex(aNumber)
    global debug
    if debug ≥ 5 then log "in ~~~ getIntegerAndHex ~~~"

    return aNumber & " in Hex " & integerToHex(aNumber)
end getIntegerAndHex

-- ------------------------------------------------------
(*
  http://krypted.com/mac-os-x/to-hex-and-back/
               0    2    4    6    8    a    c    e     0 2 4 6 8 a c e
0000000:   3c 703e 5369 6d70 6c65 2070 7574 2c20   <p>Simple put,
            *)
on hexDumpFormatOne(textMessage, hex)
    global debug
    set aNul to character id 1

    if debug ≥ 5 then
        log "in ~~~ hexDumpFormatOne ~~~"
        log "input string is " & return & hex
    end if
    -- -r -p
    set displayValue to aNul & hex
    set toUnix to "/bin/echo -n " & (quoted form of displayValue) & " | xxd  "
    if debug ≥ 5 then log "toUnix is " & toUnix
    try
        set fromUnix to do shell script toUnix

        set displayText to replaceCharacter(fromUnix, 10, "  ")
        if debug ≥ 5 then
            log return & displayText
            log "length of displayText is " & length of displayText
        end if
        set displayText to replaceCharacter(displayText, 51, " ")
        if debug ≥ 5 then
            log return & displayText
            log "almost there ..... length of displayText is " & length of displayText
        end if
        log "variable " & textMessage & " in hex is " & return & "         0    2    4    6    8    a    c    e     0 2 4 6 8 a c e" & return & displayText
    on error errMsg number n
        log "==> convert hex string to string failed. " & errMsg & " with number " & n
    end try
    if debug ≥ 5 then
        log "leaving ~.~ hexDumpFormatOne ~.~"
    end if
end hexDumpFormatOne

-- ------------------------------------------------------
on hexDumpFormatZero(textMessage, hex)
    global debug
    if debug ≥ 5 then log "in ~~~ hexDumpFormatZero ~~~"
    if debug ≥ 5 then log "input string is " & hex
    -- -r -p
    set toUnix to "/bin/echo -n " & (quoted form of hex) & " | xxd  "
    if debug ≥ 5 then log "toUnix is " & toUnix
    try
        set displayText to do shell script toUnix

        log "variable " & textMessage & " in hex is " & return & "         0    2    4    6    8    a    c    e     0 2 4 6 8 a c e" & return & displayText
    on error errMsg number n
        log "==> convert hex string to string failed. " & errMsg & " with number " & n
    end try
end hexDumpFormatZero

-- ------------------------------------------------------
(*
https://macscripter.net/viewtopic.php?id=43713
  *)
on integerToHex(nDec)
    global debug
    if debug ≥ 5 then log "in ~~~ integerToHex ~~~"
    try
        set nHex to do shell script "perl -e 'printf(\"%X\", " & nDec & ")'" --> "F0"
    on error errMsg number n
        log "==> convert integer to hex. " & errMsg & " with number " & n
        set nHex to ""
    end try
    return nHex
end integerToHex
-- ------------------------------------------------------
(*

https://stackoverflow.com/questions/55838252/minimum-value-that-not-zero
       set m to get minimumPositiveNumber from {10, 2, 0, 2, 4}
    log "m is " & m
    set m to minimumPositiveNumber from {0, 0, 0}
    log "m is " & m
*)
on minimumPositiveNumber from L
    global debug
    if debug ≥ 5 then log "in ~~~ minimumPositiveNumber ~~~"
    local L

    if L = {} then return null

    set |ξ| to 0

    repeat with x in L
        set x to x's contents
        if (x < |ξ| and x ≠ 0) ¬
            or |ξ| = 0 then ¬
            set |ξ| to x
    end repeat

    |ξ|
end minimumPositiveNumber

-- ------------------------------------------------------
(*
  makeCaseUpper("Now is the time, perhaps, for all good men")
*)
on makeCaseUpper(theString)
    global debug
    if debug ≥ 5 then log "in ~~~ makeCaseUpper ~~~"
    set UC to "ABCDEFGHIJKLMNOPQRSTUVWXYZ"
    set LC to "abcdefghijklmnopqrstuvwxyz"
    set C to characters of theString
    repeat with ch in C
        if ch is in LC then set contents of ch to item (offset of ch in LC) of UC
    end repeat
    return C as string
end makeCaseUpper

-- ------------------------------------------------------
on postToCLipboard(pleasePost)
    global debug
    if debug ≥ 5 then log "in ~~~ postToCLipboard ~~~"
    try
        -- osascript -e "set the clipboard to «data HTML${hex}»"
        set toUnixSet to "osascript -e \"set the clipboard to «data HTML" & pleasePost & "»\""
        if debug ≥ 5 then log "toUnixSet is " & printHeader("toUnixSet", toUnixSet)

        set fromUnixSet to do shell script toUnixSet
        if debug ≥ 5 then log "fromUnixSet is " & fromUnixSet

    on error errMsg number n
        log "==> We tried to send back HTML data, but failed. " & errMsg & " with number " & n
    end try
    -- see what ended up on the clipboard
    set theList2 to clipboard info
    if debug ≥ 2 then printClipboardInfo(theList2)
end postToCLipboard

-- ------------------------------------------------------
on printClipboardInfo(theList)
    global debug
    if debug ≥ 5 then log "in ~~~ printClipboardInfo ~~~"
    log (clipboard info)
    log class of theList
    log "Data types on the clipboard ... "
    printList("", theList)
    log "... "
end printClipboardInfo

-- ------------------------------------------------------
(* Pump out the beginning of theString *)
on printHeader(theName, theString)
    global debug
    if debug ≥ 5 then
        log "in ~~~ printHeader ~~~"
        log "theName is " & theName
        log theString
        log "length of theString is " & length of theString
    end if
    if length of theString ≤ 0 then
        log "==> no string to print"
    else
        log theName & " is " & return & text 1 thru (minimumPositiveNumber from {400, length of theString}) of theString & "<+++++++++"
    end if
end printHeader

-- ------------------------------------------------------
(*
print out the items in a list

*)

on printList(theName, splits)
    global debug
    if debug ≥ 5 then log "in ~~~ printList ~~~"
    try
        set theCount to 1
        repeat with theEntry in splits
            --log "class of theEntry is " & class of theEntry
            set classDisplay to class of theEntry as text
            --log "classDisplay is " & classDisplay as text
            --log "class of classDisplay is " & class of classDisplay
            if classDisplay is "list" then
                log "    " & theName & theCount & " is " & item 1 of theEntry & "; " & item 2 of theEntry
            else
                log "    " & theName & theCount & " is " & theEntry
            end if
            set theCount to theCount + 1
        end repeat
    on error errMsg number n
        log "==> No go in printList. " & errMsg & " with number " & n
    end try
end printList

-- ------------------------------------------------------
(*
StefanK in https://macscripter.net/viewtopic.php?id=43852
Replaces one or more characters based on the length of theCharacter.

  Big Warning!!!
  ==============
    This on block is called by hexDumpFormatOne().
    Therefor, you may not call hexDumpFormatOne() from this on block.
    If you so so, you get yourself into an endless loop.
    Use hexDumpFormatZero() instead.

    script -k <output file name>
    osascript /Applications/applescriptFiles/workwithclipboardV13-HTML.app
    use Activity Monito to stop osascript

*)

on replaceCharacter(theText, theOffset, theCharacter)
    global debug
    if debug ≥ 5 then
        log "in ~~~ replaceCharacter ~~~"
        log "  theOffset is " & getIntegerAndHex(theOffset) & " with theCharacter >" & theCharacter & "<  length of theText is " & getIntegerAndHex(length of theText)
        log "theText is " & theText
    end if

    set theOutput to theText -- ready to return if need be.
    repeat 1 times
        -- sanity checks
        if theOffset ≤ 0 then
            display dialog "No character to replace at " & theOffset & " with character " & theCharacter & " in " & theText giving up after 10
            log "==> Adjust theOffset to be wihin the string."
            exit repeat -------------- return ---------->
        end if
        if (theOffset - (length of theCharacter)) ≤ 0 then
            display dialog "Too near the front of the buffer.  " & theOffset & " with character " & theCharacter & " in " & theText giving up after 10
            log "==> Too near the front of the buffer. "
            exit repeat -------------- return ---------->
        end if
        if (theOffset + (length of theCharacter) - 1) > (length of theText) then
            display dialog "To near the end of the buffer. " & theOffset & " with character " & theCharacter & " in " & theText giving up after 10
            log "==> Too near the end of the buffer. "
            log "  " & "theOffset is " & theOffset & " with theCharacter >" & theCharacter & "<  in " & theText
            log "length of buffer is " & getIntegerAndHex(length of theText)
            exit repeat -------------- return ---------->
        end if

        if debug ≥ 6 then
            log "theOffset is " & getIntegerAndHex(theOffset)
            log "theCharacter is " & theCharacter
        end if

        try
            -- what if we are at the end of the buffer.  We cannot get any remainder text.
            if theOffset ≥ (length of theText) then
                set theOutput to (text 1 thru (theOffset - 1) of theText) & theCharacter
            else
                set theOutput to (text 1 thru (theOffset - 1) of theText) & theCharacter & (text (theOffset + (length of theCharacter)) thru -1 of theText)
            end if
        on error errMsg number n
            log "==> No go. " & errMsg & " with number " & n
            exit repeat -------------- return ---------->
        end try
    end repeat
    return theOutput
end replaceCharacter

-- ------------------------------------------------------
(*
splitTextToList seems to be what you are trying to do
  thisText is the input string
  delim is what to split on

  results returned in a list

  Total hack. We know splitTextToList strips of delim so add it back.
*)

on splitTextToList(thisText, delim)
    global debug
    if debug ≥ 5 then log "in ~~~ splitTextToList ~~~"

    set returnedList to textToList(thisText, delim)
    set resultArray to {}
    copy item 1 of returnedList to the end of the resultArray

    repeat with i from 2 to (count of returnedList) in returnedList
        set newElement to delim & item i of returnedList
        copy newElement to the end of the resultArray
    end repeat

    return resultArray
end splitTextToList

-- ------------------------------------------------------
(*
  Retrieved data between "begin" and "end" tag. Whatever is between the strings.
*)
on tagContent(theString, startTag, endTag)
    global debug
    if debug ≥ 5 then log "in ~~~ tagContent ~~~"
    try
        if debug ≥ 5 then log "in tabContent. " & return & "    startTag is " & startTag & " endTag is " & endTag
        set beginningOfTag to chompLeftAndTag(theString, startTag)
        if length of beginningOfTag ≤ 0 then
            set middleText to ""
        else
            printHeader("beginningOfTag", beginningOfTag)
            set endingOffset to (offset of endTag in beginningOfTag)

            if endingOffset ≤ (length of endTag) then
                set middleText to ""
            else
                set middleText to text 1 thru (endingOffset - 1) of beginningOfTag
                printHeader("middleText is ", middleText)
            end if
        end if
    on error errMsg number n
        log "==> finding contained text failed. " & errMsg & " with number " & n
        set middleText to ""
    end try
    if debug ≥ 5 then log "returning with middleText is " & middleText
    return middleText
end tagContent

(*
textToList seems to be what you are trying to do
  thisText is the input string
  delim is what to split on

  returns a list of strings.

- textToList was found here:
- http://macscripter.net/viewtopic.php?id=15423

*)

on textToList(thisText, delim)
    global debug
    if debug ≥ 5 then log "in ~~~ textToList ~~~"
    set resultList to {}
    set {tid, my text item delimiters} to {my text item delimiters, delim}

    try
        set resultList to every text item of thisText
        set my text item delimiters to tid
    on error
        set my text item delimiters to tid
    end try
    return resultList
end textToList

-- ------------------------------------------------------
on trimLf(inputLf, outputTrimmed, theLfOffset, substitueCharacter)
    global debug

    if debug ≥ 3 then
        log "in ~~~ trimLf ~~~"
        hexDumpFormatOne("inputLf", inputLf)
        hexDumpFormatOne("outputTrimmed", outputTrimmed)
        log "theLfOffset, is " & getIntegerAndHex(theLfOffset)
        log "with substitueCharacter >" & substitueCharacter & "<  "
    end if

    -- check boundaries
    if theLfOffset ≤ 0 or (theLfOffset > (length of inputLf)) then
        -- We are almost done.
        log "no LF found."
        -- tack on any trialing stuff
        set outputTrimmed to outputTrimmed & inputLf
        set inputLf to ""
        if debug ≥ 3 then
            hexDumpFormatOne("inputLf", inputLf)
            hexDumpFormatOne("outputTrimmed", outputTrimmed)
        end if
        return {inputLf, outputTrimmed} ------------ return ------------>
    end if

    -- We need to deal with output first, so we haven't trimmed the input we need.
    if theLfOffset ≥ 2 then
        set outputTrimmed to outputTrimmed & (text 1 thru (theLfOffset - 1) of inputLf) & substitueCharacter
    else if theLfOffset = 1 then
        -- no stuff before the lf
        set outputTrimmed to outputTrimmed & substitueCharacter
    end if

    -- deal with inputLf.
    if theLfOffset < (length of inputLf) then
        -- trailing stuff
        set inputLf to text (theLfOffset + 1) thru -1 of inputLf
    else if theLfOffset is (length of inputLf) then
        set inputLf to ""
    end if

    if debug ≥ 3 then
        hexDumpFormatOne("inputLf", inputLf)
        hexDumpFormatOne("outputTrimmed", outputTrimmed)
    end if
    if debug ≥ 4 then log "bye from  -.- trimLf -.-"
    return {inputLf, outputTrimmed}

end trimLf

-- ------------------------------------------------------
(*
         Unix-like systems      LF      0A      \n
            (Linux, macOS)
               Microsoft Windows    CRLF    0D 0A   \r\n
               classic Mac OS       CR      0D          \r   Applescript return
  *)
on typeText(theData)

    global debug
    if debug ≥ 5 then log "in ~~~ typeText ~~~"
    set lf to character id 1

    if debug ≥ 2 then printHeader("the input  ( theData )", theData)
    -- Example: -- https://discussions.apple.com/docs/DOC-8841
    -- locate links

    set theOutputBuffer to adjustURLs(theData)

    -- add paragraphs
    set theOutputBuffer to addParagraphs(theOutputBuffer)

    if debug ≥ 2 then log "theOutputBuffer is " & return & theOutputBuffer
    if debug ≥ 4 then log "bye from  -.- typeText -.-"
    return theOutputBuffer
end typeText



(*
https://www.oreilly.com/library/view/applescript-the-definitive/0596102119/re89.html

https://stackoverflow.com/questions/11085654/apple-script-how-can-i-copy-html-content-to-the-clipboard

-- user has copied a file's icon in the Finder
clipboard info
-- {{string, 20}, {«class ut16», 44}, {«class hfs », 80}, {«class
 utf8», 20}, {Unicode text, 42}, {picture, 2616}, {«class icns», 43336},
{«class furl», 62}}

textutil -convert html foo.rtf

if ((clipboard info) as string) contains "«class furl»" then
        log "the clipboard contains a file named " & (the clipboard as string)
    else
        log "the clipboard does not contain a file"
    end if

the clipboard       required
as  class   optional

tell application "Script Editor"
        activate
    end tell

textutil has a simplistic text to html conversion
    set clipboardDataQuoted to quoted form of theData
    log "quoted form is " & clipboardDataQuoted

    set toUnix to "/bin/echo -n " & clipboardDataQuoted
    set toUnix to toUnix & " | textutil -convert html -noload -nostore -stdin -stdout "
    log "toUnix is " & toUnix
    set fromUnix to do shell script toUnix
    log "fromUnix  is " & fromUnix


set s to "Today is my birthday"
log text 1 thru ((offset of "my" in s) - 1) of s
--> "Today is "
            -- text 1 thru ((offset of "my" in s) - 1) of s
            -- -1 since offset return the first character "m" position count

log "beginningOfTag is " & text 1 thru (minimumPositiveNumber from {200, length of beginningOfTag}) of beginningOfTag & "<+++++++++++++++++++++++"

https://developer.apple.com/library/archive/documentation/AppleScript/Conceptual/AppleScriptLangGuide/reference/ASLR_cmds.html

*)

--mac $ hex=`echo -n "<p>your html code here</>" | hexdump -ve '1/1 "%.2x"'`
--mac $ echo $hex
--3c703e796f75722068746d6c20636f646520686572653c2f3e
--mac $ osascript -e "set the clipboard to «data HTML${hex}»"
--mac $
(*
A sub-routine for encoding ASCII characters.

encode_char("$")
--> returns: "%24"

based on:
https://www.macosxautomation.com/applescript/sbrt/sbrt-08.html

*)
(*
Lowest Numeric Value in a List

This sub-routine will return the lowest numeric value in a list of items. The passed list can contain non-numeric data as well as lists within lists. For example:

lowest_number({-3.25, 23, 2345, "sid", 3, 67})
--> returns: -3.25
lowest_number({-3.25, 23, {-22, 78695, "bob"}, 2345, true, "sid", 3, 67})
--> returns: -22

If there is no numeric data in the passed list, the sub-routine will return a null string ("")

lowest_number({"this", "list", "contains", "only", "text"})
--> returns: ""

https://macosxautomation.com/applescript/sbrt/sbrt-03.html

Here's the sub-routine:

*)
(*
on lowestNumber(values_list)
    set the low_amount to ""
    repeat with i from 1 to the count of the values_list
        set this_item to item i of the values_list
        set the item_class to the class of this_item
        if the item_class is in {integer, real} then
            if the low_amount is "" then
                set the low_amount to this_item
            else if this_item is less than the low_amount then
                set the low_amount to item i of the values_list
            end if
        else if the item_class is list then
            set the low_value to lowest_number(this_item)
            if the the low_value is less than the low_amount then ¬
                set the low_amount to the low_value
        end if
    end repeat
    return the low_amount
end lowestNumber

https://lists.apple.com/archives/applescript-users/2010/Sep/msg00139.html
set list_of_values to {10, 20, 30, 40, 50, 60, 2000, 9, 3000, 4}

set minimum to 9.9999999999E+12
set maximum to 0
repeat with ref_to_value in list_of_values
    set the_value to contents of ref_to_value
    if the_value > maximum then set maximum to the_value
    if the_value < minimum then set minimum to the_value
end repeat

{minimum, maximum}

may do the trick.

Yvan KOENIG (VALLAURIS, France) lundi 13 septembre 2010 22:32:41
*)
(* https://lists.apple.com/archives/applescript-users/2010/Sep/msg00139.html
set list_of_values to {10, 20, 30, 40, 50, 60, 2000, 9, 3000, 4}

set minimum to 9.9999999999E+12

assume it's limited to positive values


on maxValue(list_of_values)
    global debug
    if debug ≥ 5 then log "in maxValue " & return & list_of_values
    set maximum to 0
    repeat with ref_to_value in list_of_values
        set the_value to contents of ref_to_value
        if the_value > maximum then set maximum to the_value
    end repeat
    if debug ≥ 5 then log maximum
    return maximum
end maxValue
*)
-- ------------------------------------------------------
(*
http://harvey.nu/applescript_url_encode_routine.html

on urlencode(theText)
    set theTextEnc to ""
    repeat with eachChar in characters of theText
        set useChar to eachChar
        set eachCharNum to ASCII number of eachChar
        if eachCharNum = 32 then
            set useChar to "+"
        else if (eachCharNum ≠ 42) and (eachCharNum ≠ 95) and (eachCharNum < 45 or eachCharNum > 46) and (eachCharNum < 48 or eachCharNum > 57) and (eachCharNum < 65 or eachCharNum > 90) and (eachCharNum < 97 or eachCharNum > 122) then
            set firstDig to round (eachCharNum / 16) rounding down
            set secondDig to eachCharNum mod 16
            if firstDig > 9 then
                set aNum to firstDig + 55
                set firstDig to ASCII character aNum
            end if
            if secondDig > 9 then
                set aNum to secondDig + 55
                set secondDig to ASCII character aNum
            end if
            set numHex to ("%" & (firstDig as string) & (secondDig as string)) as string
            set useChar to numHex
        end if
        set theTextEnc to theTextEnc & useChar as string
    end repeat
    return theTextEnc
end urlencode

Clipboard classes after a copy from the application.
from waterfox
(*«class HTML», 13876, «class utf8», 505, «class ut16», 1012, string, 505, Unicode text, 1010*)

from chrome
(*«class HTML», 748, «class utf8», 204, «class ut16», 410, string, 204, Unicode text, 408*)

from safari
(*«class weba», 120785, «class RTF », 70255, «class HTML», 122811, «class utf8», 3370, «class ut16», 6772, uniform styles, 47132, string, 3385, scrap styles, 8122, Unicode text, 6732, uniform styles, 47132, scrap styles, 8122*)

iCab
(*«class weba», 1665, «class RTF », 763, «class utf8», 121, «class ut16», 244, uniform styles, 376, string, 121, scrap styles, 62, Unicode text, 242, uniform styles, 376, scrap styles, 62*)

Opera
(*«class HTML», 5767, «class utf8», 150, «class ut16», 302, string, 150, Unicode text, 300*)

Textedit
(*«class RTF », 1136, «class utf8», 138, «class ut16», 278, uniform styles, 148, string, 138, scrap styles, 22, Unicode text, 276, uniform styles, 148, scrap styles, 22*)

Word
(*«class DSIG», 4, «class DOBJ», 56, «class OBJD», 244, «class RTF », 30573, «class HTML», 21160, scrap styles, 22, uniform styles, 136, string, 210, Unicode text, 420, «class PDF », 13197, picture, 154058, «class EMBS», 33280, «class LNKS», 909, «class LKSD», 244, «class OJLK», 93, «class HLNK», 1387, «class OFSC», 232, «class ut16», 422, «class DSIG», 4, «class DOBJ», 56, «class OBJD», 244, scrap styles, 22, uniform styles, 136, «class EMBS», 33280, «class LNKS», 909, «class LKSD», 244, «class OJLK», 93, «class HLNK», 1387, «class OFSC», 232*)

TextWrangler
(*«class utf8», 185, «class BBLM», 4, «class ut16», 372, string, 185, Unicode text, 370, «class BBLM», 4*)

*)