Difference between revisions of "Unicode"

From APL Wiki
Jump to navigation Jump to search
Line 105: Line 105:
 
The following statements can be used to test the functionality of the symbols:
 
The following statements can be used to test the functionality of the symbols:
 
<source lang=apl>
 
<source lang=apl>
⍎⎕← '1',(⎕UCS 16⊥2 2 0 10),'1'  ⍝ Epsilon
+
⍎⎕← '1',(⎕UCS 16⊥0  0 2 10),'1'  ⍝ Star
⍎⎕← '1',(⎕UCS 16⊥2  2  0  8),'1'  ⍝ Epsilon
+
⍎⎕← '1',(⎕UCS 16⊥2  2 12  6),'1'  ⍝ Star
 +
⍎⎕← '1',(⎕UCS 16⊥0 2 13),'1'  ⍝ Minus
 
⍎⎕← '1',(⎕UCS 16⊥2  2  1  2),'1'  ⍝ Minus
 
⍎⎕← '1',(⎕UCS 16⊥2  2  1  2),'1'  ⍝ Minus
⍎⎕← '1',(⎕UCS 16⊥0  0  2 13),'1'  ⍝ Minus
+
⍎⎕← '1',(⎕UCS 16⊥0  0 5 14),'1'  ⍝ And
 +
⍎⎕← '1',(⎕UCS 16⊥2 2 2  7),'1'  ⍝ And
 +
⍎⎕← '1',(⎕UCS 16⊥0  0  7 12),'1'  ⍝ Modulus
 
⍎⎕← '1',(⎕UCS 16⊥2  2  2  3),'1'  ⍝ Modulus
 
⍎⎕← '1',(⎕UCS 16⊥2  2  2  3),'1'  ⍝ Modulus
⍎⎕← '1',(⎕UCS 16⊥0  0  7 12),'1'  ⍝ Modulus
+
⍎⎕←     (⎕UCS 16⊥0  0  7 14),'1'  ⍝ Tilde
⍎⎕← '1',(⎕UCS 16⊥2  2 12  6),'1'  ⍝ Star
 
⍎⎕← '1',(⎕UCS 16⊥0  0  2 10),'1'  ⍝ Star
 
 
⍎⎕←    (⎕UCS 16⊥2  2  3 12),'1'  ⍝ Tilde
 
⍎⎕←    (⎕UCS 16⊥2  2  3 12),'1'  ⍝ Tilde
⍎⎕←     (⎕UCS 16⊥0  0  7 14),'1'  ⍝ Tilde
+
⍎⎕←'1{',(⎕UCS 16⊥0  3 11  1),'}1'  ⍝ Alpha
 +
⍎⎕←'1{',(⎕UCS 16⊥2  3  7 10),'}1'  ⍝ Alpha
 +
⍎⎕← '{',(⎕UCS 16⊥0 3 12  9),'}1'  ⍝ Omega
 +
⍎⎕← '{',(⎕UCS 16⊥2  3  7  5),'}1'  ⍝ Omega
 +
⍎⎕← '1',(⎕UCS 16⊥2  2 0 8),'1'  ⍝ Epsilon
 +
⍎⎕← '1',(⎕UCS 16⊥2  2  0 10),'1'  ⍝ Epsilon
 +
⍎⎕← '1',(⎕UCS 16⊥2  2  1  8),'.=1' ⍝ Jot
 +
⍎⎕← '1',(⎕UCS 16⊥2  5 14  6),'.=1' ⍝ Jot
 +
⍎⎕← '1',(⎕UCS 16⊥2  2  6  4),'1'  ⍝ Less than or equal to
 +
⍎⎕← '1',(⎕UCS 16⊥2 10  7 13),'1'  ⍝ Less than or equal to
 +
⍎⎕← '1',(⎕UCS 16⊥2  2  6  5),'1'  ⍝ Greater than or equal to
 +
⍎⎕← '1',(⎕UCS 16⊥2 10 7 14),'1'  ⍝ Greater than or equal to
 +
⍎⎕← '1',(⎕UCS 16⊥2  2 11 13),'1'  ⍝ Nor
 
⍎⎕← '1',(⎕UCS 16⊥2  3  7  1),'1'  ⍝ Nor
 
⍎⎕← '1',(⎕UCS 16⊥2  3  7  1),'1'  ⍝ Nor
⍎⎕← '1',(⎕UCS 16⊥2  2 11 13),'1'  ⍝ Nor
 
⍎⎕← '1',(⎕UCS 16⊥2  3  7  2),'1'  ⍝ Nand
 
 
⍎⎕← '1',(⎕UCS 16⊥2  2 11 12),'1'  ⍝ Nand
 
⍎⎕← '1',(⎕UCS 16⊥2  2 11 12),'1'  ⍝ Nand
⍎⎕← '1',(⎕UCS 16⊥2  2  2  7),'1'  ⍝ And
 
⍎⎕← '1',(⎕UCS 16⊥0  0  5 14),'1'  ⍝ And
 
⍎⎕← '1',(⎕UCS 16⊥2  2  6  4),'1'  ⍝ Not More
 
⍎⎕← '1',(⎕UCS 16⊥2 10  7 13),'1'  ⍝ Not More
 
⍎⎕← '1',(⎕UCS 16⊥2  2  6  5),'1'  ⍝ Not Less
 
⍎⎕← '1',(⎕UCS 16⊥2 10  7 14),'1'  ⍝ Not less
 
⍎⎕← '1',(⎕UCS 16⊥2  5 14  6),'.=1' ⍝ Jot
 
⍎⎕← '1',(⎕UCS 16⊥2  2  1  8),'.=1' ⍝ Jot
 
⍎⎕← '1',(⎕UCS 16⊥2  6 10 10),'1'  ⍝ Circle
 
⍎⎕← '1',(⎕UCS 16⊥2  5 12 11),'1'  ⍝ Circle
 
⍎⎕← '1',(⎕UCS 16⊥2 11  2  6),'1'  ⍝ Diamond
 
 
⍎⎕← '1',(⎕UCS 16⊥2  2 12  4),'1'  ⍝ Diamond
 
⍎⎕← '1',(⎕UCS 16⊥2  2 12  4),'1'  ⍝ Diamond
 
⍎⎕← '1',(⎕UCS 16⊥2  5 12  7),'1'  ⍝ Diamond
 
⍎⎕← '1',(⎕UCS 16⊥2  5 12  7),'1'  ⍝ Diamond
 
⍎⎕← '1',(⎕UCS 16⊥2  5 12 10),'1'  ⍝ Diamond
 
⍎⎕← '1',(⎕UCS 16⊥2  5 12 10),'1'  ⍝ Diamond
 +
⍎⎕← '1',(⎕UCS 16⊥2 11  2  6),'1'  ⍝ Diamond
 +
⍎⎕←    (⎕UCS 16⊥2  3  9  5),'←1'  ⍝ Quad
 
⍎⎕←    (⎕UCS 16⊥2  5 10 15),'←1'  ⍝ Quad
 
⍎⎕←    (⎕UCS 16⊥2  5 10 15),'←1'  ⍝ Quad
⍎⎕←    (⎕UCS 16⊥2  3  9  5),'←1'  ⍝ Quad
+
⍎⎕← '1',(⎕UCS 16⊥2  5 12 11),'1'   Circle
⍎⎕←'1{',(⎕UCS 16⊥2  3  7 10),'}1' Alpha
+
⍎⎕← '1',(⎕UCS 16⊥2 6 10 10),'1'   Circle
⍎⎕←'1{',(⎕UCS 16⊥0 3 11  1),'}1' Alpha
+
⍎⎕← '1',(⎕UCS 16⊥2  3  7  2),'1'   Nand
⍎⎕← '{',(⎕UCS 16⊥2  3  7  5),'}1'  ⍝ Omega
 
⍎⎕← '{',(⎕UCS 16⊥0  3 12  9),'}1' Omega
 
 
</source>
 
</source>
 
Note that the last four lines will not work on a system that doesn’t support [[dfns]].
 
Note that the last four lines will not work on a system that doesn’t support [[dfns]].

Revision as of 00:45, 27 December 2019

The advent of Unicode solved many problems with dealing with APL characters, however there was still some wiggle room as to which Unicode codepoint were to be used in a Unicode implementation of APL, and different implementors made different choices. This article, which documents these differences, is adapted from an original paper by Bob Smith[1] that attempted to raise awareness of these issues because the differences impede transfer of information.

The relevant document for the APL character set is the APL Character Repertoire (ACR)[2]. For whatever reasons, that document never became a standard, but it does provide some guidance, and is better than each implementor making separate choices.

Introduction

There are a surprising number of similar APL characters in Unicode and in several cases some implementors went one way, others the other way. The following table lists the characters in question, along with the way APL2, Dyalog, GNU APL, NARS2000, ngn/apl, and dzaima/APL behave. APL2000 states that Generally the default codepoint scheme for the VisualAPL product follows the IBM APL2 workstation scheme. Please edit this page if you believe there are other characters that should be included in the table.

When there are differences among APL implementations, users can become confused. They type something into one APL system, copy it to another and are greeted by a SYNTAX ERROR or the like.

The whole basis for the confusion in a lengthy thread on comp.lang.apl entitled caret vs and[3] is that in some implementations the symbol for the logical And function is U+005E only, in some implementations it's U+2227 only, and in some both characters work. The original poster encountered some APL text from the APL Wiki that had been produced by a system that supports U+005E and copied it into a system that uses U+2227 only and fails on U+005E.

When our systems differ in the set of acceptable characters for the same function, it serves only to confuse the end user to the detriment of the community.

Comparison of implementations

APL name Glyph Codepoint Unicode name APL2 Dyalog
APL
GNU
APL
NARS
2000
ngn/
apl
dzaima/
APL
Monadic Dyadic
Star * U+002A Asterisk Yes Yes Yes Yes Yes Yes Exponential Power
U+26AA Star operator No No Yes Yes Yes No
Minus - U+002D Hyphen-minus Yes Yes Yes Yes Yes Yes Negate Minus
U+2212 Minus sign No No Yes Yes Yes No
Logical And ^ U+005E Circumflex accent Yes Yes Yes Yes Yes No And
U+22BD Logical And No Yes Yes Yes Yes Yes
Stile | U+007C Vertical line Yes Yes Yes Yes Yes Yes Magnitude Residue
U+2212 Divides Yes Yes Yes Yes Yes No
Tilde ~ U+007E Tilde Yes Yes Yes Yes Yes Yes Not Without
U+223C Tilde operator No No Yes Yes No No
Alpha α U+03B1 Greek small letter Alpha No Yes Yes No No Left Argument
U+237A APL functional symbol Alpha Yes Yes Yes Yes Yes
Omega ω U+03C9 Greek small letter Omega No Yes Yes No No Right Argument
U+237A APL functional symbol Omega Yes Yes Yes Yes Yes
Epsilon [4] U+2208 Element of No No Yes Yes No No Enlist/Type Membership
U+220A Small Element of Yes Yes Yes Yes Yes Yes
Jot U+2218 Ring operator Yes Yes Yes Yes Yes Yes Outer product Beside/Beside
U+25E6 White bullet No No Yes Yes No No
Less than or
equal to
U+2264 Less-than or equal to Yes Yes Yes Yes Yes Yes Less than or
equal to
U+2A7D Less than or slanted equal to No No Yes Yes No No
Greater than or
equal to
U+2265 Greater than or equal to Yes Yes Yes Yes Yes Yes Greater than or
equal to
U+2A7E Greater than or slanted equal to No No Yes Yes No No
Logical Nor U+22BD Nor No No Yes Yes No No Nor
U+2371 APL functional symbol down caret tilde Yes Yes Yes Yes Yes Yes
Logical Nand U+22BC Nand No No Yes Yes No No Nand
U+2372 APL functional symbol up caret tilde Yes Yes Yes Yes Yes Yes
Diamond U+22C4 Diamond operator Yes Yes Yes Yes Yes Yes Statement Separator
U+25C7 White Diamond No No No Yes No No
U+25CA Lozenge No No Yes Yes No No
U+2B26 Diamond No No Yes Yes No No
Quad U+2395 APL functional symbol Quad Yes Yes Yes Yes Yes Yes Quad name
U+26AA White vertical rectangle Yes No Yes Yes No No
Circle U+25CB White circle Yes Yes Yes Yes Yes Yes Pi Times Circular
U+26AA Medium white circle No No Yes Yes No No

These characters are included here because they have been encountered them in APL code displayed somewhere on the Internet or in a PDF file. Thus blindly copying them into an APL session can produce an error which might well confuse the user.

Functionality

The following statements can be used to test the functionality of the symbols:

 '1',(⎕UCS 160  0  2 10),'1'   ⍝ Star
 '1',(⎕UCS 162  2 12  6),'1'   ⍝ Star
 '1',(⎕UCS 160  0  2 13),'1'   ⍝ Minus
 '1',(⎕UCS 162  2  1  2),'1'   ⍝ Minus
 '1',(⎕UCS 160  0  5 14),'1'   ⍝ And
 '1',(⎕UCS 162  2  2  7),'1'   ⍝ And
 '1',(⎕UCS 160  0  7 12),'1'   ⍝ Modulus
 '1',(⎕UCS 162  2  2  3),'1'   ⍝ Modulus
     (⎕UCS 160  0  7 14),'1'   ⍝ Tilde
     (⎕UCS 162  2  3 12),'1'   ⍝ Tilde
'1{',(⎕UCS 160  3 11  1),'}1'  ⍝ Alpha
'1{',(⎕UCS 162  3  7 10),'}1'  ⍝ Alpha
 '{',(⎕UCS 160  3 12  9),'}1'  ⍝ Omega
 '{',(⎕UCS 162  3  7  5),'}1'  ⍝ Omega
 '1',(⎕UCS 162  2  0  8),'1'   ⍝ Epsilon
 '1',(⎕UCS 162  2  0 10),'1'   ⍝ Epsilon
 '1',(⎕UCS 162  2  1  8),'.=1' ⍝ Jot
 '1',(⎕UCS 162  5 14  6),'.=1' ⍝ Jot
 '1',(⎕UCS 162  2  6  4),'1'   ⍝ Less than or equal to
 '1',(⎕UCS 162 10  7 13),'1'   ⍝ Less than or equal to
 '1',(⎕UCS 162  2  6  5),'1'   ⍝ Greater than or equal to
 '1',(⎕UCS 162 10  7 14),'1'   ⍝ Greater than or equal to
 '1',(⎕UCS 162  2 11 13),'1'   ⍝ Nor
 '1',(⎕UCS 162  3  7  1),'1'   ⍝ Nor
 '1',(⎕UCS 162  2 11 12),'1'   ⍝ Nand
 '1',(⎕UCS 162  2 12  4),'1'   ⍝ Diamond
 '1',(⎕UCS 162  5 12  7),'1'   ⍝ Diamond
 '1',(⎕UCS 162  5 12 10),'1'   ⍝ Diamond
 '1',(⎕UCS 162 11  2  6),'1'   ⍝ Diamond
     (⎕UCS 162  3  9  5),'←1'  ⍝ Quad
     (⎕UCS 162  5 10 15),'←1'  ⍝ Quad
 '1',(⎕UCS 162  5 12 11),'1'   ⍝ Circle
 '1',(⎕UCS 162  6 10 10),'1'   ⍝ Circle
 '1',(⎕UCS 162  3  7  2),'1'   ⍝ Nand

Note that the last four lines will not work on a system that doesn’t support dfns.

Atomic Vector

If the Atomic vector (⎕AV) has no room in which to include these new characters, an implementation can translate them on entry to the corresponding symbol that is in ⎕AV. NARS2000 even has a means of translating symbols on the way out via Copy (Ctrl+C in Windows) to various other APL systems that don't support the same set of principal characters NARS2000 uses for the functions in the above table.

Considerations

Unicode was a great start to enabling APL characters to be used, however in order for there to be interoperability, implementors have to agree upon which characters are functional. It doesn't matter if one's system can change the mapping of glyphs to codepoints as the vast majority of users won't change from the default behavior. Implementors therefore have to decide if it is worthwhile to support the above codepoints.

References

  1. Smith, Bob. APL Characters and Their Aliases. 14 Dec 2013–25 Dec 2019. Sudley Place Software.
  2. ISO-IEC/JTC1/SC22/WG3. N3067: APL Character Repertoire. 28 Dec 1999.
  3. comp.lang.apl. caret vs and. 28 Oct 2013–9 Dec 2013
  4. Found by Hanspeter Moser in The Toronto Toolkit