Reference LGR for language: Arabic (ar-Arab) | lgr-second-level-arabic-language-24aug20-en |
---|
This document is mechanically formatted from the above XML file for the LGR. It provides additional summary data and explanatory text. The XML file remains the sole normative specification of the LGR.
Date | 2020-08-24 |
---|---|
LGR Version | 1 |
Language | ar-Arab |
Unicode Version | 6.3.0 |
This document specifies a reference set of Label Generation Rules (LGR) for the Arabic language for the second level. The starting point for the development of this LGR can be found in the related Root Zone LGR [RZ-LGR-3-Arab]. For details and additional background on the script, see "Proposal for Arabic Script Root Zone LGR", Version 3.4, 18 November 2015 [Proposal-Arabic]. Additional work was done by a TF-AIDN group to create extensions appropriate to the second level and are incorporated in this LGR. (See "Methodology" below). The format of this file follows [RFC 7940].
The document contains certain provisions for customization. (See "Customizing actions for International Reachability" below.)
This is a DRAFT document released for public comments and not final. Please see the announcement on the ICANN website for public comments on the Second Level Reference LGRs for details on how to submit comments.
The repertoire is a subset of the one described in Section 3.2 of [Proposal-Arabic] that only includes the 36 code points for letters in active everyday general use in the Arabic language. For the second level, the repertoire has been augmented with the HYPHEN-MINUS, and two sets of decimal digits:
for a total of 57 code points.
This LGR does not include combining marks or code point sequences. All combining marks have been excluded for these reasons:
For further details, see Section 3.2, "Code point repertoire included" in [Proposal-Arabic]. (The proposal cited has been adopted for the Arabic script portion of the Root Zone LGR.)
Code points outside the Arabic language that are listed in this file are targets for out-of-repertoire variants and are identified by a reflexive (identity) variant of type "out-of-repertoire-var". They do not form part of the repertoire.
Each code point or range is tagged with the script or scripts that the code point is used with, and one or more references documenting sufficient justification for inclusion in the repertoire, see "References" below. Comments identify the languages using the code point.
Because this LGR contains only a subset of PVALID code points, the Bidi rules expressed in section 2 of RFC 5893 [160] (Bidi Rule) can be simplified to two constraints:
This reference LGR is designed for use in zones shared by more than one language. Where appropriate, cross-language variants have been defined to mutually exclude labels from different languages that could otherwise be substituted by the users. Once a label has been delegated for one language, any such variant labels from other languages could be blocked. Any label containing at least one code point that is not a cross-language variant would be considered distinct. Because of that, even large numbers of defined cross-language variants generally do not lead to a high percentage of labels experiencing a collision.
This LGR includes "blocked" and "allocatable" variants, assigned according to Section 4, "Final recommendation of variants for Top Level Domains (TLDs)" in [Proposal-Arabic]. These recommendations balance the desire to minimize the number of possible allocatable variants with the need to keep the definition of variants simple. See also the comments given in the listing.
For the second level, three additional variant types are added: "optionally-allocatable", "activated", and "optionally-activated". They are used to improve user acceptance. The rationale for these new types is provided below.
Digit Variants: All Arabic digits are treated as semantic variants of the corresponding common (ASCII) digits. By transitivity, they are also semantic variants of any native digits in scripts that also include the common digits. Because of the restriction on leading digits, most labels would contain a unique code point in addition to any digits, thus no variant labels would actually result from any pro-forma cross-script variants. To keep digit variant sets manageable in zones where multiple scripts are present, no attempt has been made at identifying cross-script variants among digits of different numeric value or between a digit in one script and a letter in another, such as between digit zero and Latin letter 'o'.
In generating the variant tables, a number of concepts have been used:
When building a variant table, for each code point in the Arabic language repertoire, a full study is conducted across the whole Arabic script in order to identify all possible variants corresponding to the code point. This is done for more protection to the registry’s TLD-space and to minimize the overhead of re-studying when the registry decides to support more than one language from the Arabic script. Hence, conducting this variant study across the whole Arabic script would provide an IDN registry with the following benefits:
One of the main principles for the stability of the Internet and IDNs is that the end user should be able to reach a website connected to his/her domain name regardless of location. Additionally, an end user reads and types website addresses based on his/her language alphabet and whatever is available in his/her keyboard. Therefore, in order to enforce this principle the input devices (language table) that the user may use to reach a domain name (based on the user location) should be carefully considered when defining variants. Otherwise, it may cause a reachability problem and reduce the user acceptance. For example, if someone registered the domain name “مكة” (all characters from the Arabic language) and a user try to reach the website connected to this domain name from an Internet café or airport, say, in Pakistan. He/she will not be able to reach that website unless if the variant “مکۃ” (Urdu variant) is already allocated and activated. Thus, variants need to be studied from both similarity point of view (by language community) and reachability pointy of view (based on input devices used by other language communities).
Consistency is a very important concept in generating variants. Regardless of the selected applied-for label the list of generated allocatable variants should be the same. As we are dealing with normal users at the SLD, their 1st choice (applied-for) label might not be the one that will be used by the internet community. Therefore, a registry should provide the registrant the ability to "correct" his/her choice if he/she was not successful with the first try. For example, the word “Internet” is written in most Arab countries in North Africa as (أنترنت) while it is written in other Arab countries as (إنترنت), while end users often write it as (انترنت). Therefore, if someone registered "أنترنت", he/she should be able to enable "إنترنت" or "انترنت". Additionally, many words have two correct ways to write them, for example, both "آدم" and "أدم" are widely used for the same name Adam. Hence, if someone registered "أدم" he/she should be able to enable "آدم" or "ادم”. This is achieved by making variants allocatable in at least one direction in the LGR.
Even though we are constructing an LGR at a language level, because we are addressing international reachability, we need to prevent mixing between code points from different language tables while generating a valid variant. Otherwise, some of permuted variants will be composed of characters (code points) that are not part of a single language or they are not easily available for a single input device (keyboard). Therefore, from a practical and realistic point of view, and to significantly minimize the number of allocatable variants and maximize the number of blocked variants, it blocking these unrealistic variants represents best practice.
Based on the principle expressed in the previous item, code points not part of the Arabic language repertoire have been added to variant sets to facilitate international reachability. Many of these out-of-repertoire code points are involved in at least one variant mapping of type "activated", "optionally-activated", or "optionally-allocatable. The dispositions related to the extended variants may be optionally modified by a registry by editing the appropriate action elements. See the section on "Customizing Actions for International Reachability" for details of how this feature can be made mandatory or disabled.
Note: Please note that the set of supported languages used for implementing the above concepts (namely international reachability and no mixing between languages) is a first version. The set may be updated in the future by adding new languages whenever they become ready.
The specification of variants in this reference LGR follows the guidelines in [RFC 8228].
This proposal defines the following named character classes:
Actions include the default actions for LGRs as well as that needed to invalidate labels with misplaced combining marks. They are marked with ⍟. For a description see [RFC 7940].
The following rules aim at reducing the allocation of redundant labels.
In addition, this LGR includes WLE rules and actions specific to the Arabic language adapted from the rules for the Arabic script found in Section 5, "Whole Label Evaluation (WLE) rules" in [Proposal-Arabic]. As specified, the rules and actions serve to prevent the mixing of two variants of the same code point within the same label. This reduces overproduction of variant labels. The rules are listed here with the numbers given in Table 17 in [Proposal-Arabic]. See also the comments given for each rule or action.
The three non-default variant mapping types used in this reference LGR trigger actions that result in variant label dispositions as follows:
Variant mappings of type "activated" lead to a disposition of "activated", which means the variant label should be delegated. This variant type is used here for the variant mappings between European and Arabic-Indic digits, to guarantee that labels differing only by the digit set used will all be delegated. Activated variants are handled by the first action above, and are not affected by the optional customizations described below.
As described above, this LGR is designed so that full "international reachability" is optionally available. It can easily be enabled with a small customization.
The disposition for the second of the actions listed above is by default set to "allocatable" which makes the variant available to registrants that would like to support international reachability. Some registry operators may desire to make support for such variants mandatory, in which case the disposition (disp="allocatable" in the XML) for the relevant action could be changed from "allocatable" to "activated" without further changes to the LGR.
The disposition for the last of the actions listed above is by default set to "blocked" which reserves the variants of type "optionally-allocatable". Some registry operators may desire to support such variants as allocatable, in which case the disposition (disp="blocked" in the XML) for the relevant action could be changed from "blocked" to "allocatable" without further changes to the LGR.
Note that this reference LGR allows variant labels containing out-of-repertoire code points to be "allocatable" or "activated". However, independent of which of the customizations for disposition is chosen above, an original label (as applied for) that contains any of the affected code points would remain unavailable.
Most of the code points involved in labels resulting in "activated" or "allocatable" actions are subject to "no-mix" rules to decrease the number of activated or allocatable variants. This is especially a concern for the "activated" action which results in forced delegation.
Applying this customization for variant sets involving code points which do not have "no-mix" should be done with caution. This is especially true for the variant set including the ALEF characters, for which an external policy should be established to ensure that only a strictly limited number of variant labels are allocated. It may not be possible to create a general policy that determine which of the variants from among a potential large variant pool are indeed suitable; therefore, the selection may have to be left as a choice to the registrant, but within a strict cap.
This reference LGR for the Arabic language for the 2nd Level has been edited by Michel Suignard and Asmus Freytag, based on extensive community input. This LGR is based on the Root Zone LGR for Arabic and relies on information contained or referenced therein, see [RZ-LGR-3-Arab]. Suitable extensions for the second level have been applied according to the [Guidelines]. The specific features related to the Arabic Language LGR were drafted by a TF-AIDN sub-group (namely in alphabetical order: Abdalmonem Tharwat Galila , Abdeslam Nasri , Abdulaziz Al-Zoman, Abdulrahman Alghadir, Hazem Hezzah, Nabil Benamar, Raed Alfayez, Tarik Merghani). In addition, Sarmad Hussain provided editorial support.
For more information on methodology and contributors to the underlying Root Zone LGR, see [Proposal-Arabic], as well as [RZ-LGR-Overview].
For references consulted particularly in designing the repertoire for the Arabic language LGR for the second level, please see details in the Table of References below. Reference [0] refers to Unicode Standard version in which the corresponding code points were initially encoded. References [100] and above correspond to sources justifying the inclusion of the corresponding code points. Entries in the table may have multiple source reference values.
Number of elements in Repertoire | 57 | ||||
---|---|---|---|---|---|
Out of repertoire variants | 19 | ||||
Total entries in table | 76 | ||||
Number of code points for each script |
|
||||
Longest code point sequence | 1 |
The following table lists the repertoire by code point (or code point sequence). The data in the Script and Name column are extracted from the Unicode character database. Where a comment in the original LGR is equal to the character name, it has been suppressed.
For any code point or sequence for which a variant is defined, additional information is provided in the Variants column. Some code points or sequences listed in the following table are not part of the repertoire itself; they document targets for out-of-repertoire variant mappings as indicated. See also the legend provided below the table.
Code Point |
Glyph | Script | Name | Ref | Tags | Required Context | Part of Repertoire |
Variants | Comment |
---|---|---|---|---|---|---|---|---|---|
U+002D | - | Common | HYPHEN-MINUS | [0] | Hyphen | not: hyphen-minus-disallowed | ✔ | ⍟ | |
U+0030 | 0 | Common | DIGIT ZERO | [0] | Common-digit | not: leading-digit | ✔ | set 1 | ⍟ |
U+0031 | 1 | Common | DIGIT ONE | [0] | Common-digit | not: leading-digit | ✔ | set 2 | ⍟ |
U+0032 | 2 | Common | DIGIT TWO | [0] | Common-digit | not: leading-digit | ✔ | set 3 | ⍟ |
U+0033 | 3 | Common | DIGIT THREE | [0] | Common-digit | not: leading-digit | ✔ | set 4 | ⍟ |
U+0034 | 4 | Common | DIGIT FOUR | [0] | Common-digit | not: leading-digit | ✔ | set 5 | ⍟ |
U+0035 | 5 | Common | DIGIT FIVE | [0] | Common-digit | not: leading-digit | ✔ | set 6 | ⍟ |
U+0036 | 6 | Common | DIGIT SIX | [0] | Common-digit | not: leading-digit | ✔ | set 7 | ⍟ |
U+0037 | 7 | Common | DIGIT SEVEN | [0] | Common-digit | not: leading-digit | ✔ | set 8 | ⍟ |
U+0038 | 8 | Common | DIGIT EIGHT | [0] | Common-digit | not: leading-digit | ✔ | set 9 | ⍟ |
U+0039 | 9 | Common | DIGIT NINE | [0] | Common-digit | not: leading-digit | ✔ | set 10 | ⍟ |
U+0621 | ء | Arabic | ARABIC LETTER HAMZA | [0], [100] | ✔ | Arabic | |||
U+0622 | آ | Arabic | ARABIC LETTER ALEF WITH MADDA ABOVE | [0], [100] | ✔ | set 11 | Arabic | ||
U+0623 | أ | Arabic | ARABIC LETTER ALEF WITH HAMZA ABOVE | [0], [100] | ✔ | set 11 | Arabic | ||
U+0624 | ؤ | Arabic | ARABIC LETTER WAW WITH HAMZA ABOVE | [0], [100] | ✔ | set 12 | Arabic | ||
U+0625 | إ | Arabic | ARABIC LETTER ALEF WITH HAMZA BELOW | [0], [100] | ✔ | set 11 | Arabic | ||
U+0626 | ئ | Arabic | ARABIC LETTER YEH WITH HAMZA ABOVE | [0], [100] | initial-or-medial-position | ✔ | set 13 | Arabic | |
U+0627 | ا | Arabic | ARABIC LETTER ALEF | [0], [100] | ✔ | set 11 | Arabic | ||
U+0628 | ب | Arabic | ARABIC LETTER BEH | [0], [100] | ✔ | Arabic | |||
U+0629 | ة | Arabic | ARABIC LETTER TEH MARBUTA | [0], [100] | ✔ | set 14 | Arabic | ||
U+062A | ت | Arabic | ARABIC LETTER TEH | [0], [100] | ✔ | Arabic | |||
U+062B | ث | Arabic | ARABIC LETTER THEH | [0], [100] | ✔ | Arabic | |||
U+062C | ج | Arabic | ARABIC LETTER JEEM | [0], [100] | ✔ | Arabic | |||
U+062D | ح | Arabic | ARABIC LETTER HAH | [0], [100] | ✔ | Arabic | |||
U+062E | خ | Arabic | ARABIC LETTER KHAH | [0], [100] | ✔ | Arabic | |||
U+062F | د | Arabic | ARABIC LETTER DAL | [0], [100] | ✔ | Arabic | |||
U+0630 | ذ | Arabic | ARABIC LETTER THAL | [0], [100] | ✔ | Arabic | |||
U+0631 | ر | Arabic | ARABIC LETTER REH | [0], [100] | ✔ | Arabic | |||
U+0632 | ز | Arabic | ARABIC LETTER ZAIN | [0], [100] | ✔ | Arabic | |||
U+0633 | س | Arabic | ARABIC LETTER SEEN | [0], [100] | ✔ | Arabic | |||
U+0634 | ش | Arabic | ARABIC LETTER SHEEN | [0], [100] | ✔ | Arabic | |||
U+0635 | ص | Arabic | ARABIC LETTER SAD | [0], [100] | ✔ | Arabic | |||
U+0636 | ض | Arabic | ARABIC LETTER DAD | [0], [100] | ✔ | Arabic | |||
U+0637 | ط | Arabic | ARABIC LETTER TAH | [0], [100] | ✔ | Arabic | |||
U+0638 | ظ | Arabic | ARABIC LETTER ZAH | [0], [100] | ✔ | Arabic | |||
U+0639 | ع | Arabic | ARABIC LETTER AIN | [0], [100] | ✔ | Arabic | |||
U+063A | غ | Arabic | ARABIC LETTER GHAIN | [0], [100] | ✔ | Arabic | |||
U+0641 | ف | Arabic | ARABIC LETTER FEH | [0], [100] | ✔ | Arabic | |||
U+0642 | ق | Arabic | ARABIC LETTER QAF | [0], [100] | ✔ | Arabic | |||
U+0643 | ك | Arabic | ARABIC LETTER KAF | [0], [100] | ✔ | set 15 | Arabic | ||
U+0644 | ل | Arabic | ARABIC LETTER LAM | [0], [100] | ✔ | Arabic | |||
U+0645 | م | Arabic | ARABIC LETTER MEEM | [0], [100] | ✔ | Arabic | |||
U+0646 | ن | Arabic | ARABIC LETTER NOON | [0], [100] | ✔ | set 16 | Arabic | ||
U+0647 | ه | Arabic | ARABIC LETTER HEH | [0], [100] | ✔ | set 14 | Arabic | ||
U+0648 | و | Arabic | ARABIC LETTER WAW | [0], [100] | ✔ | set 12 | Arabic | ||
U+0649 | ى | Arabic | ARABIC LETTER ALEF MAKSURA | [0], [100] | not: initial-or-medial-position | ✔ | set 13 | Arabic | |
U+064A | ي | Arabic | ARABIC LETTER YEH | [0], [100] | ✔ | set 13 | Arabic | ||
U+0660 | ٠ | Arabic | ARABIC-INDIC DIGIT ZERO | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 1 | ⍟ |
U+0661 | ١ | Arabic | ARABIC-INDIC DIGIT ONE | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 2 | ⍟ |
U+0662 | ٢ | Arabic | ARABIC-INDIC DIGIT TWO | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 3 | ⍟ |
U+0663 | ٣ | Arabic | ARABIC-INDIC DIGIT THREE | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 4 | ⍟ |
U+0664 | ٤ | Arabic | ARABIC-INDIC DIGIT FOUR | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 5 | ⍟ |
U+0665 | ٥ | Arabic | ARABIC-INDIC DIGIT FIVE | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 6 | ⍟ |
U+0666 | ٦ | Arabic | ARABIC-INDIC DIGIT SIX | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 7 | ⍟ |
U+0667 | ٧ | Arabic | ARABIC-INDIC DIGIT SEVEN | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 8 | ⍟ |
U+0668 | ٨ | Arabic | ARABIC-INDIC DIGIT EIGHT | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 9 | ⍟ |
U+0669 | ٩ | Arabic | ARABIC-INDIC DIGIT NINE | [0], [100], [201], [401], [600], [700] | Arabic-indic-digit | not: leading-digit | ✔ | set 10 | ⍟ |
U+06A9 | ک | Arabic | ARABIC LETTER KEHEH | [0], [108], [109], [112] | (✗) | set 15 | Pashto, Persian, Urdu; Not available for original label | ||
U+06BA | ں | Arabic | ARABIC LETTER NOON GHUNNA | [0], [112] | ✗ | set 16 | Urdu; Not available for original label | ||
U+06BE | ھ | Arabic | ARABIC LETTER HEH DOACHASHMEE | [0], [112] | (✗) | set 14 | Urdu; Not available for original label | ||
U+06C1 | ہ | Arabic | ARABIC LETTER HEH GOAL | [0], [112] | (✗) | set 14 | Urdu; Not available for original label | ||
U+06C3 | ۃ | Arabic | ARABIC LETTER TEH MARBUTA GOAL | [0], [126] | (✗) | set 14 | Urdu; Not available for original label | ||
U+06CC | ی | Arabic | ARABIC LETTER FARSI YEH | [0], [108], [109], [112] | (✗) | set 13 | Pashto, Persian, Urdu; Not available for original label | ||
U+06CD | ۍ | Arabic | ARABIC LETTER YEH WITH TAIL | [0], [108] | ✗ | set 13 | Pashto; Not available for original label | ||
U+06D0 | ې | Arabic | ARABIC LETTER E | [0], [108] | ✗ | set 13 | Pashto; Not available for original label | ||
U+06D2 | ے | Arabic | ARABIC LETTER YEH BARREE | [0], [112] | ✗ | set 13 | Urdu; Not available for original label | ||
U+06F0 | ۰ | Arabic | EXTENDED ARABIC-INDIC DIGIT ZERO | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 1 | |
U+06F1 | ۱ | Arabic | EXTENDED ARABIC-INDIC DIGIT ONE | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 2 | |
U+06F2 | ۲ | Arabic | EXTENDED ARABIC-INDIC DIGIT TWO | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 3 | |
U+06F3 | ۳ | Arabic | EXTENDED ARABIC-INDIC DIGIT THREE | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 4 | |
U+06F4 | ۴ | Arabic | EXTENDED ARABIC-INDIC DIGIT FOUR | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 5 | |
U+06F5 | ۵ | Arabic | EXTENDED ARABIC-INDIC DIGIT FIVE | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 6 | |
U+06F6 | ۶ | Arabic | EXTENDED ARABIC-INDIC DIGIT SIX | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 7 | |
U+06F7 | ۷ | Arabic | EXTENDED ARABIC-INDIC DIGIT SEVEN | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 8 | |
U+06F8 | ۸ | Arabic | EXTENDED ARABIC-INDIC DIGIT EIGHT | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 9 | |
U+06F9 | ۹ | Arabic | EXTENDED ARABIC-INDIC DIGIT NINE | [0], [109] | Extended-arabic-indic-digit | not: leading-digit | (✗) | set 10 |
Legend
Number of variant sets | 16 | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Largest variant set | 7 | ||||||||||
Ordinary Variants by Type |
|
||||||||||
Reflexive Variants by Type |
|
The following tables list all variant sets defined in this LGR, except for singleton sets. Each table lists all variant mapping pairs of the set; one per row. Mappings are assumed to be symmetric: each row documents both forward (→) and reverse (←) mapping directions. In each table, the mappings are sorted by Source value in ascending code point order; shading is used to group mappings from the same source code point or sequence.
Where the type of both forward and reverse mappings are the same, a single value is given in the Type column; otherwise the types for forward and reverse mappings, as well as comments and references, are listed above one another. For summary counts, both forward and reverse mappings are always counted separately.
A mapping where source and target are the same is reflexive. Variant sets consisting of only a single reflexive mapping are not shown as a set. Instead, the variant type of the mapping is listed in the Variants column of the Repertoire by Code Point table. Reflexive mappings that are part of a larger set are indicated with a “≡” and are counted once per entry.
In any LGR with variant specifications that are well behaved, all members within each variant set are defined as variants of each other; the mappings in each set are symmetric and transitive; and all variant sets are disjoint.
Common Legend
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0030 | 0 | 0660 | ٠ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0030 | 0 | 06F0 | ۰ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0660 | ٠ | 06F0 | ۰ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F0 | ۰ | 06F0 | ۰ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0031 | 1 | 0661 | ١ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0031 | 1 | 06F1 | ۱ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0661 | ١ | 06F1 | ۱ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F1 | ۱ | 06F1 | ۱ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0032 | 2 | 0662 | ٢ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0032 | 2 | 06F2 | ۲ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0662 | ٢ | 06F2 | ۲ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F2 | ۲ | 06F2 | ۲ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0033 | 3 | 0663 | ٣ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0033 | 3 | 06F3 | ۳ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0663 | ٣ | 06F3 | ۳ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F3 | ۳ | 06F3 | ۳ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0034 | 4 | 0664 | ٤ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0034 | 4 | 06F4 | ۴ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0664 | ٤ | 06F4 | ۴ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F4 | ۴ | 06F4 | ۴ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0035 | 5 | 0665 | ٥ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0035 | 5 | 06F5 | ۵ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0665 | ٥ | 06F5 | ۵ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F5 | ۵ | 06F5 | ۵ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0036 | 6 | 0666 | ٦ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0036 | 6 | 06F6 | ۶ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0666 | ٦ | 06F6 | ۶ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F6 | ۶ | 06F6 | ۶ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0037 | 7 | 0667 | ٧ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0037 | 7 | 06F7 | ۷ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0667 | ٧ | 06F7 | ۷ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F7 | ۷ | 06F7 | ۷ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0038 | 8 | 0668 | ٨ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0038 | 8 | 06F8 | ۸ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0668 | ٨ | 06F8 | ۸ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F8 | ۸ | 06F8 | ۸ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0039 | 9 | 0669 | ٩ | ↔ | activated | ASCII digit variant / Arabic digit variant | |
0039 | 9 | 06F9 | ۹ | → | optionally-activated | Extended digit variant | |
← | blocked | ASCII digit variant | |||||
0669 | ٩ | 06F9 | ۹ | → | optionally-activated | Extended digit variant | |
← | blocked | Arabic digit variant | |||||
06F9 | ۹ | 06F9 | ۹ | ≡ | out-of-repertoire-var | Not part of Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0622 | آ | 0623 | أ | ↔ | optionally-allocatable | Arabic language variant | |
0622 | آ | 0625 | إ | ↔ | optionally-allocatable | Arabic language variant | |
0622 | آ | 0627 | ا | → | allocatable | U+0622 (آ) ALEF WITH MADDA ABOVE is simplified to U+0627 (ا) ALEF in the Arabic language | |
← | optionally-allocatable | Arabic language variant | |||||
0623 | أ | 0625 | إ | ↔ | optionally-allocatable | Arabic language variant | |
0623 | أ | 0627 | ا | → | allocatable | U+0623 (أ) ALEF WITH HAMZA ABOVE is simplified to U+0627 (ا) ALEF in the Arabic language | |
← | optionally-allocatable | Arabic language variant | |||||
0625 | إ | 0627 | ا | → | allocatable | U+0625 (إ) ALEF WITH HAMZA BELOW is simplified to U+0627 (ا) ALEF in the Arabic language | |
← | optionally-allocatable | Arabic language variant |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0624 | ؤ | 0648 | و | → | allocatable | U+0624 (ؤ) WAV WITH HAMZA ABOVE is simplified to U+0648 (و) WAV in the Arabic language | |
← | blocked | Arabic language variant |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0626 | ئ | 0649 | ى | ↔ | blocked | Arabic language variant | |
0626 | ئ | 064A | ي | ↔ | blocked | Arabic language variant | |
0626 | ئ | 06CC | ی | ↔ | blocked | Arabic language variant / Cross-repertoire variant | |
0626 | ئ | 06CD | ۍ | ↔ | blocked | Arabic language variant / Cross-repertoire variant | |
0626 | ئ | 06D0 | ې | ↔ | blocked | Arabic language variant / Cross-repertoire variant | |
0626 | ئ | 06D2 | ے | ↔ | blocked | Arabic language variant / Cross-repertoire variant | |
0649 | ى | 064A | ي | ↔ | blocked | Arabic language variant | |
0649 | ى | 06CC | ی | → | optionally-activated | The two are visually identical and the same label could be typed using one or the other based on the set language settings and keyboard layout of a user | |
← | blocked | Cross-repertoire variant | |||||
0649 | ى | 06CD | ۍ | ↔ | blocked | Cross-repertoire variant | |
0649 | ى | 06D0 | ې | ↔ | blocked | Cross-repertoire variant | |
0649 | ى | 06D2 | ے | ↔ | blocked | Cross-repertoire variant | |
064A | ي | 06CC | ی | → | optionally-activated | The two are visually identical and the same label could be typed using one or the other based on the set language settings and keyboard layout of a user | |
← | blocked | Cross-repertoire variant | |||||
064A | ي | 06CD | ۍ | ↔ | blocked | Cross-repertoire variant | |
064A | ي | 06D0 | ې | ↔ | blocked | Cross-repertoire variant | |
064A | ي | 06D2 | ے | ↔ | blocked | Cross-repertoire variant | |
06CC | ی | 06CC | ی | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire | |
06CC | ی | 06CD | ۍ | ↔ | blocked | Cross-repertoire variant / Added for transitivity | |
06CC | ی | 06D0 | ې | ↔ | blocked | Cross-repertoire variant / Added for transitivity | |
06CC | ی | 06D2 | ے | ↔ | blocked | Cross-repertoire variant / Added for transitivity | |
06CD | ۍ | 06CD | ۍ | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire | |
06CD | ۍ | 06D0 | ې | ↔ | blocked | Cross-repertoire variant / Added for transitivity | |
06CD | ۍ | 06D2 | ے | ↔ | blocked | Cross-repertoire variant / Added for transitivity | |
06D0 | ې | 06D0 | ې | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire | |
06D0 | ې | 06D2 | ے | ↔ | blocked | Cross-repertoire variant | |
06D2 | ے | 06D2 | ے | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0629 | ة | 0647 | ه | → | allocatable | In the Arabic language, U+0647 (ه) HEH may be substituted for U+0629 (ة) TEH MARBUTA. [RFC 6365] | |
← | blocked | Arabic language variant | |||||
0629 | ة | 06BE | ھ | ↔ | blocked | Cross-repertoire variant | |
0629 | ة | 06C1 | ہ | ↔ | blocked | Cross-repertoire variant | |
0629 | ة | 06C3 | ۃ | → | optionally-activated | The two are visually identical and the same label could be typed using one or the other based on the set language settings and keyboard layout of a user. Labels in the Arabic language using U+0629 (ة) TEH MARBUTA in the final and isolated positions will be typed in other languages using U+06C3 (ۃ) TEH MARBUTA GOAL (Urdu, etc.) which is identical in isolated and has a variant glyph or identical glyph form in final position | |
← | blocked | Cross-repertoire variant | |||||
0647 | ه | 06BE | ھ | → | optionally-activated | Labels in the Arabic language using U+0647 (ه) HEH in the initial and medial positions will be visually similar in Urdu language to U+06BE (ھ) LETTER HEH DOACHASHMEE | |
← | blocked | Cross-repertoire variant | |||||
0647 | ه | 06C1 | ہ | → | optionally-activated | Labels in the Arabic language using U+0647 (ه) HEH in the final and isolated positions will be typed in other languages using U+06C1 (ہ) HEH GOAL (Urdu, Pashto, Saraiki, etc.) which is identical in isolated and has a variant glyph or identical glyph form in final position | |
← | blocked | Cross-repertoire variant | |||||
0647 | ه | 06C3 | ۃ | ↔ | blocked | Cross-repertoire variant | |
06BE | ھ | 06BE | ھ | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire | |
06BE | ھ | 06C1 | ہ | ↔ | blocked | Added for transitivity | |
06BE | ھ | 06C3 | ۃ | ↔ | blocked | Added for transitivity | |
06C1 | ہ | 06C1 | ہ | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire | |
06C1 | ہ | 06C3 | ۃ | ↔ | blocked | Added for transitivity | |
06C3 | ۃ | 06C3 | ۃ | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0643 | ك | 06A9 | ک | → | optionally-activated | The two have identical shapes in initial and medial positions and are used by different language communities to refer to the same letter | |
← | blocked | Cross-repertoire variant | |||||
06A9 | ک | 06A9 | ک | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire |
Source | Glyph | Target | Glyph | Type | Ref | Comment | |
---|---|---|---|---|---|---|---|
0646 | ن | 06BA | ں | ↔ | blocked | Cross-repertoire variant | |
06BA | ں | 06BA | ں | ≡ | out-of-repertoire-var | Not part of the Arabic language repertoire |
The following table lists all named and implicit classes with their definition and a list of their members intersected with the current repertoire (for larger classes, this list is elided).
Name | Definition | Count | Members or Ranges | Ref | Comment |
---|---|---|---|---|---|
right-joining | Prop=jt:R | 111→14 | {0622-0625 0627 0629 062F-0632 0648 06C3 06CD 06D2} | Any character matching Unicode property jt:R | |
dual-joining | Prop=jt:D | 424→30 | {0626 0628 062A-062E 0633-063A 0641-0647 0649-064A 06A9 06BA 06BE 06C1 06CC 06D0} | Any character matching Unicode property jt:D | |
joins-to-the-right | combined = [[:right-joining:] ∪ [:dual-joining:]] |
535→44 | {0622-063A 0641-064A 06A9 06BA 06BE 06C1 06C3 06CC-06CD 06D0 06D2} | ||
arabic-language | explicit | 57 | {002D 0030-0039 0621-063A 0641-064A 0660-0669} | ||
urdu-language | explicit | 63→56 | {002D 0030-0039 0621-0622 0626-0628 062A-063A 0641-0642 0644-0646 0648 06A9 06BA 06BE 06C1 06C3 06CC 06D2 06F0-06F9} | ||
persian-language | explicit | 56→52 | {002D 0030-0039 0621-0622 0626-0628 062A-063A 0641-0642 0644-0648 06A9 06CC 06F0-06F9} | ||
pashto-language | explicit | 68→56 | {002D 0030-0039 0621-0622 0624 0626-0628 062A-063A 0641-0642 0644-0648 064A 06A9 06CC-06CD 06D2 06F0-06F9} | ||
common-digits | Tag=Common-digit | 10 | {0030-0039} | Digits from the ASCII range; ⍟ | |
arabic-indic-digits | Tag=Arabic-indic-digit | 10 | {0660-0669} | Arabic-Indic digits; ⍟ | |
extended-arabic-indic-digits | Tag=Extended-arabic-indic-digit | 10 | {06F0-06F9} | Extended Arabic-Indic digits | |
hyphen | Tag=Hyphen | 1 | {002D} | The Hyphen-minus character ⍟ | |
implicit | Tag=sc:Arab | 65 | {0621-063A 0641-064A 0660-0669 06A9 06BA 06BE 06C1 06C3 06CC-06CD 06D0 06D2 06F0-06F9} | Any character tagged as Arabic | |
implicit | Tag=sc:Zyyy | 11 | {002D 0030-0039} | Any character tagged as Common |
Legend
The following table lists all named rules defined in the LGR and indicates whether they are used as trigger in an action or as context (when or not-when) for a code point or variant.
Name | Regular Expression | Used as Trigger |
Anchor | Used as Context |
Ref | Comment |
---|---|---|---|---|---|---|
leading-combining-mark | (start)[∅=[[∅=\p{gc=Mn}] ∪ [∅=\p{gc=Mc}]]] |
✔ | [150] | RFC 5891 restrictions on placement of combining marks ⍟ | ||
hyphen-minus-disallowed | (((start))← ⚓)|(⚓ →((end)))|(((start)..[:hyphen:])← ⚓) |
✔ | C | [150] | RFC 5891 restrictions on placement of U+002D (-) ⍟ | |
single-language-label | ((start)[:arabic-language:]+(end))|((start)[:persian-language:]+(end))|((start)[:urdu-language:]+(end))|((start)[:pashto-language:]+(end))+ |
✔ | a label/variant can only be written using characters from one of the 4 languages | |||
leading-digit | ((start))← ⚓ |
✔ | C | [160] | RFC 5893 RTL labels cannot start with a digit | |
digit-mixing | ([:common-digits:].*([:arabic-indic-digits:]|[:extended-arabic-indic-digits:]))|([:arabic-indic-digits:].*([:common-digits:]|[:extended-arabic-indic-digits:]))|([:extended-arabic-indic-digits:].*([:common-digits:]|[:arabic-indic-digits:])) |
✔ | [160] | RFC 5892 and RFC 5893 restrictions on mixing digits; extended to all three sets | ||
initial-or-medial-position | ⚓ →([:joins-to-the-right:]) |
✔ | C | U+0649 (ى) ALEF MAKSURA must not be in initial or medial position; U+0626 (ئ) YEH WITH HAMZA ABOVE is only allowed when in initial or medial position | ||
no-mix-kaf-keheh | (\u0643.*\u06A9)|(\u06A9.*\u0643) |
✔ | [100] | WLE Rule 1: do not mix Arabic letters KAF and KEHEH in the same label | ||
no-mix-alef-maksura-farsi-yeh | (\u0649.*\u06CC)|(\u06CC.*\u0649) |
✔ | [100] | WLE Rule 3: do not mix Arabic letters ALEF MAKSURA and FARSI YEH in the same label | ||
no-mix-heh-goal | (\u0647.*\u06C1)|(\u06C1.*\u0647) |
✔ | [100] | WLE Rule 4: do not mix Arabic letters HEH and HEH GOAL in the same label | ||
no-mix-heh-doachashmee | (\u0647.*\u06BE)|(\u06BE.*\u0647) |
✔ | [100] | WLE Rule 7: do not mix Arabic letters HEH and HEH DOACHASHMEE in the same label | ||
no-mix-teh-marbuta-goal | (\u0629.*\u06C3)|(\u06C3.*\u0629) |
✔ | [100] | WLE Rule 8: do not mix Arabic letters TEH MARBUTA and FEH WITH DOT MOVED BELOW in the same label | ||
ascii-only-label | (start)[\u002D\u0030-\u0039]+(end) |
✔ | [150] | RFC 5891 restriction requiring at least one non-ASCII code point ⍟ |
Legend
The following table lists the actions that are used to assign dispositions to labels and variant labels based on the specified conditions. The order of actions defines their precedence: the first action triggered by a label is the one defining its disposition.
# | Condition | Rule / Variant Set | Disposition | Ref | Comment | |
---|---|---|---|---|---|---|
1 | if label does not match | single-language-label | → | invalid | all labels (including variants) must be entirely within one of four languages | |
2 | if label matches | digit-mixing | → | invalid | a label matching the RFC 5892 and RFC 5893 restriction on digit mixing is invalid | |
3 | if label matches | leading-combining-mark | → | invalid | RFC 5892: labels with leading combining marks are invalid ⍟ | |
4 | if label matches | ascii-only-label | → | invalid | [150] | ascii-only labels invalid (not IDNs) ⍟ |
5 | if at least one variant is in | {out-of-repertoire-var} | → | invalid | disallow code points that are out of repertoire | |
6 | if label matches | no-mix-kaf-keheh | → | invalid | do not mix Arabic letters KAF and KEHEH in the same label | |
7 | if label matches | no-mix-alef-maksura-farsi-yeh | → | invalid | do not mix Arabic letters ALEF MAKSURA and FARSI YEH in the same label | |
8 | if label matches | no-mix-heh-goal | → | invalid | do not mix Arabic letters HEH and HEH GOAL in the same label | |
9 | if label matches | no-mix-heh-doachashmee | → | invalid | do not mix Arabic letters HEH and HEH DOACHASHMEE in the same label | |
10 | if label matches | no-mix-teh-marbuta-goal | → | invalid | do not mix Arabic letters TEH MARBUTA and FEH WITH DOT MOVED BELOW in the same label | |
11 | if at least one variant is in | {blocked} | → | blocked | any variant label containing blocked variants is blocked ; | |
12 | if at least one variant is in | {optionally-allocatable} | → | blocked | optional allocation for certain within-repertoire variants; to make allocation possible, change (blocked) to (allocatable) | |
13 | if at least one variant is in | {optionally-activated} | → | allocatable | optional delegation for certain cross-repertoire variants; to make delegation mandatory, change (allocatable) to (activated) | |
14 | if at least one variant is in | {activated} | → | activated | forced delegation for certain in-repertoire variants | |
15 | if each variant is in | {allocatable} | → | allocatable | variant labels with all variants allocatable are allocatable | |
16 | if any label (catch-all) | → | valid | catch all (default action) |
Legend
The following lists the references cited for specific code points, variants, classes, rules or actions in this LGR. For General references refer to the "References" section in the Description.
[0] | The Unicode Consortium. The Unicode Standard, Version 1.0, Volume 1
Reading, MA, Addison-Wesley Developers Press, 1991. ISBN 0-201-56788-1 and The Unicode Standard, Version 1.0, Volume 2
Reading, MA, Addison-Wesley Developers Press, 1992. ISBN 0-201-60845-6, as amended by Davis, Mark, Unicode Technical Report #4: The Unicode Standard, Version 1.1
Cupertino, CA, The Unicode Consortium, 1993 Any code point cited was originally encoded in Unicode Version 1.1 |
[100] | RFC 5564 Linguistic Guidelines for the Use of the Arabic Language in Internet Domains https://tools.ietf.org/html/rfc5564 |
[108] | Omniglot Pashto http://omniglot.com/writing/pashto.htm |
[109] | Omniglot Persian(Farsi) http://omniglot.com/writing/persian.htm |
[112] | Omniglot Urdu http://omniglot.com/writing/urdu.htm |
[126] | Urdu, Teh marbuta goal, Code point UZT 76 of Urdu Zabta Takhti 1.01, the official code page standard for Govt. of Pakistan, approved in 2001; see http://cle.org.pk/Publication/papers/2001/uzt1.01.pdf |
[150] | RFC 5891, Internationalized Domain Names in Applications (IDNA): Protocol http://tools.ietf.org/html/rfc5891 |
[160] | RFC 5893, Right-to-Left Scripts for Internationalized Domain Names for Applications (IDNA) http://tools.ietf.org/html/rfc5893 |
[201] | Omniglot Arabic https://www.omniglot.com/writing/arabic.htm |
[401] | The Unicode Consortium, Common Locale Data Repository.- CLDR Version 28 (2015-09-16)- Locale Data Summary for Arabic (ar)- http://www.unicode.org/cldr/charts/28/summary/ar.html Code points cited are from the set of Main Letters |
[600] | Wikipedia Arabic alphabet https://en.wikipedia.org/wiki/Arabic_alphabet accessed 2015-10-31 Code points cited are from the set of Basic letters |
[700] | Saudi Network Information Center (.sa, Saudi Arabia ccTLD) http://www.iana.org/domains/idn-tables/tables/sa_ar_2.0.pdf |