Transliteration
The OpenStreetMap dataset contains non-latin1 characters. This makes the raw data incompatible with many Garmin devices that can not display the full range of unicode characters. To solve this, I have developed custom mappings for each unicode character group to bring the data in-line with latin1.
The aggregations and mappings are generated and reviewed every release for quality control.
Metadata
Legend
- All characters in the group are mapped
- Some characters in the group are mapped
- All characters replaced with whitespace or removed
- The mapping of this group is undefined
- Handling of this is delegated to the kakasi library
Mapping
| Unicode Group | Range | Count |
|---|---|---|
| Basic Latin | U+0000 - U+007F | 6586285 |
| Latin-1 Supplement | U+0080 - U+00FF | 1914 |
| Latin Extended-A | U+0100 - U+017F | 23232 |
| Latin Extended-B | U+0180 - U+024F | 12 |
| Spacing Modifier Letters | U+02B0 - U+02FF | 3 |
| Combining Diacritical Marks | U+0300 - U+036F | 6 |
| Greek and Coptic | U+0370 - U+03FF | 63 |
| Cyrillic | U+0400 - U+04FF | 8474 |
| Thai | U+0E01 - U+0E5B | 77 |
| Phonetic Extensions | U+1D00 - U+1D7F | 1 |
| Latin Extended Additional | U+1E00 - U+1EFF | 61 |
| General Punctuation | U+2000 - U+206F | 1143 |
| Superscripts and Subscripts | U+2070 - U+209C | 4 |
| Letterlike Symbols | U+2100 - U+214F | 55 |
| Number Forms | U+2150 - U+2189 | 293 |
| Arrows | U+2190 - U+21FF | 162 |
| Mathematical Operators | U+2200 - U+22FF | 461 |
| Enclosed Alphanumerics | U+2460 - U+24FF | 577 |
| Box Drawing | U+2500 - U+257F | 4 |
| Geometric Shapes | U+25A0 - U+25FF | 154 |
| Miscellaneous Symbols | U+2600 - U+26FF | 133 |
| Dingbats | U+2701 - U+27BF | 8 |
| Miscellaneous Symbols and Arrows | U+2B00 - U+2B59 | 5 |
| CJK Radicals Supplement¹ | U+2E80 - U+2EF3 | 4 |
| Kangxi Radicals¹ | U+2F00 - U+2FD5 | 36 |
| CJK Symbols and Punctuation¹ | U+3000 - U+303F | 21816 |
| Hiragana¹ | U+3041 - U+309F | 2129853 |
| Katakana¹ | U+30A0 - U+30FF | 2040756 |
| Katakana Phonetic Extensions¹ | U+31F0 - U+31FF | 2 |
| Enclosed CJK Letters and Months | U+3200 - U+32FE | 116 |
| CJK Compatibility | U+3300 - U+33FF | 14 |
| CJK Unified Ideographs Extension A¹ | U+3400 - U+4DB5 | 74 |
| CJK Unified Ideographs¹ | U+4E00 - U+9FCB | 6477822 |
| Hangul Syllables | U+AC00 - U+D7A3 | 163 |
| Private Use Area | U+E000 - U+F8FF | 2 |
| CJK Compatibility Ideographs¹ | U+F900 - U+FAD9 | 107 |
| Variation Selectors | U+FE00 - U+FE0F | 20 |
| CJK Compatibility Forms | U+FE30 - U+FE4F | 1 |
| Halfwidth and Fullwidth Forms | U+FF01 - U+FFEE | 40611 |
| Specials | U+FFF9 - U+FFFD | 1 |
| Enclosed Alphanumeric Supplement | U+1F100 - U+1F1FF | 3 |
| Miscellaneous Symbols And Pictographs | U+1F300 - U+1F5FF | 6 |
| Transport And Map Symbols | U+1F680 - U+1F6C5 | 2 |
| CJK Unified Ideographs Extension B¹ | U+20000 - U+2A6D6 | 31 |
| CJK Unified Ideographs Extension D¹ | U+2B740 - U+2B81D | 2 |
| Variation Selectors Supplement | U+E0100 - U+E01EF | 22 |