Halfwidth and Fullwidth Forms
My pipeline maps the latin and japanese half/full width forms to their normalized equivalent. For example, the “FULLWIDTH YEN SIGN” is transliterated into the “YEN SIGN” found in latin1-supplement.
In rare cases, the dataset composes a japanese character with a dakuten/handakuten to create a
composite like ｶﾞ (ｶ + ﾞ). In this case, I match on the two character pair and transliterate it
directly to its full-width variant ガ.
Standalone dakuten/handakuten symbols are dropped from the dataset.
| From | To | Name | Count |
|---|---|---|---|
| ！ | ! | FULLWIDTH EXCLAMATION MARK | 439 |
| ＂ | " | FULLWIDTH QUOTATION MARK | - |
| ＃ | # | FULLWIDTH NUMBER SIGN | 5 |
| ＄ | $ | FULLWIDTH DOLLAR SIGN | 1 |
| ％ | % | FULLWIDTH PERCENT SIGN | 3 |
| ＆ | & | FULLWIDTH AMPERSAND | 1577 |
| ＇ | ' | FULLWIDTH APOSTROPHE | - |
| （ | ( | FULLWIDTH LEFT PARENTHESIS | 28422 |
| ） | ) | FULLWIDTH RIGHT PARENTHESIS | 28475 |
| ＊ | * | FULLWIDTH ASTERISK | 27 |
| ＋ | + | FULLWIDTH PLUS SIGN | 100 |
| ， | , | FULLWIDTH COMMA | 238 |
| － | ^ | FULLWIDTH HYPHEN-MINUS | 1708 |
| ． | . | FULLWIDTH FULL STOP | 157 |
| ／ | / | FULLWIDTH SOLIDUS | 290 |
| ０ | 0 | FULLWIDTH DIGIT ZERO | 4352 |
| １ | 1 | FULLWIDTH DIGIT ONE | 18763 |
| ２ | 2 | FULLWIDTH DIGIT TWO | 15345 |
| ３ | 3 | FULLWIDTH DIGIT THREE | 10985 |
| ４ | 4 | FULLWIDTH DIGIT FOUR | 8223 |
| ５ | 5 | FULLWIDTH DIGIT FIVE | 6956 |
| ６ | 6 | FULLWIDTH DIGIT SIX | 5560 |
| ７ | 7 | FULLWIDTH DIGIT SEVEN | 5336 |
| ８ | 8 | FULLWIDTH DIGIT EIGHT | 4934 |
| ９ | 9 | FULLWIDTH DIGIT NINE | 4292 |
| ： | : | FULLWIDTH COLON | 513 |
| ； | ; | FULLWIDTH SEMICOLON | 134 |
| ＜ | < | FULLWIDTH LESS-THAN SIGN | 95 |
| ＝ | = | FULLWIDTH EQUALS SIGN | 48 |
| ＞ | > | FULLWIDTH GREATER-THAN SIGN | 99 |
| ？ | ? | FULLWIDTH QUESTION MARK | 91 |
| ＠ | @ | FULLWIDTH COMMERCIAL AT | 12 |
| Ａ | A | FULLWIDTH LATIN CAPITAL LETTER A | 1709 |
| Ｂ | B | FULLWIDTH LATIN CAPITAL LETTER B | 582 |
| Ｃ | C | FULLWIDTH LATIN CAPITAL LETTER C | 1609 |
| Ｄ | D | FULLWIDTH LATIN CAPITAL LETTER D | 314 |
| Ｅ | E | FULLWIDTH LATIN CAPITAL LETTER E | 456 |
| Ｆ | F | FULLWIDTH LATIN CAPITAL LETTER F | 233 |
| Ｇ | G | FULLWIDTH LATIN CAPITAL LETTER G | 228 |
| Ｈ | H | FULLWIDTH LATIN CAPITAL LETTER H | 239 |
| Ｉ | I | FULLWIDTH LATIN CAPITAL LETTER I | 1378 |
| Ｊ | J | FULLWIDTH LATIN CAPITAL LETTER J | 943 |
| Ｋ | K | FULLWIDTH LATIN CAPITAL LETTER K | 452 |
| Ｌ | L | FULLWIDTH LATIN CAPITAL LETTER L | 215 |
| Ｍ | M | FULLWIDTH LATIN CAPITAL LETTER M | 356 |
| Ｎ | N | FULLWIDTH LATIN CAPITAL LETTER N | 500 |
| Ｏ | O | FULLWIDTH LATIN CAPITAL LETTER O | 416 |
| Ｐ | P | FULLWIDTH LATIN CAPITAL LETTER P | 650 |
| Ｑ | Q | FULLWIDTH LATIN CAPITAL LETTER Q | 26 |
| Ｒ | R | FULLWIDTH LATIN CAPITAL LETTER R | 709 |
| Ｓ | S | FULLWIDTH LATIN CAPITAL LETTER S | 775 |
| Ｔ | T | FULLWIDTH LATIN CAPITAL LETTER T | 584 |
| Ｕ | U | FULLWIDTH LATIN CAPITAL LETTER U | 307 |
| Ｖ | V | FULLWIDTH LATIN CAPITAL LETTER V | 119 |
| Ｗ | W | FULLWIDTH LATIN CAPITAL LETTER W | 91 |
| Ｘ | X | FULLWIDTH LATIN CAPITAL LETTER X | 65 |
| Ｙ | Y | FULLWIDTH LATIN CAPITAL LETTER Y | 202 |
| Ｚ | Z | FULLWIDTH LATIN CAPITAL LETTER Z | 42 |
| ［ | [ | FULLWIDTH LEFT SQUARE BRACKET | 30 |
| ＼ | \ | FULLWIDTH REVERSE SOLIDUS | 2 |
| ］ | ] | FULLWIDTH RIGHT SQUARE BRACKET | 30 |
| ＾ | ^ | FULLWIDTH CIRCUMFLEX ACCENT | - |
| ＿ | _ | FULLWIDTH LOW LINE | 7 |
| ｀ | ` | FULLWIDTH GRAVE ACCENT | 1 |
| ａ | a | FULLWIDTH LATIN SMALL LETTER A | 181 |
| ｂ | b | FULLWIDTH LATIN SMALL LETTER B | 29 |
| ｃ | c | FULLWIDTH LATIN SMALL LETTER C | 64 |
| ｄ | d | FULLWIDTH LATIN SMALL LETTER D | 59 |
| ｅ | e | FULLWIDTH LATIN SMALL LETTER E | 173 |
| ｆ | f | FULLWIDTH LATIN SMALL LETTER F | 32 |
| ｇ | g | FULLWIDTH LATIN SMALL LETTER G | 52 |
| ｈ | h | FULLWIDTH LATIN SMALL LETTER H | 57 |
| ｉ | i | FULLWIDTH LATIN SMALL LETTER I | 155 |
| ｊ | j | FULLWIDTH LATIN SMALL LETTER J | 9 |
| ｋ | k | FULLWIDTH LATIN SMALL LETTER K | 140 |
| ｌ | l | FULLWIDTH LATIN SMALL LETTER L | 73 |
| ｍ | m | FULLWIDTH LATIN SMALL LETTER M | 231 |
| ｎ | n | FULLWIDTH LATIN SMALL LETTER N | 139 |
| ｏ | o | FULLWIDTH LATIN SMALL LETTER O | 150 |
| ｐ | p | FULLWIDTH LATIN SMALL LETTER P | 20 |
| ｑ | q | FULLWIDTH LATIN SMALL LETTER Q | 11 |
| ｒ | r | FULLWIDTH LATIN SMALL LETTER R | 129 |
| ｓ | s | FULLWIDTH LATIN SMALL LETTER S | 124 |
| ｔ | t | FULLWIDTH LATIN SMALL LETTER T | 109 |
| ｕ | u | FULLWIDTH LATIN SMALL LETTER U | 91 |
| ｖ | v | FULLWIDTH LATIN SMALL LETTER V | 34 |
| ｗ | w | FULLWIDTH LATIN SMALL LETTER W | 27 |
| ｘ | x | FULLWIDTH LATIN SMALL LETTER X | 7 |
| ｙ | y | FULLWIDTH LATIN SMALL LETTER Y | 56 |
| ｚ | z | FULLWIDTH LATIN SMALL LETTER Z | 13 |
| ｛ | { | FULLWIDTH LEFT CURLY BRACKET | 1 |
| ｜ | | | FULLWIDTH VERTICAL LINE | 37 |
| ｝ | } | FULLWIDTH RIGHT CURLY BRACKET | 2 |
| ～ | ~ | FULLWIDTH TILDE | 1364 |
| ｟ | (( | FULLWIDTH LEFT WHITE PARENTHESIS | - |
| ｠ | )) | FULLWIDTH RIGHT WHITE PARENTHESIS | - |
| ｡ | . | HALFWIDTH IDEOGRAPHIC FULL STOP | 2 |
| ｢ | [ | HALFWIDTH LEFT CORNER BRACKET | 5 |
| ｣ | ] | HALFWIDTH RIGHT CORNER BRACKET | 5 |
| ､ | , | HALFWIDTH IDEOGRAPHIC COMMA | 1 |
| ･ | · | HALFWIDTH KATAKANA MIDDLE DOT | 1247 |
| ｦ | wo | HALFWIDTH KATAKANA LETTER WO | - |
| ｧ | a | HALFWIDTH KATAKANA LETTER SMALL A | 19 |
| ｨ | i | HALFWIDTH KATAKANA LETTER SMALL I | 18 |
| ｩ | u | HALFWIDTH KATAKANA LETTER SMALL U | - |
| ｪ | e | HALFWIDTH KATAKANA LETTER SMALL E | 7 |
| ｫ | o | HALFWIDTH KATAKANA LETTER SMALL O | 1 |
| ｬ | ya | HALFWIDTH KATAKANA LETTER SMALL YA | 14 |
| ｭ | yu | HALFWIDTH KATAKANA LETTER SMALL YU | 9 |
| ｮ | yo | HALFWIDTH KATAKANA LETTER SMALL YO | 10 |
| ｯ | tsu | HALFWIDTH KATAKANA LETTER SMALL TU | 23 |
| ｰ | ^ | HALFWIDTH KATAKANA-HIRAGANA PROLONGED SOUND MARK | 196 |
| ｱ | a | HALFWIDTH KATAKANA LETTER A | 21 |
| ｲ | i | HALFWIDTH KATAKANA LETTER I | 63 |
| ｳ | u | HALFWIDTH KATAKANA LETTER U | 35 |
| ｴ | e | HALFWIDTH KATAKANA LETTER E | 16 |
| ｵ | o | HALFWIDTH KATAKANA LETTER O | 27 |
| ｶ | ka | HALFWIDTH KATAKANA LETTER KA | 24 |
| ｷ | ki | HALFWIDTH KATAKANA LETTER KI | 12 |
| ｸ | ku | HALFWIDTH KATAKANA LETTER KU | 30 |
| ｹ | ke | HALFWIDTH KATAKANA LETTER KE | 18 |
| ｺ | ko | HALFWIDTH KATAKANA LETTER KO | 14 |
| ｻ | sa | HALFWIDTH KATAKANA LETTER SA | 19 |
| ｼ | shi | HALFWIDTH KATAKANA LETTER SI | 33 |
| ｽ | su | HALFWIDTH KATAKANA LETTER SU | 44 |
| ｾ | se | HALFWIDTH KATAKANA LETTER SE | 20 |
| ｿ | so | HALFWIDTH KATAKANA LETTER SO | 6 |
| ﾀ | ta | HALFWIDTH KATAKANA LETTER TA | 54 |
| ﾁ | chi | HALFWIDTH KATAKANA LETTER TI | 13 |
| ﾂ | tsu | HALFWIDTH KATAKANA LETTER TU | 9 |
| ﾃ | te | HALFWIDTH KATAKANA LETTER TE | 31 |
| ﾄ | to | HALFWIDTH KATAKANA LETTER TO | 39 |
| ﾅ | na | HALFWIDTH KATAKANA LETTER NA | 13 |
| ﾆ | ni | HALFWIDTH KATAKANA LETTER NI | 12 |
| ﾇ | nu | HALFWIDTH KATAKANA LETTER NU | 2 |
| ﾈ | ne | HALFWIDTH KATAKANA LETTER NE | 6 |
| ﾉ | no | HALFWIDTH KATAKANA LETTER NO | 27 |
| ﾊ | ha | HALFWIDTH KATAKANA LETTER HA | 39 |
| ﾋ | hi | HALFWIDTH KATAKANA LETTER HI | 34 |
| ﾌ | fu | HALFWIDTH KATAKANA LETTER HU | 58 |
| ﾍ | he | HALFWIDTH KATAKANA LETTER HE | 14 |
| ﾎ | ho | HALFWIDTH KATAKANA LETTER HO | 14 |
| ﾏ | ma | HALFWIDTH KATAKANA LETTER MA | 15 |
| ﾐ | mi | HALFWIDTH KATAKANA LETTER MI | 24 |
| ﾑ | mu | HALFWIDTH KATAKANA LETTER MU | 13 |
| ﾒ | me | HALFWIDTH KATAKANA LETTER ME | 9 |
| ﾓ | mo | HALFWIDTH KATAKANA LETTER MO | 19 |
| ﾔ | ya | HALFWIDTH KATAKANA LETTER YA | 6 |
| ﾕ | yu | HALFWIDTH KATAKANA LETTER YU | 1 |
| ﾖ | yo | HALFWIDTH KATAKANA LETTER YO | 1 |
| ﾗ | ra | HALFWIDTH KATAKANA LETTER RA | 44 |
| ﾘ | ri | HALFWIDTH KATAKANA LETTER RI | 36 |
| ﾙ | ru | HALFWIDTH KATAKANA LETTER RU | 73 |
| ﾚ | re | HALFWIDTH KATAKANA LETTER RE | 18 |
| ﾛ | ro | HALFWIDTH KATAKANA LETTER RO | 10 |
| ﾜ | wa | HALFWIDTH KATAKANA LETTER WA | 10 |
| ﾝ | n | HALFWIDTH KATAKANA LETTER N | 99 |
| ﾞ | HALFWIDTH KATAKANA VOICED SOUND MARK | 90 | |
| ﾟ | HALFWIDTH KATAKANA SEMI-VOICED SOUND MARK | 43 | |
| ﾠ | HALFWIDTH HANGUL FILLER | - | |
| ﾡ | HALFWIDTH HANGUL LETTER KIYEOK | - | |
| ﾢ | HALFWIDTH HANGUL LETTER SSANGKIYEOK | - | |
| ﾣ | HALFWIDTH HANGUL LETTER KIYEOK-SIOS | - | |
| ﾤ | HALFWIDTH HANGUL LETTER NIEUN | - | |
| ﾥ | HALFWIDTH HANGUL LETTER NIEUN-CIEUC | - | |
| ﾦ | HALFWIDTH HANGUL LETTER NIEUN-HIEUH | - | |
| ﾧ | HALFWIDTH HANGUL LETTER TIKEUT | - | |
| ﾨ | HALFWIDTH HANGUL LETTER SSANGTIKEUT | - | |
| ﾩ | HALFWIDTH HANGUL LETTER RIEUL | - | |
| ﾪ | HALFWIDTH HANGUL LETTER RIEUL-KIYEOK | - | |
| ﾫ | HALFWIDTH HANGUL LETTER RIEUL-MIEUM | - | |
| ﾬ | HALFWIDTH HANGUL LETTER RIEUL-PIEUP | - | |
| ﾭ | HALFWIDTH HANGUL LETTER RIEUL-SIOS | - | |
| ﾮ | HALFWIDTH HANGUL LETTER RIEUL-THIEUTH | - | |
| ﾯ | HALFWIDTH HANGUL LETTER RIEUL-PHIEUPH | - | |
| ﾰ | HALFWIDTH HANGUL LETTER RIEUL-HIEUH | - | |
| ﾱ | HALFWIDTH HANGUL LETTER MIEUM | - | |
| ﾲ | HALFWIDTH HANGUL LETTER PIEUP | - | |
| ﾳ | HALFWIDTH HANGUL LETTER SSANGPIEUP | - | |
| ﾴ | HALFWIDTH HANGUL LETTER PIEUP-SIOS | - | |
| ﾵ | HALFWIDTH HANGUL LETTER SIOS | - | |
| ﾶ | HALFWIDTH HANGUL LETTER SSANGSIOS | - | |
| ﾷ | HALFWIDTH HANGUL LETTER IEUNG | - | |
| ﾸ | HALFWIDTH HANGUL LETTER CIEUC | - | |
| ﾹ | HALFWIDTH HANGUL LETTER SSANGCIEUC | - | |
| ﾺ | HALFWIDTH HANGUL LETTER CHIEUCH | - | |
| ﾻ | HALFWIDTH HANGUL LETTER KHIEUKH | - | |
| ﾼ | HALFWIDTH HANGUL LETTER THIEUTH | - | |
| ﾽ | HALFWIDTH HANGUL LETTER PHIEUPH | - | |
| ﾾ | HALFWIDTH HANGUL LETTER HIEUH | - | |
| ￂ | HALFWIDTH HANGUL LETTER A | - | |
| ￃ | HALFWIDTH HANGUL LETTER AE | - | |
| ￄ | HALFWIDTH HANGUL LETTER YA | - | |
| ￅ | HALFWIDTH HANGUL LETTER YAE | - | |
| ￆ | HALFWIDTH HANGUL LETTER EO | - | |
| ￇ | HALFWIDTH HANGUL LETTER E | - | |
| ￊ | HALFWIDTH HANGUL LETTER YEO | - | |
| ￋ | HALFWIDTH HANGUL LETTER YE | - | |
| ￌ | HALFWIDTH HANGUL LETTER O | - | |
| ￍ | HALFWIDTH HANGUL LETTER WA | - | |
| ￎ | HALFWIDTH HANGUL LETTER WAE | - | |
| ￏ | HALFWIDTH HANGUL LETTER OE | - | |
| ￒ | HALFWIDTH HANGUL LETTER YO | - | |
| ￓ | HALFWIDTH HANGUL LETTER U | - | |
| ￔ | HALFWIDTH HANGUL LETTER WEO | - | |
| ￕ | HALFWIDTH HANGUL LETTER WE | - | |
| ￖ | HALFWIDTH HANGUL LETTER WI | - | |
| ￗ | HALFWIDTH HANGUL LETTER YU | - | |
| ￚ | HALFWIDTH HANGUL LETTER EU | - | |
| ￛ | HALFWIDTH HANGUL LETTER YI | - | |
| ￜ | HALFWIDTH HANGUL LETTER I | - | |
| ￠ | ¢ | FULLWIDTH CENT SIGN | - |
| ￡ | £ | FULLWIDTH POUND SIGN | - |
| ￢ | ¬ | FULLWIDTH NOT SIGN | - |
| ￣ | ¯ | FULLWIDTH MACRON | - |
| ￤ | ¦ | FULLWIDTH BROKEN BAR | - |
| ￥ | ¥ | FULLWIDTH YEN SIGN | 7 |
| ￦ | W | FULLWIDTH WON SIGN | - |
| ￨ | | | HALFWIDTH FORMS LIGHT VERTICAL | - |
| ￩ | <- | HALFWIDTH LEFTWARDS ARROW | - |
| ￪ | HALFWIDTH UPWARDS ARROW | - | |
| ￫ | -> | HALFWIDTH RIGHTWARDS ARROW | - |
| ￬ | HALFWIDTH DOWNWARDS ARROW | - | |
| ￭ | HALFWIDTH BLACK SQUARE | - | |
| ￮ | HALFWIDTH WHITE CIRCLE | - |