Update GB18030 encoding from version 2000 to 2022
authorJohn Naylor <[email protected]>
Wed, 24 Sep 2025 06:26:05 +0000 (13:26 +0700)
committerJohn Naylor <[email protected]>
Wed, 24 Sep 2025 06:26:05 +0000 (13:26 +0700)
commit5334620eef8f7b429594e6cf9dc97331eda2a8bd
tree8297fac3f8b050349fc65ba8c5b3fd22ca8197eb
parente41d954da6aa04f0a4453e566d3bcc064512d457
Update GB18030 encoding from version 2000 to 2022

Mappings for 18 characters have changed, affecting 36 code points. This
is a break in compatibility, but these characters are rarely used.

U+E5E5 (Private Use Area) was previously mapped to \xA3A0. This code
point now maps to \x65356535. Attempting to convert \xA3A0 will now
raise an error.

Separate from the 2022 update, the following mappings were previously
swapped, and subsequently corrected in 2000 and later versions:
 * U+E7C7 (Private Use Area) now maps to \x8135F437
 * U+1E3F (Latin Small Letter M with Acute) now maps to \xA8BC

The 2022 standard mentions the following policy changes, but they
have no effect in our implementation:

66 new ideographs are now required, but these are mapped
algorithmically so were already handled by utf8_and_gb18030.c.

Nine CJK compatibility ideographs are no longer required, but
implementations may retain them, as does the source we use from
the Unicode Consortium.

Release notes: Compatibility section

For further details, see:
https://www.unicode.org/L2/L2022/22274-disruptive-changes.pdf
https://ken-lunde.medium.com/the-gb-18030-2022-standard-3d0ebaeb4132

Author: Chao Li <[email protected]>
Author: Zheng Tao <[email protected]>
Discussion: https://postgr.es/m/966d9fc.169.198741fe60b.Coremail.jiaoshuntian%40highgo.com
doc/src/sgml/charset.sgml
src/backend/utils/mb/Unicode/Makefile
src/backend/utils/mb/Unicode/UCS_to_GB18030.pl
src/backend/utils/mb/Unicode/gb18030_to_utf8.map
src/backend/utils/mb/Unicode/utf8_to_gb18030.map
src/test/regress/expected/conversion.out
src/test/regress/sql/conversion.sql