Make Unicode script fit for future versions

petere · petere · commit 5c08927d365b · 2023-09-18T07:25:46.000+02:00
Between Unicode 15.0.0 and 15.1.0, the whitespace in
EastAsianWidth.txt has changed a bit, such as from

0020;Na          # Zs         SPACE

to

0020           ; Na # Zs         SPACE

with space around the semicolon.  Adjust the script to be able to
parse that.
diff --git a/src/common/unicode/generate-unicode_east_asian_fw_table.pl b/src/common/unicode/generate-unicode_east_asian_fw_table.pl
@@ -23,7 +23,7 @@
 	chomp $line;
 	$line =~ s/\s*#.*$//;
 	next if $line eq '';
-	my ($codepoint, $width) = split ';', $line;
+	my ($codepoint, $width) = split /\s*;\s*/, $line;
 
 	if ($codepoint =~ /\.\./)
 	{

Original file line number	Diff line number	Diff line change
`@@ -23,7 +23,7 @@`
`23`	`23`	`chomp $line;`
`24`	`24`	`$line =~ s/\s#.$//;`
`25`	`25`	`next if $line eq '';`
`26`		`- my ($codepoint, $width) = split ';', $line;`
	`26`	`+ my ($codepoint, $width) = split /\s;\s/, $line;`
`27`	`27`
`28`	`28`	`if ($codepoint =~ /\.\./)`
`29`	`29`	`{`