summaryrefslogtreecommitdiff
path: root/template/unicode_norm_gen.tmpl
AgeCommit message (Collapse)Author
2019-04-13merge revision(s) 67439,67441,67453,67476: [Backport #15740]naruse
change lib/unicode_normalize/tables.rb to single item per line to make diffs shorter * template/unicode_norm_gen.tmpl: Change formatting of output to produce only a single item (or range) for each line to make future diffs shorter and easier to understand and check. * lib/unicode_normalize/tables.rb: output of the above update to Unicode Version 12.1.0 (beta) Unicode Version 12.1.0 adds one single character, U+32FF SQUARE ERA NAME REIWA, for the new Japanese era starting on May 1st. 12.1.0 will be finalized only on May 7th, so we go with the beta version because further changes in the data we need are highly unlikely, and we want to make sure Ruby is ready for the new era. * common.mk: change UNICODE_VERSION to 12.1.0, UNICODE_BETA to YES * enc/unicode/12.1.0, enc/unicode/12.1.0/casefold.h, enc/unicode/12.1.0/name2ctype.h: add directory and generated data files for new version * lib/unicode_normalize/tables.rb: update for new character * test/ruby/test_regexp.rb: add test for character property age=12.1 * test/test_unicode_normalize.rb: add test for NFKC decomposition of new character This (mostly) completes issue #15195. remove Unicode 12.0.0 related directory and generated files git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/branches/ruby_2_6@67525 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2018-01-12Fix a typo.hsbt
* template/unicode_norm_gen.tmpl: ouput -> output git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@61791 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2017-12-02fix for emoji-data.txtnobu
* common.mk: download emoji-data.txt. As emoji data files are located in a separate directory in Unicode.org site, reearranged Unicode data files directories same as the site. * tool/enc-unicode.rb (get_file): search emoji data files in the second argument path. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@60977 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2017-04-12nodoc UnicodeNormalize modulestomar
* lib/unicode_normalize/normalize.rb: [DOC] nodoc the internal UnicodeNormalize module. * lib/unicode_normalize/tables.rb: ditto. * template/unicode_norm_gen.tmpl: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@58329 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2016-08-16open Unicode data in binary modenobu
* tool/enc-unicode.rb (data_foreach): open in binary mode because Unicode 9.0.0 contains non-ascii characters. * template/unicode_norm_gen.tmpl: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@55945 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2016-07-22* template/unicode_norm_gen.tmpl: Removeduerst
UnicodeNormalize::UNICODE_VERSION at origin [Feature #12546]. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@55725 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2016-01-18unicode_norm_gen.tmpl: Remove indicatornobu
* template/unicode_norm_gen.tmpl: Remove indicator for "frozen_string_literal: true", as r52526. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@53577 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2015-09-29unicode_norm_gen.tmpl: end markernobu
* template/unicode_norm_gen.tmpl: pragma needs the end marker too, not only the beginning marker. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@51972 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2015-09-29tool/unicode_norm_gen.tmpl, lib/unicode_normalize/tables.rb:duerst
get rid of many .freeze commands by using frozen_string_literal pragma. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@51971 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2014-11-11unicode_norm_gen.tmpl: fix build errornobu
* template/unicode_norm_gen.tmpl: fix build error on CentOS 5 with ruby 1.8.5 which lacks Symbol#to_proc. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@48377 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2014-11-11suppress warning: shadowing outer local variable - linenaruse
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@48372 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2014-11-10unicode_normalize: UNICODE_VERSION constantnobu
* template/unicode_norm_gen.tmpl (UnicodeNormalize): embed the version of Unicode data files used to generate. * test/test_unicode_normalize.rb (TestUnicodeNormalize): use the embedded version to load the test data. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@48357 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2014-11-06unicode_norm_gen.tmpl: expand kompatible_tablenobu
* template/unicode_norm_gen.tmpl: expand kompatible_table so that recursive expansion is not needed at runtime. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@48311 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2014-10-25template/unicode_norm_gen.tmpl: Adjusted name of generating file.duerst
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@48130 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2014-10-25template/unicode_norm_gen.tmpl: from tool/unicode_norm_gen.rbnobu
* template/unicode_norm_gen.tmpl: use generic_erb.rb to update if changed and manage timestamp, so that source tree on read-only filesystem works. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@48129 b2dd03c8-39d4-4d8f-98ff-823fe69b080e