ruby.git/lib/unicode_normalize/normalize.rb, branch v4.0.3

minor code allignment (related to bug 21559)

2025-11-02T10:22:22+00:00

Remove recursion in UnicodeNormalize.nfc_one, fixing bug 21159.

2025-11-02T00:27:54+00:00

Improve performance of UnicodeNormalize.canonical_ordering_one

2025-10-25T12:19:29+00:00

Use array_of_integer.sort! instead of buble-sort-like algorithm

prepare Unicode normalization for Unicode 16.0.0

2025-04-18T07:07:17+00:00

[DOC] hide `UnicodeNormalize` in module index

2022-03-14T06:01:20+00:00

lib/*: Prefer require_relative over require, remove explicit extension

2018-11-02T17:52:43+00:00

[#15206] [Fix GH-1976]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@65506 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

fix range check for Hangul jamo trailers in Unicode normalization

2018-07-28T09:44:33+00:00

* lib/unicode_normalize/normalize.rb: Fix the range check for trailing
  Hangul jamo characters in Unicode normalization. Different from
  leading or vowel jamos, where LBASE and VBASE are actual characters,
  a value equal to TBASE expresses the absence of a trailing jamo.
  This fix is technically correct, but there was no bug because
  the regular expressions in lib/unicode_normalize/tables.rb
  eliminate jamos equal to TBASE from normalization processing.

* test/test_unicode_normalize.rb: Add preventive test
  test_no_trailing_jamo based on
  https://github.com/python/cpython/commit/d134809cd3764c6a634eab7bb8995e3e2eff14d5
  just for the case we ever get a regression.

This closes issue #14934, thanks to MaLin (Lin Ma) for reporting.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@64087 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

add explanations about status of module UnicodeNormalize

2017-05-09T10:45:46+00:00

In lib/unicode_normalize/normalize.rb, add explanations and clarifications
about the status of the files and the module. [ci skip]
This is in response to discussions at https://github.com/ruby/spec/pull/433
and https://bugs.ruby-lang.org/issues/5481#note-58.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@58617 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

move definition of String#unicode_normalized? to C to make sure it is documented

2017-05-04T02:00:19+00:00

* lib/unicode_normalize.rb: Remove definition of String#unicode_normalized?
  (including documentation). Leave a comment explaining that the file is now empty.
* string.c: Define String#unicode_normalized? in rb_str_unicode_normalized_p in C,
  (including documentation)
* lib/unicode_normalize/normalize.rb: Remove (re)definition of
  String#unicode_normalized? to avoid warnings (when $VERBOSE==true) and
  problems when String is frozen

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@58555 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

move definition of String#unicode_normalize! to C to make sure it is documented

2017-05-04T01:36:52+00:00

* lib/unicode_normalize.rb: Remove definition of String#unicode_normalize!
  (including documentation)
* string.c: Define String#unicode_normalize! in rb_str_unicode_normalize_bang in C,
  (including documentation)
* lib/unicode_normalize/normalize.rb: Remove (re)definition of
  String#unicode_normalize! to avoid warnings (when $VERBOSE==true) and
  problems when String is frozen

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@58553 b2dd03c8-39d4-4d8f-98ff-823fe69b080e