summaryrefslogtreecommitdiff
path: root/test/ruby/test_m17n.rb
AgeCommit message (Collapse)Author
2009-04-08* string.c (rb_str_dump): buffer length plus one byte for nullmame
terminator. [ruby-dev:38294] * test/ruby/test_m17n.rb (test_str_dump): add a test for above. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@23160 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-03-06* {ext,lib,test}/**/*.rb: removed trailing spaces.nobu
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@22784 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-02-25* string.c (rb_str_force_encoding): should clear coderange at changingnobu
encoding. [ruby-core:22437] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@22611 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-12-13* test/ruby/test_m17n.rb: feature changed in r20626.yugui
follows it. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@20714 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-02* string.c (rb_str_sub_bang): fix coderange.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19662 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-19* parse.y: strings which contain only US-ASCII don't force to havenaruse
US-ASCII encoding. [ruby-dev:36400] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19434 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-18* grapheme cluster implementation reverted. [ruby-dev:36375]akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19417 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-18* transcode.c: add "Error" suffix for Encoding exception classes.matz
a patch from Tadashi Saito <shiba at mail2.accsnet.ne.jp> in [ruby-dev:36346]. * encoding.c (Init_Encoding): rename EncodingCompatibilityError to Encoding::CompatibilityError. [ruby-dev:36366] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19407 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-16* include/ruby/oniguruma.h (OnigEncodingTypeST): add precise_retakr
argument for mbc_to_code. (ONIGENC_MBC_TO_CODE): provide NULL for precise_ret. (ONIGENC_MBC_PRECISE_CODEPOINT): defined. * include/ruby/encoding.h (rb_enc_mbc_precise_codepoint): defined. * regenc.h (onigenc_single_byte_mbc_to_code): precise_ret argument added. (onigenc_mbn_mbc_to_code): ditto. * regenc.c (onigenc_single_byte_mbc_to_code): precise_ret argument added. (onigenc_mbn_mbc_to_code): ditto. * string.c (count_utf8_lead_bytes_with_word): removed. (str_utf8_nth): removed. (str_utf8_offset): removed. (str_strlen): UTF-8 codepoint oriented optimization removed. (rb_str_substr): ditto. (enc_succ_char): use rb_enc_mbc_precise_codepoint. (enc_pred_char): ditto. (rb_str_succ): ditto. * encoding.c (rb_enc_ascget): check length with rb_enc_mbc_precise_codepoint. (rb_enc_codepoint): use rb_enc_mbc_precise_codepoint. * regexec.c (string_cmp_ic): add text_end argument. (match_at): check end of character after exact string matches. * enc/utf_8.c (graphme_table): defined for extended graphme cluster boundary. (grapheme_cmp): defined. (get_grapheme_properties): defined. (grapheme_boundary_p): defined. (MAX_BYTES_LENGTH): defined. (comb_char_enc_len): defined. (mbc_to_code0): extracted from mbc_to_code. (mbc_to_code): use mbc_to_code0. (left_adjust_combchar_head): defined. (utf_8): use a extended graphme cluster as a unit. * enc/unicode.c (onigenc_unicode_mbc_case_fold): use ONIGENC_MBC_PRECISE_CODEPOINT to extract codepoints. (onigenc_unicode_get_case_fold_codes_by_str): ditto. * enc/euc_jp.c (mbc_to_code): follow mbc_to_code field change. use onigenc_mbn_mbc_to_code. * enc/shift_jis.c (mbc_to_code): ditto. * enc/emacs_mule.c (mbc_to_code): ditto. * enc/gbk.c (gbk_mbc_to_code): follow mbc_to_code field and onigenc_mbn_mbc_to_code change. * enc/cp949.c (cp949_mbc_to_code): ditto. * enc/big5.c (big5_mbc_to_code): ditto. * enc/euc_tw.c (euctw_mbc_to_code): ditto. * enc/euc_kr.c (euckr_mbc_to_code): ditto. * enc/gb18030.c (gb18030_mbc_to_code): ditto. * enc/utf_32be.c (utf32be_mbc_to_code): follow mbc_to_code field change. * enc/utf_16be.c (utf16be_mbc_to_code): ditto. * enc/utf_32le.c (utf32le_mbc_to_code): ditto. * enc/utf_16le.c (utf16le_mbc_to_code): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19389 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-15* encoding.c (rb_enc_compatible): accepst other than strings andnaruse
regexps. [ruby-core:18595] * encoding.c (rb_enc_get_index): works files and encodings. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19357 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-08-29* encoding.c (enc_compatible_p): add SPECIAL_CONST_P check.naruse
* test/ruby/test_m17n.rb (test_compatible): fix test. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18933 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-08-13* test/ruby/test_m17n.rb: follow EncodingCompatibilityError.naruse
* test/ruby/test_mixed_unicode_escapes.rb: ditto. * test/ruby/enc/test_utf16.rb: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18567 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-08-01* parse.y (parser_yylex): removed an useless conditional, and magicyugui
comment are ignored unless at the first of line. * test/ruby/test_m17n.rb (test_magic_comment_vim): added. * test/ruby/test_m17n.rb (test_magic_comment_at_variaous_positions): added. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18304 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-04* re.c (unescape_nonascii): add has_property argument not toakr
raise error by /\p{Hiragana}\u{3042}/ in EUC-JP script. (rb_reg_preprocess): use has_property argument to make regexp encoding fixed. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17884 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-04* re.c (unescape_nonascii): make regexp fixed_encoding if \p is used.akr
fixed [ruby-core:17279]. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17882 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-19* bootstraptest/test_knownbug.rb: move solved tests.ko1
* bootstraptest/test_eval.rb, test_literal.rb, test_syntax.rb, test_thread.rb: ditto. * test/ruby/test_m17n.rb, test_proc.rb, test_sprintf.rb, test_string.rb, test/ruby/test_struct.rb: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16472 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-15* test/ruby/test_string.rb: add tests to achieve over 90% testmame
coverage of string.c. * test/ruby/test_m17n.rb: ditto. * test/ruby/test_symbol.rb: ditto. * test/ruby/test_pack.rb: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16427 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-15* string.c (tr_find): String#delete returned wrong result when multiplemame
utf-8 arguments are passed. * test/ruby/test_m17n.rb (test_delete): add a test for above. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16426 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-28* proc.c (method_name): should return symbols instead of strings.matz
[ruby-dev:34531] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16223 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-03-08* string.c (search_nonascii): Use VALUE instead of unsigned longnaruse
because VALUE can be the fastest unsigned integer type. On LLP64 unsigned long isn't the fastest. * string.c (str_strlen): ditto. * string.c (str_utf8_nth): ditto. * string.c (count_utf8_lead_bytes_with_ulong): ditto. * string.c (count_utf8_lead_bytes_with_word): renamed. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15731 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-03-05* string.c (count_utf8_lead_bytes_with_ulong): fix shift size.naruse
[ruby-dev:33993] * string.c (str_utf8_nth) fix wrong counting. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15700 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-28* encoding.c (enc_find): check type of argument and convert to Stringnaruse
if it is StringValue. [ruby-cvs:22866] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15631 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-22commit miss. orzusa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15570 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-22sorry, typo.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15569 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-22* test/ruby/test_m17n.rb: add tests.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15568 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-18* string.c (rb_str_each_line): fix newline size.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15539 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-17add tests.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15522 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-17add a test for [ruby-dev:33826]akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15521 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-17* re.c (rb_reg_quote): return US-ASCII string consistently.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15515 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-14add a test for named class in regexp.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15467 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-14more tests for embedding regexps.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15466 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-14* re.c (rb_reg_preprocess_dregexp): use non-preprocessed regexp sourceakr
for result. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15465 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-08add a test.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15403 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-08add a test.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15401 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-29add tests.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15324 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-29* insns.def (toregexp): generate a regexp from strings instead of oneakr
string. * re.c (rb_reg_new_ary): defined for toregexp. it concatenates strings after each string is preprocessed. * compile.c (compile_dstr_fragments): split from compile_dstr. (compile_dstr): call compile_dstr_fragments. (compile_dregx): defined for dynamic regexp. (iseq_compile_each): use compile_dregx for dynamic regexp. [ruby-dev:33400] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15311 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-28 * parse.y (reg_fragment_setenc_gen): US-ASCII script special code.usa
* parse.y (reg_fragment_check_len, reg_compile_gen): no need such trick. [ruby-dev:33399] * test/ruby/test_m17n.rb (test_regexp_usacii_literal): add tests. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15304 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-28* test/ruby/test_m17n.rb: refine some tests, and add op symbol test.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15299 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-28* test/ruby/test_m17n.rb (test_str_String): update test.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15293 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-28 * parse.y (parser_str_new): encoding of UTF-8 literal string inusa
US-ASCII script is UTF-8. [ruby-dev:33406] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15285 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-28 * test/ruby/test_m17n.rb (test_magic_comment): add test.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15284 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-26add tests.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15263 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-26add a test for [ruby-dev:33377].akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15255 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-26add a test for [ruby-dev:33406].akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15254 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-25* string.c (rb_str_usascii_new{,2}: defined.naruse
(rb_str_new): set US-ASCII and ENC_CODERANGE_7BIT when empty string. * encoding.c (rb_usascii_encoding, rb_usascii_encindex): defined. (rb_enc_inspect, enc_name, rb_locale_charmap, rb_enc_name_list_i): use rb_str_ascii_new. * array.c (recursive_join, inspect_ary): ditto. * object.c (nil_to_s, nil_inspect, true_to_s, false_to_s, rb_mod_to_s): ditto. * hash.c (inspect_hash, rb_hash_inspect, rb_f_getenv, env_fetch, env_clear, env_to_s, env_inspect): ditto. * numeric.c (flo_to_s, int_chr, rb_fix2str): ditto. * bignum.c (rb_big2str): ditto. * file.c (rb_file_ftype, rb_file_s_dirname, rb_file_s_extname, file_inspect_join, Init_file): ditto. * test/ruby/test_ruby_m17n.rb: add checks for encoding of string. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15244 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-24* test/ruby/test_m17n.rb: commit miss.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15219 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-24 * test/ruby/test_m17n.rb: follow to the following changes.usa
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15218 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-23split UTF-16 tests.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15183 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-23add a test.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15182 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-23add a test.akr
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15179 b2dd03c8-39d4-4d8f-98ff-823fe69b080e