ruby.git/test/ruby/test_transcode.rb, branch v3_4_9

[Bug #18651] Pass undefined region in CP51932 as is to CP50220

2024-09-20T07:23:55+00:00

IBM864 single-byte transcoding (#10518)

2024-07-11T08:03:14+00:00

Include € euro sign from CCSID 864

Ensure test suite is compatible with --frozen-string-literal

2024-03-14T16:56:15+00:00

As preparation for https://bugs.ruby-lang.org/issues/20205
making sure the test suite is compatible with frozen string
literals is making things easier.

Extract transcoding assertions

2023-10-28T13:18:17+00:00

- Prefix `check_both_ways` with `assert_` to show proper failure
  lines.

- Extract dedicated assertions for Encoding::UndefinedConversionError
  and Encoding::InvalidByteSequenceError.

Remove get_actual_encoding() and the dynamic endian detection for dummy UTF-16/UTF-32

2022-09-12T12:02:34+00:00

* And simplify callers of get_actual_encoding().
* See [Feature #18949].
* See https://github.com/ruby/ruby/pull/6322#issuecomment-1242758474

Support Encoding::Converter newline: :lf and :lf_newline options

2022-08-20T03:23:36+00:00

Previously, newline: :lf was accepted but ignored.  Where it
should have been used was commented out code that didn't work,
but unlike all other invalid values, using newline: :lf did
not raise an error.

This adds support for newline: :lf and :lf_newline, for consistency
with newline: :cr and :cr_newline.  This is basically the same as
universal_newline, except that it only affects writing and not
reading due to RUBY_ECONV_NEWLINE_DECORATOR_WRITE_MASK.

Add tests for the File.open :newline option while here.

Fixes [Bug #12436]

- add regression tests for U+6E7F (湿) in ISO-2022-JP

2021-07-01T08:33:43+00:00

  In ISO-2022-JP, the bytes use to code are the same as those for "<>".
  This adds regression tests to make sure that these bytes, when representing
  湿, are NOT　escaped with encode("ISO-2022-JP, xml: :text) or similar.
  These are additional regression tests for #12052.

Work around issue transcoding issue with non-ASCII compatible encodings and xml escaping

2021-06-26T19:32:39+00:00

When using a non-ASCII compatible source and destination encoding
and xml escaping (the :xml option to String#encode), the resulting
string was broken, as it used the correct non-ASCII compatible
encoding, but contained data that was ASCII-compatible instead of
compatible with the string's encoding.

Work around this issue by detecting the case where both the
source and destination encoding are non-ASCII compatible, and
transcoding the source string from the non-ASCII compatible
encoding to UTF-8. The xml escaping code will correctly handle
the UTF-8 source string and the return the correctly encoded
and escaped value.

Fixes [Bug #12052]

Co-authored-by: Nobuyoshi Nakada

Add string encoding IBM720 alias CP720 (#3803)

2020-11-22T13:23:40+00:00

The mapping table is generated from the ICU project:
  https://github.com/unicode-org/icu/blob/master/icu4c/source/data/mappings/ibm-720_P100-1997.ucm

Fixes bug 16233 : https://bugs.ruby-lang.org/issues/16233

Fixed symbol misused as ID

2020-02-24T06:37:52+00:00

`rb_funcallv_public` and `rb_respond_to` require an `ID`, not a
`Symbol`.  [Bug #16649]