summaryrefslogtreecommitdiff
path: root/prism/encoding.c
AgeCommit message (Collapse)Author
2025-12-05[ruby/prism] Avoid out-of-bounds readsSteven Johnstone
Fixes https://github.com/ruby/prism/pull/3784. https://github.com/ruby/prism/commit/3fe862534b
2025-11-30[ruby/prism] Update unicode tables to match that of CRubyKevin Newton
The unicode version has been updated upstream, which means new codepoints mapped to alpha/alnum/isupper flags. We need to update our tables to match. I'm purposefully not adding a version check here, since that is such a large amount of code. It's possible that we could include different tables depending on a macro (like UNICODE_VERSION) or something to that effect, but it's such a minimal impact on the running of the actual parser that I don't think it's necessary. https://github.com/ruby/prism/commit/78925fe5b6
2024-03-20[ruby/prism] Provide options for reducing sizeKevin Newton
https://github.com/ruby/prism/commit/592128de4d
2024-02-26[ruby/prism] Triple-check prism encodingsKevin Newton
https://github.com/ruby/prism/commit/ab7f261354
2024-02-14[ruby/prism] Validate multibyte characters in stringsKevin Newton
Check that multibyte characters are valid using pm_strpbrk. We need to add a couple of codepaths to ensure all encodings are covered. Importantly this doesn't check regular expressions, because apparently you're allowed to have invalid multibyte characters inside regular expression comment groups/extended mode. https://github.com/ruby/prism/commit/2857d3e1b5
2024-02-13[ruby/prism] Fix KOI-8 char width checkKevin Newton
https://github.com/ruby/prism/commit/06d3747c5b
2024-02-01[ruby/prism] Amend assert in pm_utf_8_codepoint(), n=0 is fineAlan Wu
This assert used to trip in the included test: ``` ./miniruby --parser=prism -e ' "%W"\u" ' ``` https://github.com/ruby/prism/commit/8c0f84db4f
2024-01-31[ruby/prism] Always return the character width for ↵Benoit Daloze
char_is_identifier_start() and char_is_identifier_utf8() * This is also faster than calling pm_encoding_utf_8_alpha_char/pm_encoding_utf_8_alnum_char as those compute the character width and do extra checks. https://github.com/ruby/prism/commit/4cb276ac4c
2024-01-11[ruby/prism] Exclude encodings that are dynamicKevin Newton
https://github.com/ruby/prism/commit/6749146c0e
2023-12-06[ruby/prism] Update documentation for encodingsKevin Newton
https://github.com/ruby/prism/commit/18e6df0d4f
2023-12-06[ruby/prism] Provide flags for changing encodingsKevin Newton
https://github.com/ruby/prism/commit/e838eaff6f
2023-11-30[ruby/prism] Document remaining encodingsKevin Newton
https://github.com/ruby/prism/commit/b9510aed40
2023-11-30[ruby/prism] Group encodings into a single arrayKevin Newton
https://github.com/ruby/prism/commit/f4b7beadc9
2023-11-30[ruby/prism] Do not expose encodings that do not need to be exposedKevin Newton
https://github.com/ruby/prism/commit/c52c7f37ea
2023-11-30[ruby/prism] Remove public ASCII functions that can now be staticKevin Newton
https://github.com/ruby/prism/commit/9461384b0c
2023-11-30[PRISM] Consolidate prism encoding filesKevin Newton
generated by cgit v1.2.3 (git 2.25.1) at 2026-05-13 08:49:56 +0000