summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-08-11Get rid of type-punning pointer casts [Bug #18062]Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4716
2021-08-11* 2021-08-11 [ci skip]git
2021-08-10Assert for duplicated ARGF [Bug #18074]Nobuyoshi Nakada
2021-08-10Assert that each contents are read [Bug #18074]Nobuyoshi Nakada
2021-08-10Remove root_jmpbuf in rb_thread_structNobuyoshi Nakada
It has not been used since 1b82c877dfa72e8505ded149fd0e3ba956529d3f. Notes: Merged: https://github.com/ruby/ruby/pull/4725
2021-08-10add some lines to delete unused TracePointKoichi Sasada
`TracePoint.stat` returns the "to be deleted" TP numbers, and http://rubyci.s3.amazonaws.com/graviton2/ruby-master/log/20210810T030003Z.fail.html.gz shows there is a "to be deleted" TP. This patch uses only :line event and add some lines to allow MRI deletes "to be deleted" TPs.
2021-08-10Run only directories or *_spec.rb files only by mspec [Bug #18072]Nobuyoshi Nakada
Not to match *.c files under spec/ruby/optional/capi/ext, in the case of in-place build.
2021-08-10Fix ARGF.read(length) short read [Bug #18074]Csaba Henk
Notes: Merged: https://github.com/ruby/ruby/pull/4727
2021-08-10.github/workflows/compilers.yml: clang-14卜部昌平
It seems LLVM-14 begun. See also https://github.com/llvm/llvm-project/commit/08c766a7318ab37bf1d77e0c683cd3b00e700877 Notes: Merged: https://github.com/ruby/ruby/pull/4718
2021-08-09.travis.yml: Check failures for Travis arm64 again.Jun Aruga
It seems the concurrent jobs are stable recently on arm64 pipeline. Keep allowing to fail on arm32 due to a failure. Notes: Merged: https://github.com/ruby/ruby/pull/4726
2021-08-10Add comment about I/O that is not ttyaycabta
2021-08-10* 2021-08-10 [ci skip]git
2021-08-10Update parser files of RDoc generated by the latest Raccaycabta
2021-08-10Update parser files of RDoc generated by the latest KPegaycabta
2021-08-10[ruby/rdoc] Use HEAD of kpegaycabta
I compared the results between the latest release of kpeg gem (1.1.0) and HEAD of kpeg gem with `time` command, and the execution time is reduced from 38.35s sec to 35.06 sec. ref. https://github.com/evanphx/kpeg/pull/43 https://github.com/ruby/rdoc/commit/682bcb48ce
2021-08-10[ruby/rdoc] Add "rake clean" task to erase generated parser filesaycabta
https://github.com/ruby/rdoc/commit/4e3e635afa
2021-08-10Import copied Rakefile from original RDoc repositoryaycabta
2021-08-10[ruby/rdoc] Move dev dependency of gettext to Gemfileaycabta
https://github.com/ruby/rdoc/commit/a177377b6f
2021-08-10[ruby/rdoc] Use single quote in Gemfileaycabta
https://github.com/ruby/rdoc/commit/e4b68d414c
2021-08-10Import copied Gemfile from original RDoc repositoryaycabta
2021-08-10Import Gemfile and Rakefile of rdoc by tool/sync_default_gems.rbaycabta
2021-08-09VC warns the same attribute used more than onceNobuyoshi Nakada
2021-08-09Include ruby.h before internal headers to suppress -Wundef warningsNobuyoshi Nakada
2021-08-09Omit on Readline 7.0 because it's wrong behaviour for not TTY envaycabta
2021-08-09Rename rb_iterate to get rid of name clash on Sun CNobuyoshi Nakada
2021-08-09Extended logging for debugging readline failures.Samuel Williams
Notes: Merged: https://github.com/ruby/ruby/pull/4722
2021-08-09Suppress a clobbered warningNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Deprecate rb_iterate in C++Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress deprecated rb_iterate declaration warnings in C++Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress warnings in C++2aNobuyoshi Nakada
* bitwise operation between different enumeration types ('ruby_value_type' and 'ruby_fl_type') is deprecated [-Wdeprecated-enum-enum-conversion] * volatile-qualified parameter type 'volatile int' is deprecated [-Wdeprecated-volatile] Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress unused-function warning when OPT_THREADED_CODE != 1Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress unused-variable warnings when DEBUG_INTEGER_PACKNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09* 2021-08-09 [ci skip]git
2021-08-09Rework the readline test to be more robust.Samuel Williams
- Capture that the child is started by initial log line. - More robust handling of child status reaping. - Direct exit without sucess mesage if `#readline` receives input. Notes: Merged: https://github.com/ruby/ruby/pull/4721
2021-08-08Reduce chance to receive EBADF when closing an IO from another thread.Samuel Williams
Notes: Merged: https://github.com/ruby/ruby/pull/4717
2021-08-08Make bit flags `reason` unsignedNobuyoshi Nakada
2021-08-08Use #full_message instead of #backtrace_locationsaycabta
2021-08-08Suppress warnings when GC_ENABLE_INCREMENTAL_MARK == 0Nobuyoshi Nakada
2021-08-08* 2021-08-08 [ci skip]git
2021-08-08Show backtrace locations when I/O timed outaycabta
2021-08-07Use TERM=xterm for tests on Solarisaycabta
2021-08-07Set TERM env for some CI environmentsaycabta
2021-08-07Group commands on GitHub ActionsNobuyoshi Nakada
2021-08-07Remove unneeded rb_fiber_transfer_kw declarationS-H-GAMELINKS
Notes: Merged: https://github.com/ruby/ruby/pull/4713
2021-08-07Suppress unused-result warningsS.H
* Hide read function warning in string_spec_RSTRING_PTR_read function * The type of `read` may be `ssize_t` Co-authored-by: Nobuyoshi Nakada <nobu@ruby-lang.org> Notes: Merged: https://github.com/ruby/ruby/pull/4703 Merged-By: nobu <nobu@ruby-lang.org>
2021-08-07Stop force-recycling evacuated array [Bug #18065]Nobuyoshi Nakada
2021-08-06Use Rational for Float#round with ndigits > 14Jeremy Evans
ndigits higher than 14 can result in values that are slightly too large due to floating point limitations. Converting to rational for the calculation and then back to float fixes these issues. Fixes [Bug #14635] Fixes [Bug #17183] Co-authored by: Yusuke Endoh <mame@ruby-lang.org> Notes: Merged: https://github.com/ruby/ruby/pull/4682
2021-08-07* 2021-08-07 [ci skip]git
2021-08-06Make backtrace generation work outward from current frameJeremy Evans
This fixes multiple bugs found in the partial backtrace optimization added in 3b24b7914c16930bfadc89d6aff6326a51c54295. These bugs occurs when passing a start argument to caller where the start argument lands on a iseq frame without a pc. Before this commit, the following code results in the same line being printed twice, both for the #each method. ```ruby def a; [1].group_by { b } end def b; puts(caller(2, 1).first, caller(3, 1).first) end a ``` After this commit and in Ruby 2.7, the lines are different, with the first line being for each and the second for group_by. Before this commit, the following code can either segfault or result in an infinite loop: ```ruby def foo caller_locations(2, 1).inspect # segfault caller_locations(2, 1)[0].path # infinite loop end 1.times.map { 1.times.map { foo } } ``` After this commit, this code works correctly. This commit completely refactors the backtrace handling. Instead of processing the backtrace from the outermost frame working in, process it from the innermost frame working out. This is much faster for partial backtraces, since you only access the control frames you need to in order to construct the backtrace. To handle cfunc frames in the new design, they start out with no location information. We increment a counter for each cfunc frame added. When an iseq frame with pc is accessed, after adding the iseq backtrace location, we use the location for the iseq backtrace location for all of the directly preceding cfunc backtrace locations. If the last backtrace line is a cfunc frame, we continue scanning for iseq frames until the end control frame, and use the location information from the first one for the trailing cfunc frames in the backtrace. As only rb_ec_partial_backtrace_object uses the new backtrace implementation, remove all of the function pointers and inline the functions. This makes the process easier to understand. Restore the Ruby 2.7 implementation of backtrace_each and use it for all the other functions that called backtrace_each other than rb_ec_partial_backtrace_object. All other cases requested the entire backtrace, so there is no advantage of using the new algorithm for those. Additionally, there are implicit assumptions in the other code that the backtrace processing works inward instead of outward. Remove the cfunc/iseq union in rb_backtrace_location_t, and remove the prev_loc member for cfunc. Both cfunc and iseq types can now have iseq and pc entries, so the location information can be accessed the same way for each. This avoids the need for a extra backtrace location entry to store an iseq backtrace location if the final entry in the backtrace is a cfunc. This is also what fixes the segfault and infinite loop issues in the above bugs. Here's Ruby pseudocode for the new algorithm, where start and length are the arguments to caller or caller_locations: ```ruby end_cf = VM.end_control_frame.next cf = VM.start_control_frame size = VM.num_control_frames - 2 bt = [] cfunc_counter = 0 if length.nil? || length > size length = size end while cf != end_cf && bt.size != length if cf.iseq? if cf.instruction_pointer? if start > 0 start -= 1 else bt << cf.iseq_backtrace_entry cf_counter.times do |i| bt[-1 - i].loc = cf.loc end cfunc_counter = 0 end end elsif cf.cfunc? if start > 0 start -= 1 else bt << cf.cfunc_backtrace_entry cfunc_counter += 1 end end cf = cf.prev end if cfunc_counter > 0 while cf != end_cf if (cf.iseq? && cf.instruction_pointer?) cf_counter.times do |i| bt[-i].loc = cf.loc end end cf = cf.prev end end ``` With the following benchmark, which uses a call depth of around 100 (common in many Ruby applications): ```ruby class T def test(depth, &block) if depth == 0 yield self else test(depth - 1, &block) end end def array Array.new end def first caller_locations(1, 1) end def full caller_locations end end t = T.new t.test((ARGV.first || 100).to_i) do Benchmark.ips do |x| x.report ('caller_loc(1, 1)') {t.first} x.report ('caller_loc') {t.full} x.report ('Array.new') {t.array} x.compare! end end ``` Results before commit: ``` Calculating ------------------------------------- caller_loc(1, 1) 281.159k (_ 0.7%) i/s - 1.426M in 5.073055s caller_loc 15.836k (_ 2.1%) i/s - 79.450k in 5.019426s Array.new 1.852M (_ 2.5%) i/s - 9.296M in 5.022511s Comparison: Array.new: 1852297.5 i/s caller_loc(1, 1): 281159.1 i/s - 6.59x (_ 0.00) slower caller_loc: 15835.9 i/s - 116.97x (_ 0.00) slower ``` Results after commit: ``` Calculating ------------------------------------- caller_loc(1, 1) 562.286k (_ 0.8%) i/s - 2.858M in 5.083249s caller_loc 16.402k (_ 1.0%) i/s - 83.200k in 5.072963s Array.new 1.853M (_ 0.1%) i/s - 9.278M in 5.007523s Comparison: Array.new: 1852776.5 i/s caller_loc(1, 1): 562285.6 i/s - 3.30x (_ 0.00) slower caller_loc: 16402.3 i/s - 112.96x (_ 0.00) slower ``` This shows that the speed of caller_locations(1, 1) has roughly doubled, and the speed of caller_locations with no arguments has improved slightly. So this new algorithm is significant faster, much simpler, and fixes bugs in the previous algorithm. Fixes [Bug #18053] Notes: Merged: https://github.com/ruby/ruby/pull/4671
2021-08-06Make jobserver availableNobuyoshi Nakada