summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-08-09Rename rb_iterate to get rid of name clash on Sun CNobuyoshi Nakada
2021-08-09Extended logging for debugging readline failures.Samuel Williams
Notes: Merged: https://github.com/ruby/ruby/pull/4722
2021-08-09Suppress a clobbered warningNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Deprecate rb_iterate in C++Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress deprecated rb_iterate declaration warnings in C++Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress warnings in C++2aNobuyoshi Nakada
* bitwise operation between different enumeration types ('ruby_value_type' and 'ruby_fl_type') is deprecated [-Wdeprecated-enum-enum-conversion] * volatile-qualified parameter type 'volatile int' is deprecated [-Wdeprecated-volatile] Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress unused-function warning when OPT_THREADED_CODE != 1Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09Suppress unused-variable warnings when DEBUG_INTEGER_PACKNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4720
2021-08-09* 2021-08-09 [ci skip]git
2021-08-09Rework the readline test to be more robust.Samuel Williams
- Capture that the child is started by initial log line. - More robust handling of child status reaping. - Direct exit without sucess mesage if `#readline` receives input. Notes: Merged: https://github.com/ruby/ruby/pull/4721
2021-08-08Reduce chance to receive EBADF when closing an IO from another thread.Samuel Williams
Notes: Merged: https://github.com/ruby/ruby/pull/4717
2021-08-08Make bit flags `reason` unsignedNobuyoshi Nakada
2021-08-08Use #full_message instead of #backtrace_locationsaycabta
2021-08-08Suppress warnings when GC_ENABLE_INCREMENTAL_MARK == 0Nobuyoshi Nakada
2021-08-08* 2021-08-08 [ci skip]git
2021-08-08Show backtrace locations when I/O timed outaycabta
2021-08-07Use TERM=xterm for tests on Solarisaycabta
2021-08-07Set TERM env for some CI environmentsaycabta
2021-08-07Group commands on GitHub ActionsNobuyoshi Nakada
2021-08-07Remove unneeded rb_fiber_transfer_kw declarationS-H-GAMELINKS
Notes: Merged: https://github.com/ruby/ruby/pull/4713
2021-08-07Suppress unused-result warningsS.H
* Hide read function warning in string_spec_RSTRING_PTR_read function * The type of `read` may be `ssize_t` Co-authored-by: Nobuyoshi Nakada <nobu@ruby-lang.org> Notes: Merged: https://github.com/ruby/ruby/pull/4703 Merged-By: nobu <nobu@ruby-lang.org>
2021-08-07Stop force-recycling evacuated array [Bug #18065]Nobuyoshi Nakada
2021-08-06Use Rational for Float#round with ndigits > 14Jeremy Evans
ndigits higher than 14 can result in values that are slightly too large due to floating point limitations. Converting to rational for the calculation and then back to float fixes these issues. Fixes [Bug #14635] Fixes [Bug #17183] Co-authored by: Yusuke Endoh <mame@ruby-lang.org> Notes: Merged: https://github.com/ruby/ruby/pull/4682
2021-08-07* 2021-08-07 [ci skip]git
2021-08-06Make backtrace generation work outward from current frameJeremy Evans
This fixes multiple bugs found in the partial backtrace optimization added in 3b24b7914c16930bfadc89d6aff6326a51c54295. These bugs occurs when passing a start argument to caller where the start argument lands on a iseq frame without a pc. Before this commit, the following code results in the same line being printed twice, both for the #each method. ```ruby def a; [1].group_by { b } end def b; puts(caller(2, 1).first, caller(3, 1).first) end a ``` After this commit and in Ruby 2.7, the lines are different, with the first line being for each and the second for group_by. Before this commit, the following code can either segfault or result in an infinite loop: ```ruby def foo caller_locations(2, 1).inspect # segfault caller_locations(2, 1)[0].path # infinite loop end 1.times.map { 1.times.map { foo } } ``` After this commit, this code works correctly. This commit completely refactors the backtrace handling. Instead of processing the backtrace from the outermost frame working in, process it from the innermost frame working out. This is much faster for partial backtraces, since you only access the control frames you need to in order to construct the backtrace. To handle cfunc frames in the new design, they start out with no location information. We increment a counter for each cfunc frame added. When an iseq frame with pc is accessed, after adding the iseq backtrace location, we use the location for the iseq backtrace location for all of the directly preceding cfunc backtrace locations. If the last backtrace line is a cfunc frame, we continue scanning for iseq frames until the end control frame, and use the location information from the first one for the trailing cfunc frames in the backtrace. As only rb_ec_partial_backtrace_object uses the new backtrace implementation, remove all of the function pointers and inline the functions. This makes the process easier to understand. Restore the Ruby 2.7 implementation of backtrace_each and use it for all the other functions that called backtrace_each other than rb_ec_partial_backtrace_object. All other cases requested the entire backtrace, so there is no advantage of using the new algorithm for those. Additionally, there are implicit assumptions in the other code that the backtrace processing works inward instead of outward. Remove the cfunc/iseq union in rb_backtrace_location_t, and remove the prev_loc member for cfunc. Both cfunc and iseq types can now have iseq and pc entries, so the location information can be accessed the same way for each. This avoids the need for a extra backtrace location entry to store an iseq backtrace location if the final entry in the backtrace is a cfunc. This is also what fixes the segfault and infinite loop issues in the above bugs. Here's Ruby pseudocode for the new algorithm, where start and length are the arguments to caller or caller_locations: ```ruby end_cf = VM.end_control_frame.next cf = VM.start_control_frame size = VM.num_control_frames - 2 bt = [] cfunc_counter = 0 if length.nil? || length > size length = size end while cf != end_cf && bt.size != length if cf.iseq? if cf.instruction_pointer? if start > 0 start -= 1 else bt << cf.iseq_backtrace_entry cf_counter.times do |i| bt[-1 - i].loc = cf.loc end cfunc_counter = 0 end end elsif cf.cfunc? if start > 0 start -= 1 else bt << cf.cfunc_backtrace_entry cfunc_counter += 1 end end cf = cf.prev end if cfunc_counter > 0 while cf != end_cf if (cf.iseq? && cf.instruction_pointer?) cf_counter.times do |i| bt[-i].loc = cf.loc end end cf = cf.prev end end ``` With the following benchmark, which uses a call depth of around 100 (common in many Ruby applications): ```ruby class T def test(depth, &block) if depth == 0 yield self else test(depth - 1, &block) end end def array Array.new end def first caller_locations(1, 1) end def full caller_locations end end t = T.new t.test((ARGV.first || 100).to_i) do Benchmark.ips do |x| x.report ('caller_loc(1, 1)') {t.first} x.report ('caller_loc') {t.full} x.report ('Array.new') {t.array} x.compare! end end ``` Results before commit: ``` Calculating ------------------------------------- caller_loc(1, 1) 281.159k (_ 0.7%) i/s - 1.426M in 5.073055s caller_loc 15.836k (_ 2.1%) i/s - 79.450k in 5.019426s Array.new 1.852M (_ 2.5%) i/s - 9.296M in 5.022511s Comparison: Array.new: 1852297.5 i/s caller_loc(1, 1): 281159.1 i/s - 6.59x (_ 0.00) slower caller_loc: 15835.9 i/s - 116.97x (_ 0.00) slower ``` Results after commit: ``` Calculating ------------------------------------- caller_loc(1, 1) 562.286k (_ 0.8%) i/s - 2.858M in 5.083249s caller_loc 16.402k (_ 1.0%) i/s - 83.200k in 5.072963s Array.new 1.853M (_ 0.1%) i/s - 9.278M in 5.007523s Comparison: Array.new: 1852776.5 i/s caller_loc(1, 1): 562285.6 i/s - 3.30x (_ 0.00) slower caller_loc: 16402.3 i/s - 112.96x (_ 0.00) slower ``` This shows that the speed of caller_locations(1, 1) has roughly doubled, and the speed of caller_locations with no arguments has improved slightly. So this new algorithm is significant faster, much simpler, and fixes bugs in the previous algorithm. Fixes [Bug #18053] Notes: Merged: https://github.com/ruby/ruby/pull/4671
2021-08-06Make jobserver availableNobuyoshi Nakada
2021-08-06Check the result of tigetstrNobuyoshi Nakada
2021-08-06Fix caching of curses_dlNobuyoshi Nakada
2021-08-06test/reline/test_terminfo.rb: skip when setupterm failsYusuke Endoh
http://rubyci.s3.amazonaws.com/solaris11-gcc/ruby-master/log/20210806T000008Z.fail.html.gz ``` 1) Error: Reline::Terminfo::Test#test_tigetstr: Reline::Terminfo::TerminfoError: The terminfo database could not be found. /export/home/chkbuild/chkbuild-gcc/tmp/build/20210806T000008Z/ruby/lib/reline/terminfo.rb:84:in `setupterm' /export/home/chkbuild/chkbuild-gcc/tmp/build/20210806T000008Z/ruby/test/reline/test_terminfo.rb:6:in `setup' ```
2021-08-06Show Readline::VERSION for debuggingaycabta
2021-08-06* 2021-08-06 [ci skip]git
2021-08-06Omit test_interrupt_in_other_thread with Editlineaycabta
2021-08-06Fix reversal of assertion resultaycabta
2021-08-06Fix control structure to preperly catch Timeout::Erroraycabta
2021-08-06Fix the result of checking the existence of constants being reversedaycabta
2021-08-05Build rubyspec CAPI extensionsNobuyoshi Nakada
2021-08-05Show log when timed outaycabta
2021-08-04Remove an unused variableaycabta
2021-08-05Fix a link [ci skip]Kazuhiro NISHIYAMA
2021-08-05Show WorkingSetSize as RSS on WindowsNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/4709
2021-08-05check GC.enable'd statusKoichi Sasada
Check GC.enable'd status before and after test execution. Write this checker in gc_checker.rb, it was renamed from gc_compact_checker.rb. Notes: Merged: https://github.com/ruby/ruby/pull/4710
2021-08-05Revert "Removed extinit.o from main programs"Yusuke Endoh
This reverts commit ac86fcbfd0bab8667d277aa575bc5b81e5135d3c. This change broke "--disable-shared --with-static-linked-ext".
2021-08-05Use equivalent `__FILE__`Nobuyoshi Nakada
2021-08-05Tests for Windows can run only on WindowsNobuyoshi Nakada
Should not directly require "reline/windows.rb" which should be loaded by "reline.rb".
2021-08-05* 2021-08-05 [ci skip]git
2021-08-04Reenable GC at the end of testPeter Zhu
The test disables GC but never reenables it. Before this patch, running all tests would have a peak RSS in the main process of >4GB. After this patch, peak RSS in the main process is <500MB. Notes: Merged: https://github.com/ruby/ruby/pull/4707
2021-08-04Fix relative paths from core_assertions.rbNobuyoshi Nakada
2021-08-04Run interrupt test except on Windowsaycabta
Notes: Merged: https://github.com/ruby/ruby/pull/4704
2021-08-04Add a load path to require 'helper'aycabta
Notes: Merged: https://github.com/ruby/ruby/pull/4704
2021-08-04Show the log of test_interrupt_in_other_thread when failedaycabta
Notes: Merged: https://github.com/ruby/ruby/pull/4704