summaryrefslogtreecommitdiff
path: root/tool
AgeCommit message (Collapse)Author
2024-09-02Experiment with removing --profile ruby for nowTakashi Kokubun
2024-09-02Try to fix AWS_CLI_OPTS with AWS_ACCESS_KEY_IDTakashi Kokubun
2024-09-02Drop `--profile ruby` on the release workflowTakashi Kokubun
2024-09-03Fix `gem exec rails new foo` failing on Ruby 3.2David Rodríguez
The default version of securerandom (0.2.2) gets activated by RubyGems, but does not match Rails requirements (>= 0.3), leading to an error like this: ``` $ gem exec rails new repro /Users/deivid/Code/rubygems/rubygems/lib/rubygems/specification.rb:2246:in `raise_if_conflicts': Unable to activate activesupport-7.2.1, because securerandom-0.2.2 conflicts with securerandom (>= 0.3) (Gem::ConflictError) from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/specification.rb:1383:in `activate' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/specification.rb:1421:in `block in activate_dependencies' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/specification.rb:1403:in `each' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/specification.rb:1403:in `activate_dependencies' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/specification.rb:1385:in `activate' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/core_ext/kernel_gem.rb:62:in `block in gem' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/core_ext/kernel_gem.rb:62:in `synchronize' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/core_ext/kernel_gem.rb:62:in `gem' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/commands/exec_command.rb:193:in `activate!' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/commands/exec_command.rb:73:in `execute' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/command.rb:326:in `invoke_with_build_args' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/command_manager.rb:255:in `invoke_command' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/command_manager.rb:194:in `process_args' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/command_manager.rb:152:in `run' from /Users/deivid/Code/rubygems/rubygems/lib/rubygems/gem_runner.rb:56:in `run' from /Users/deivid/code/rubygems/rubygems/exe/gem:12:in `<main>' ``` Vendoring our own securerandom fixes the issue since that way we avoid activating the gem internally.
2024-09-03Fix runnable symlinksNobuyoshi Nakada
Fix symlinks to executable as relative paths from `bin` directory. Notes: Merged: https://github.com/ruby/ruby/pull/11532
2024-09-02redmine-backporter: Support matching multiple revsTakashi Kokubun
with `done` command
2024-09-02redmine-backporter: Clarify the actual control flowTakashi Kokubun
The `rev && has_commit(rev, "ruby_#{TARGET_VERSION.tr('.','_')}")` case seems to be used if and only if it's manually specified in the argument to the done command. It was hard to notice it with the previous code.
2024-08-31* remove trailing spaces. [ci skip]git
2024-08-31Added check method with released version of rubygems.orgHiroshi SHIBATA
2024-08-23`load_relative` is always falsy hereDavid Rodríguez
Notes: Merged: https://github.com/ruby/ruby/pull/11435
2024-08-23Reuse `load_relative` localDavid Rodríguez
Notes: Merged: https://github.com/ruby/ruby/pull/11435
2024-08-22`make test-tool` with Windows is broken. We should use :KILL with that platform.Hiroshi SHIBATA
``` [ 14/191] TestParallel::TestParallel#test_hungup = 11.02 s 1) Failure: TestParallel::TestParallel#test_hungup [C:/Users/hsbt/DevDrive/github.com/ruby/ruby/tool/test/testunit/test_parallel.rb:211]: Expected /^Retrying hung up testcases\.+$/ to match "Run options: \n" + " --seed=35582\n" + " --ruby\n" + " \".\\\\ruby.exe -I../../ruby/lib -I.ext/x64-mswin64_140 -I. ../../ruby/tool/runruby.rb --extout=.ext -- --disable-gems\"\n" + " -j\n" + " t1\n" + " --worker-timeout=1\n" + "\n" + "# Running tests:\n" + "\n" + "[1/1] 50340=test4test_hungup.\n" + "C:/Users/hsbt/DevDrive/github.com/ruby/ruby/tool/lib/test/unit.rb:418:in 'Process.kill': Invalid argument (Errno::EINVAL)\n" + ``` Notes: Merged: https://github.com/ruby/ruby/pull/11430
2024-08-21[Bug #20687] Check if base ruby provides necessary librariesNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/11419
2024-08-21Skip failing tempfile library testsSoutaro Matsumoto
Notes: Merged: https://github.com/ruby/ruby/pull/11417
2024-08-20Remove dependency on Tempfile::Remover in leakchecker.rbPeter Zhu
2024-08-20Remove extraneous lock filesNobuyoshi Nakada
See https://github.com/rubygems/rubygems/pull/7939
2024-08-18Make Range#step to consistently use + for iteration (#7444)Victor Shepelev
Make Range#step to consistently use + for iteration [Feature #18368] Previously, non-numerics expected step to be integer, and iterated with begin#succ, skipping over step value steps. Since this commit, numeric and non-numeric iteration behaves the same way, by using + operator. Notes: Merged-By: zverok <zverok.offline@gmail.com>
2024-08-15Improve base time of assert_linear_performance (#11369)tomoya ishida
Remove `.ceil` from base time calculation that makes 10x gap. This will make the assertion more strict and also less flaky. Notes: Merged-By: kou <kou@clear-code.com>
2024-08-08Added test scenario for https://github.com/ruby/ruby/pull/11322Hiroshi SHIBATA
2024-08-07tool/test-annocheck.sh: Refactor with double-quotes.Jun Aruga
2024-08-07CI: Run annocheck for libruby.soJun Aruga
When building with the `--shared` option, most functionality is kept in `libruby.so`. Therefore also run annocheck for `libruby.so`. Use `ARG IN_DIR` to propagate multiple files into the container instead of `ARG FILES` in the `Dockerfile-copy`. Because the `COPY` syntax in Dockerfile doesn't support copying the multiple files. https://stackoverflow.com/questions/61599384/specify-multiple-files-in-arg-to-copy-in-dockerfile Co-authored-by: Vít Ondruch <vondruch@redhat.com>
2024-08-07Use 20min for parallel test worker timeoutYusuke Endoh
2024-08-07Use SIGSEGV to kill a parallel test worker (to dump backtrace)Yusuke Endoh
2024-08-07Wait a bit longer for worker quitYusuke Endoh
2024-08-07Add a log when SIGKILL is sent to a test parallel workerYusuke Endoh
2024-08-07Fix a typoYusuke Endoh
2024-08-06Use 3min for test parallel worker timeout againYusuke Endoh
Notes: Merged: https://github.com/ruby/ruby/pull/11315
2024-08-06Dump all-thread backtraces when test parallel worker exceeds time limitYusuke Endoh
Notes: Merged: https://github.com/ruby/ruby/pull/11315
2024-08-06Extend the default timeout of parallel testing to one hourYusuke Endoh
2024-08-06Extend the default timeout of parallel testingYusuke Endoh
Notes: Merged: https://github.com/ruby/ruby/pull/11311
2024-08-05Clean up empty directoryHiroshi SHIBATA
2024-08-05Make sure to always use the right `warn`David Rodríguez
Notes: Merged: https://github.com/ruby/ruby/pull/11296
2024-07-26Error when --with-shared-gc doesn't specify a directoryPeter Zhu
Notes: Merged: https://github.com/ruby/ruby/pull/11248
2024-07-18Write rbinc files at onceNobuyoshi Nakada
Unexpected error can make empty files which result in unclear compilation errors. Notes: Merged: https://github.com/ruby/ruby/pull/11194
2024-07-16Follow-up resolv and win32 integrationHiroshi SHIBATA
https://github.com/ruby/resolv/pull/54
2024-07-11[PRISM] Revert incorrectly merged gemfileKevin Newton
2024-07-11[ruby/prism] Various cleanup for initializers and typechecksKevin Newton
https://github.com/ruby/prism/commit/86cf82794a
2024-07-11Removed WEBrick and that testsHiroshi SHIBATA
We can handle uri, time and others without `make test-all` dependencies now.
2024-07-09Fix grammar of ruby_shared_gc.m4Peter Zhu
2024-07-08Add make target shared-gcPeter Zhu
Allows building shared GC using `make shared-gc SHARED_GC=gc_impl`
2024-07-08Move the file location of launchable.rbNaoto Ono
2024-07-08Integrate Launchable into make btestNaoto Ono
2024-07-05Change external GC to use directory at configurePeter Zhu
This commit changes the external GC API to use `--with-shared-gc=DIR` at configure time with a directory of the external GC and uses `RUBY_GC_LIBRARY` environment variable to load the external GC at runtime.
2024-07-01Skip to copy .so/.bundle files generated by rake-compilerHiroshi SHIBATA
2024-06-24Use gperf 3.1 to generate ANSI-C codeNobuyoshi Nakada
2024-06-24No longer needs `sigsetjmp`Nobuyoshi Nakada
Since signal handlers just set flag and return now, `sigsetjmp` and `siglongjmp` will not be needed.
2024-06-21Support LCOV 2.0Yusuke Endoh
LCOV 2.0, a GCOV frontend, seems to have stricter error checking
2024-06-18Optimized forwarding callers and calleesAaron Patterson
This patch optimizes forwarding callers and callees. It only optimizes methods that only take `...` as their parameter, and then pass `...` to other calls. Calls it optimizes look like this: ```ruby def bar(a) = a def foo(...) = bar(...) # optimized foo(123) ``` ```ruby def bar(a) = a def foo(...) = bar(1, 2, ...) # optimized foo(123) ``` ```ruby def bar(*a) = a def foo(...) list = [1, 2] bar(*list, ...) # optimized end foo(123) ``` All variants of the above but using `super` are also optimized, including a bare super like this: ```ruby def foo(...) super end ``` This patch eliminates intermediate allocations made when calling methods that accept `...`. We can observe allocation elimination like this: ```ruby def m x = GC.stat(:total_allocated_objects) yield GC.stat(:total_allocated_objects) - x end def bar(a) = a def foo(...) = bar(...) def test m { foo(123) } end test p test # allocates 1 object on master, but 0 objects with this patch ``` ```ruby def bar(a, b:) = a + b def foo(...) = bar(...) def test m { foo(1, b: 2) } end test p test # allocates 2 objects on master, but 0 objects with this patch ``` How does it work? ----------------- This patch works by using a dynamic stack size when passing forwarded parameters to callees. The caller's info object (known as the "CI") contains the stack size of the parameters, so we pass the CI object itself as a parameter to the callee. When forwarding parameters, the forwarding ISeq uses the caller's CI to determine how much stack to copy, then copies the caller's stack before calling the callee. The CI at the forwarded call site is adjusted using information from the caller's CI. I think this description is kind of confusing, so let's walk through an example with code. ```ruby def delegatee(a, b) = a + b def delegator(...) delegatee(...) # CI2 (FORWARDING) end def caller delegator(1, 2) # CI1 (argc: 2) end ``` Before we call the delegator method, the stack looks like this: ``` Executing Line | Code | Stack ---------------+---------------------------------------+-------- 1| def delegatee(a, b) = a + b | self 2| | 1 3| def delegator(...) | 2 4| # | 5| delegatee(...) # CI2 (FORWARDING) | 6| end | 7| | 8| def caller | -> 9| delegator(1, 2) # CI1 (argc: 2) | 10| end | ``` The ISeq for `delegator` is tagged as "forwardable", so when `caller` calls in to `delegator`, it writes `CI1` on to the stack as a local variable for the `delegator` method. The `delegator` method has a special local called `...` that holds the caller's CI object. Here is the ISeq disasm fo `delegator`: ``` == disasm: #<ISeq:delegator@-e:1 (1,0)-(1,39)> local table (size: 1, argc: 0 [opts: 0, rest: -1, post: 0, block: -1, kw: -1@-1, kwrest: -1]) [ 1] "..."@0 0000 putself ( 1)[LiCa] 0001 getlocal_WC_0 "..."@0 0003 send <calldata!mid:delegatee, argc:0, FCALL|FORWARDING>, nil 0006 leave [Re] ``` The local called `...` will contain the caller's CI: CI1. Here is the stack when we enter `delegator`: ``` Executing Line | Code | Stack ---------------+---------------------------------------+-------- 1| def delegatee(a, b) = a + b | self 2| | 1 3| def delegator(...) | 2 -> 4| # | CI1 (argc: 2) 5| delegatee(...) # CI2 (FORWARDING) | cref_or_me 6| end | specval 7| | type 8| def caller | 9| delegator(1, 2) # CI1 (argc: 2) | 10| end | ``` The CI at `delegatee` on line 5 is tagged as "FORWARDING", so it knows to memcopy the caller's stack before calling `delegatee`. In this case, it will memcopy self, 1, and 2 to the stack before calling `delegatee`. It knows how much memory to copy from the caller because `CI1` contains stack size information (argc: 2). Before executing the `send` instruction, we push `...` on the stack. The `send` instruction pops `...`, and because it is tagged with `FORWARDING`, it knows to memcopy (using the information in the CI it just popped): ``` == disasm: #<ISeq:delegator@-e:1 (1,0)-(1,39)> local table (size: 1, argc: 0 [opts: 0, rest: -1, post: 0, block: -1, kw: -1@-1, kwrest: -1]) [ 1] "..."@0 0000 putself ( 1)[LiCa] 0001 getlocal_WC_0 "..."@0 0003 send <calldata!mid:delegatee, argc:0, FCALL|FORWARDING>, nil 0006 leave [Re] ``` Instruction 001 puts the caller's CI on the stack. `send` is tagged with FORWARDING, so it reads the CI and _copies_ the callers stack to this stack: ``` Executing Line | Code | Stack ---------------+---------------------------------------+-------- 1| def delegatee(a, b) = a + b | self 2| | 1 3| def delegator(...) | 2 4| # | CI1 (argc: 2) -> 5| delegatee(...) # CI2 (FORWARDING) | cref_or_me 6| end | specval 7| | type 8| def caller | self 9| delegator(1, 2) # CI1 (argc: 2) | 1 10| end | 2 ``` The "FORWARDING" call site combines information from CI1 with CI2 in order to support passing other values in addition to the `...` value, as well as perfectly forward splat args, kwargs, etc. Since we're able to copy the stack from `caller` in to `delegator`'s stack, we can avoid allocating objects. I want to do this to eliminate object allocations for delegate methods. My long term goal is to implement `Class#new` in Ruby and it uses `...`. I was able to implement `Class#new` in Ruby [here](https://github.com/ruby/ruby/pull/9289). If we adopt the technique in this patch, then we can optimize allocating objects that take keyword parameters for `initialize`. For example, this code will allocate 2 objects: one for `SomeObject`, and one for the kwargs: ```ruby SomeObject.new(foo: 1) ``` If we combine this technique, plus implement `Class#new` in Ruby, then we can reduce allocations for this common operation. Co-Authored-By: John Hawthorn <john@hawthorn.email> Co-Authored-By: Alan Wu <XrXr@users.noreply.github.com>
2024-06-14Enable LeakChecker for RJIT previously disabled for MJIT (#10998)Alan Wu
RJIT doesn't spawn subprocesses so there should now be no need to special case it.
2024-06-11redmine-backporter.rb: Prepend commit: to shorter revsTakashi Kokubun
Some of the places in Redmine (e.g. Associated revisions) print revisions using only 8 characters. Even when I copied a revision from there, I want to prepend commit: in the message.