summaryrefslogtreecommitdiff
path: root/bootstraptest/runner.rb
AgeCommit message (Collapse)Author
2024-12-12bootstraptest: On -j failure, show total test countAlan Wu
It used to always try to divide by zero like: FAIL 1/0 tests failed
2024-12-03Enable Launchable integration in compilers.yml (#12136)Naoto Ono
Notes: Merged-By: ono-max <onoto1998@gmail.com>
2024-07-19Rename a variable nameNaoto Ono
Notes: Merged: https://github.com/ruby/ruby/pull/11205
2024-07-19Launchable: Aggregate test results based on file levelNaoto Ono
Notes: Merged: https://github.com/ruby/ruby/pull/11205
2024-07-09Use `File.write` instead of `Kernel#open`Nobuyoshi Nakada
2024-07-08Move the file location of launchable.rbNaoto Ono
2024-07-08Integrate Launchable into make btestNaoto Ono
2024-07-01maximum showing line number on btest failureKoichi Sasada
Some tests in btest uses long src for btest and it is harmful to check the results. This patch introducing the limitation how many lines of code is shown on failure.
2024-06-10respect `RUBY_TEST_TIMEOUT_SCALE`Koichi Sasada
GC benchmarks will spend long time with assertions so we need to respect `RUBY_TEST_SUBPROCESS_TIMEOUT_SCALE` environment variable. @nobu pointed out that now `RUBY_TEST_TIMEOUT_SCALE` is primary (and `RUBY_TEST_SUBPROCESS_TIMEOUT_SCALE` was obsolete so check both and will remove it later.
2024-06-04Fix pathes => paths typo in bootstrap test runnerMatt Valentine-House
2024-04-28Fix regexps for abbreviated optionsNobuyoshi Nakada
2024-04-28Timeout scale in bootstraptestNobuyoshi Nakada
2024-04-28Timeout in bootstraptestNobuyoshi Nakada
2024-04-08Fix nil error with KNOWNBUGS.rbAlan Wu
Previously, `make test-knownbugs` crashed with `NoMethodError` due to the failed regex match if there is a test case in KNOWNBUGS.rb. The note about 1.8 compatibility is probably bogus as we require a way more recent BASERUBY now.
2024-03-15Refactor frozen_string_literal check during compilationJean Boussier
In preparation for https://bugs.ruby-lang.org/issues/20205. The `frozen_string_literal` compilation option will no longer be a boolean but a tri-state: `on/off/default`.
2024-03-14Ensure test suite is compatible with --frozen-string-literalJean Boussier
As preparation for https://bugs.ruby-lang.org/issues/20205 making sure the test suite is compatible with frozen string literals is making things easier.
2024-01-23Revert "Skip a failing test for Prism"Peter Zhu
This reverts commit 557b69e83b27dafea435719fc3afc2e67e155962.
2024-01-23Skip a failing test for PrismTakashi Kokubun
This should be reverted once https://github.com/ruby/prism/issues/2249 is closed.
2024-01-22Skip a flaky Ractor test for YJITTakashi Kokubun
`[BUG] pthread_mutex_lock: Invalid argument (EINVAL)` doesn't seem like a fault of YJIT? https://github.com/ruby/ruby/actions/runs/7614455181/job/20736754975 https://github.com/ruby/ruby/actions/runs/7615316673/job/20739572487
2023-12-21RJIT: Streamline RJIT enablement checkTakashi Kokubun
in bootstrap tests so that `make btest-bruby` skips the right tests.
2023-12-16support `skip` in bootstraptestKoichi Sasada
2023-03-19Remove a warning in bootstraptest/runner.rbTakashi Kokubun
../bootstraptest/runner.rb:121: warning: assigned but unused variable - e
2023-03-06s/MJIT/RJIT/Takashi Kokubun
Notes: Merged: https://github.com/ruby/ruby/pull/7462
2022-11-07Let other test runners follow the change of GNU make 4.4 jobserverNobuyoshi Nakada
2022-10-01Indent folded bootstraptest dotsNobuyoshi Nakada
2022-09-29bootstraptest/runner: run in parallel if in parallel buildNobuyoshi Nakada
2022-09-28bootstraptest/runner: manage sub processes with the job serverNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/6463
2022-09-28bootstraptest/runner: fold dots by window sizeNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/6463
2022-09-19Fix the option name in the error message [ci skip]Nobuyoshi Nakada
2022-02-17Reuse `-v` option result as `target_platform`Nobuyoshi Nakada
Backticks method invokes `/bin/sh` when the command contains quotes, and `sh` clears some environment variables set in runruby.rb to search the built shared library.
2022-02-17btest-ruby OPTS=-v should disable quietKoichi Sasada
`make btest-ruby` is run with -q (quiet) option and -v should remove -q option.
2022-02-06support concurrent btest executionKoichi Sasada
* `-j` option for concurrent test with threads * `-jN` uses N threads * `-j` uses nproc/2 threads * Introduce `BT` struct to manage configurations * Introduce `Assertion` to manage all assertions * Remove all toplevel instance variables * Show elapsed seconds at last ``` $ time make btest ... real 0m37.319s user 0m26.221s sys 0m16.534s $ time make btest TESTOPTS=-j ... real 0m11.812s user 0m36.667s sys 0m21.872s ``` Notes: Merged: https://github.com/ruby/ruby/pull/5528
2022-01-26refactoring btest outputKoichi Sasada
don't duplicate the message, but prepare `out` var to choose stdout/err. Notes: Merged: https://github.com/ruby/ruby/pull/5484
2022-01-21respect `--quiet` option for btestKoichi Sasada
Do not print anymore except errors.
2022-01-19[wasm] bootstraptest, basictest: disable backquote literal testsYuta Saito
WASI doesn't support spawning a new process for now. Notes: Merged: https://github.com/ruby/ruby/pull/5407
2021-12-13Prepare for removing RubyVM::JIT (#5262)Takashi Kokubun
Notes: Merged-By: k0kubun <takashikkbn@gmail.com>
2021-01-13Rename RubyVM::MJIT to RubyVM::JITTakashi Kokubun
because the name "MJIT" is an internal code name, it's inconsistent with --jit while they are related to each other, and I want to discourage future JIT implementation-specific (e.g. MJIT-specific) APIs by this rename. [Feature #17490]
2020-12-13Debug the command used for gdb dumpTakashi Kokubun
It's not working http://ci.rvm.jp/results/trunk-mjit@phosphorus-docker/3288206. I'm debugging why.
2020-12-13@ruby is the target Ruby in bootstraptestTakashi Kokubun
2020-12-12Dump a backtrace with gdbTakashi Kokubun
Because Ruby often fails to dump a C backtrace.
2020-12-10Save a core file from bootstraptestTakashi Kokubun
2020-12-04Guard all accesses to RubyVM::MJIT with defined?(RubyVM::MJIT) &&Benoit Daloze
* Otherwise those tests, etc cannot run on alternative Ruby implementations.
2020-07-29display stderr output even if core dump filesKoichi Sasada
On btest, stderr messages are not displayed if core files are generated. There is no reason to skip it, so this patch display stderr and check core files.
2019-07-29Erase only on ttyNobuyoshi Nakada
2019-07-02colors file has been moved from test to toolNobuyoshi Nakada
2019-07-01bootstraptest/runner.rb (show_limit): defer messages unless verbose and a ttyNobuyoshi Nakada
2019-07-01bootstraptest/runner.rb (show_limit): show dots only when printing to a ttyNobuyoshi Nakada
2019-06-19* remove trailing spaces, expand tabs.git
2019-06-19Show thread and fiber limits as part of bootstrap tests.Samuel Williams
2019-01-17support btest on older ruby.ko1
* bootstraptest/runner.rb (assert_normal_exit): check MJIT first to support btest with ruby ~2.5. btest (bootstraptest) should be enable to run with stable ruby interpreter because modified ruby may not able to run runner.rb and we need to know why (this is why we introduce btest). git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@66842 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
generated by cgit v1.2.3 (git 2.25.1) at 2026-01-17 03:31:48 +0000