From: Ryan Davis <ryand-ruby@...>
Date: 2011-06-22T06:55:02+09:00
Subject: [ruby-core:37273] Re: [Ruby 1.9 - Bug #4814] minitest 2.2.x and test/unit do not get along


On Jun 12, 2011, at 05:38 , Yui NARUSE wrote:

> Issue #4814 has been updated by Yui NARUSE.
> 
> How's it going?

I completely missed Sora's last email and assumed your question was for him. I'm still broken:

7107 % svn st
7107 % svn info io.c | grep Revision
Revision: 31902
7108 % make -j 4 ruby19
make: `ruby19' is up to date.
7109 % make TESTS="-v testunit/test_parallel.rb" test-all
./miniruby -I./lib -I. -I.ext/common  ./tool/runruby.rb --extout=.ext  -- "./test/runner.rb" --ruby="./miniruby -I./lib -I. -I.ext/common  ./tool/runruby.rb --extout=.ext  --" -v testunit/test_parallel.rb
Run options: "--ruby=./miniruby -I./lib -I. -I.ext/common  ./tool/runruby.rb --extout=.ext  --" -v

# Running tests:

TestParallel::TestParallel#test_jobs_status = 0.12 s = F
TestParallel::TestParallel#test_no_retry_option = 0.12 s = F
TestParallel::TestParallel#test_should_retry_failed_on_workers = 0.12 s = F
TestParallel::TestParallel#test_should_run_all_without_any_leaks = 0.13 s = F
TestParallel::TestParallelWorker#test_accept_run_command_multiple_times = 0.11 s = .
TestParallel::TestParallelWorker#test_done = 0.11 s = .
TestParallel::TestParallelWorker#test_p = 0.11 s = .
TestParallel::TestParallelWorker#test_quit = 0.11 s = .
TestParallel::TestParallelWorker#test_run = 0.11 s = .
TestParallel::TestParallelWorker#test_run_multiple_testcase_in_one_file = 0.11 s = .


Finished tests in 1.145128s, 8.7326 tests/s, 35.8039 assertions/s.

  1) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:176]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t2 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

  2) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:170]:
Expected /^ +\d+\) Failure:\nptest_fail_at_worker\(TestD\)/ to match "Run options: -j t2 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

  3) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /^Retrying\.+$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

  4) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /^\.*(\.SF\.*F|F\.*\.+SF)\.*$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

10 tests, 41 assertions, 4 failures, 0 errors, 0 skips
make: *** [yes-test-all] Error 4


Even after updating to the latest revision:


Run options: "--ruby=./miniruby -I./lib -I. -I.ext/common  ./tool/runruby.rb --extout=.ext  --" -v

# Running tests:

TestParallel::TestParallel#test_ignore_jzero = 0.11 s = .
TestParallel::TestParallel#test_jobs_status = 0.12 s = F
TestParallel::TestParallel#test_no_retry_option = 0.11 s = F
TestParallel::TestParallel#test_should_retry_failed_on_workers = 0.11 s = F
TestParallel::TestParallel#test_should_run_all_without_any_leaks = 0.11 s = F
TestParallel::TestParallelWorker#test_accept_run_command_multiple_times = 0.12 s = .
TestParallel::TestParallelWorker#test_done = 0.13 s = .
TestParallel::TestParallelWorker#test_p = 0.16 s = .
TestParallel::TestParallelWorker#test_quit = 0.11 s = .
TestParallel::TestParallelWorker#test_run = 0.11 s = .
TestParallel::TestParallelWorker#test_run_multiple_testcase_in_one_file = 0.11 s = .


Finished tests in 1.302439s, 8.4457 tests/s, 32.2472 assertions/s.

  1) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:175]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t1 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

  2) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:169]:
Expected /^ +\d+\) Failure:\nptest_fail_at_worker\(TestD\)/ to match "Run options: -j t1 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

  3) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /^Retrying\.+$/ to match "Run options: -j t1\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

  4) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /^[SF\.]{7}$/ to match "Run options: -j t1\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in `ensure in _run_parallel': undefined method `each' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in `_run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in `_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in `_run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:in `run_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in `block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `each'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in `_run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in `run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in `<main>'\n".

11 tests, 42 assertions, 4 failures, 0 errors, 0 skips
make: *** [yes-test-all] Error 4