mercurial-scm/hg-stable: tests/test-run-tests.t annotate

annotate tests/test-run-tests.t @ 38554:3fb46734508d

tests: add test showing puzzling test output with (glob) lines When using multiple (glob) lines, the test runner often moves the lines around in the output on failure. I have run into this problem many times. The added test shows one example of this. Note that it doesn't show the mismatching lines and instead shows diff hunks that appear to replace a literal by a glob, and other hunks that should clearly match. Differential Revision: https://phab.mercurial-scm.org/D3880

author	Martin von Zweigbergk <martinvonz@google.com>
date	Fri, 29 Jun 2018 11:29:03 -0700
parents	b5651ae53127
children	f83600efa1ca

rev	line source
21732 b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	1 This file tests the behavior of run-tests.py itself.
b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	2
24960 65e8dac7b016 test-run-test: unset run-test specific environment variables Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	3 Avoid interference from actual test env:
65e8dac7b016 test-run-test: unset run-test specific environment variables Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	4
29220 054bcdad6042 tests: refactor run-tests helpers timeless <timeless@mozdev.org> parents: 29199 diff changeset	5 $ . "$TESTDIR/helper-runtests.sh"
24960 65e8dac7b016 test-run-test: unset run-test specific environment variables Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	6
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	7 Smoke test with install
21732 b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	8 ============
37740 1b71a397d6b2 tests: make sure test-run-tests.t actually runs run-tests.py under Python 3 Augie Fackler <augie@google.com> parents: 37434 diff changeset	9 $ $PYTHON $TESTDIR/run-tests.py $HGTEST_RUN_TESTS_PURE -l
21732 b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	10
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	11 # Ran 0 tests, 0 skipped, 0 failed.
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	12
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	13 Define a helper to avoid the install step
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	14 =============
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	15 $ rt()
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	16 > {
37740 1b71a397d6b2 tests: make sure test-run-tests.t actually runs run-tests.py under Python 3 Augie Fackler <augie@google.com> parents: 37434 diff changeset	17 > $PYTHON $TESTDIR/run-tests.py --with-hg=`which hg` "$@"
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	18 > }
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	19
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	20 error paths
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	21
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	22 #if symlink
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	23 $ ln -s `which true` hg
37740 1b71a397d6b2 tests: make sure test-run-tests.t actually runs run-tests.py under Python 3 Augie Fackler <augie@google.com> parents: 37434 diff changeset	24 $ $PYTHON $TESTDIR/run-tests.py --with-hg=./hg
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	25 warning: --with-hg should specify an hg script
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	26
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	27 # Ran 0 tests, 0 skipped, 0 failed.
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	28 $ rm hg
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	29 #endif
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	30
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	31 #if execbit
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	32 $ touch hg
37740 1b71a397d6b2 tests: make sure test-run-tests.t actually runs run-tests.py under Python 3 Augie Fackler <augie@google.com> parents: 37434 diff changeset	33 $ $PYTHON $TESTDIR/run-tests.py --with-hg=./hg
35198 b4b0aed7bfaf run-tests: convert to argparse Gregory Szorc <gregory.szorc@gmail.com> parents: 35176 diff changeset	34 usage: run-tests.py [options] [tests]
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	35 run-tests.py: error: --with-hg must specify an executable hg script
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	36 [2]
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	37 $ rm hg
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	38 #endif
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	39
31829 4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	40 Features for testing optional lines
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	41 ===================================
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	42
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	43 $ cat > hghaveaddon.py <<EOF
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	44 > import hghave
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	45 > @hghave.check("custom", "custom hghave feature")
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	46 > def has_custom():
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	47 > return True
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	48 > @hghave.check("missing", "missing hghave feature")
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	49 > def has_missing():
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	50 > return False
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	51 > EOF
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	52
28812 f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	53 an empty test
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	54 =======================
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	55
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	56 $ touch test-empty.t
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	57 $ rt
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	58 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	59 # Ran 1 tests, 0 skipped, 0 failed.
28812 f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	60 $ rm test-empty.t
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	61
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	62 a succesful test
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	63 =======================
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	64
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	65 $ cat > test-success.t << EOF
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	66 > $ echo babar
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	67 > babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	68 > $ echo xyzzy
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	69 > dont_print (?)
220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	70 > nothing[42]line (re) (?)
28701 3bce3d2fd727 run-tests: make _processoutput picky about optional globs timeless <timeless@mozdev.org> parents: 28619 diff changeset	71 > never*happens (glob) (?)
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	72 > more_nothing (?)
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	73 > xyzzy
25388 6025cac3d02f tests: add (?) flag for optional lines Matt Mackall <mpm@selenic.com> parents: 25098 diff changeset	74 > nor this (?)
28317 8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	75 > $ printf 'abc\ndef\nxyz\n'
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	76 > 123 (?)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	77 > abc
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	78 > def (?)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	79 > 456 (?)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	80 > xyz
31829 4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	81 > $ printf 'zyx\nwvu\ntsr\n'
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	82 > abc (?)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	83 > zyx (custom !)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	84 > wvu
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	85 > no_print (no-custom !)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	86 > tsr (no-missing !)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	87 > missing (missing !)
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	88 > EOF
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	89
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	90 $ rt
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	91 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	92 # Ran 1 tests, 0 skipped, 0 failed.
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	93
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	94 failing test
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	95 ==================
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	96
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	97 test churn with globs
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	98 $ cat > test-failure.t <<EOF
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	99 > $ echo "bar-baz"; echo "bar-bad"; echo foo
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	100 > bar*bad (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	101 > bar*baz (glob)
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	102 > \| fo (re)
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	103 > EOF
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	104 $ rt test-failure.t
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	105
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	106 --- $TESTTMP/test-failure.t
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	107 +++ $TESTTMP/test-failure.t.err
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	108 @@ -1,4 +1,4 @@
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	109 $ echo "bar-baz"; echo "bar-bad"; echo foo
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	110 + bar*baz (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	111 bar*bad (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	112 - bar*baz (glob)
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	113 - \| fo (re)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	114 + foo
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	115
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	116 ERROR: test-failure.t output changed
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	117 !
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	118 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	119 # Ran 1 tests, 0 skipped, 1 failed.
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	120 python hash seed: * (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	121 [1]
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	122
38554 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	123 test how multiple globs gets matched with lines in output
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	124 $ cat > test-failure-globs.t <<EOF
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	125 > $ echo "context"; echo "context"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	126 > echo "key: 1"; echo "value: not a"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	127 > echo "key: 2"; echo "value: not b"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	128 > echo "key: 3"; echo "value: c"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	129 > echo "key: 4"; echo "value: d"
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	130 > context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	131 > context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	132 > key: 1
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	133 > value: a
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	134 > key: 2
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	135 > value: b
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	136 > key: 3
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	137 > value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	138 > key: 4
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	139 > value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	140 > EOF
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	141 $ rt test-failure-globs.t
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	142
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	143 --- $TESTTMP/test-failure-globs.t
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	144 +++ $TESTTMP/test-failure-globs.t.err
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	145 @@ -2,10 +2,10 @@
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	146 context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	147 context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	148 key: 1
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	149 - value: a
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	150 + value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	151 key: 2
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	152 - value: b
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	153 + value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	154 key: 3
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	155 - value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	156 + value: c
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	157 key: 4
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	158 - value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	159 + value: d
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	160
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	161 ERROR: test-failure-globs.t output changed
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	162 !
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	163 Failed test-failure-globs.t: output changed
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	164 # Ran 1 tests, 0 skipped, 1 failed.
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	165 python hash seed: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	166 [1]
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	167 $ rm test-failure-globs.t
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	168
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	169 test diff colorisation
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	170
33552 754569f5e999 run-tests: make sure to check if pygments is installed before using it Pulkit Goyal <7895pulkit@gmail.com> parents: 33500 diff changeset	171 #if no-windows pygments
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	172 $ rt test-failure.t --color always
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	173
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	174 \x1b[38;5;124m--- $TESTTMP/test-failure.t\x1b[39m (esc)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	175 \x1b[38;5;34m+++ $TESTTMP/test-failure.t.err\x1b[39m (esc)
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	176 \x1b[38;5;90;01m@@ -1,4 +1,4 @@\x1b[39;00m (esc)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	177 $ echo "bar-baz"; echo "bar-bad"; echo foo
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	178 \x1b[38;5;34m+ bar*baz (glob)\x1b[39m (esc)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	179 bar*bad (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	180 \x1b[38;5;124m- bar*baz (glob)\x1b[39m (esc)
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	181 \x1b[38;5;124m- \| fo (re)\x1b[39m (esc)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	182 \x1b[38;5;34m+ foo\x1b[39m (esc)
34842 8bce3e51b101 run-tests: move newline out of colorized message Martin von Zweigbergk <martinvonz@google.com> parents: 34270 diff changeset	183
33835 81b12f69ef5b run-tests: also color the summary messages (skipped, failed...) Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33722 diff changeset	184 \x1b[38;5;88mERROR: \x1b[39m\x1b[38;5;9mtest-failure.t\x1b[39m\x1b[38;5;88m output changed\x1b[39m (esc)
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	185 !
33835 81b12f69ef5b run-tests: also color the summary messages (skipped, failed...) Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33722 diff changeset	186 \x1b[38;5;88mFailed \x1b[39m\x1b[38;5;9mtest-failure.t\x1b[39m\x1b[38;5;88m: output changed\x1b[39m (esc)
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	187 # Ran 1 tests, 0 skipped, 1 failed.
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	188 python hash seed: * (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	189 [1]
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	190
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	191 $ rt test-failure.t 2> tmp.log
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	192 [1]
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	193 $ cat tmp.log
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	194
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	195 --- $TESTTMP/test-failure.t
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	196 +++ $TESTTMP/test-failure.t.err
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	197 @@ -1,4 +1,4 @@
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	198 $ echo "bar-baz"; echo "bar-bad"; echo foo
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	199 + bar*baz (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	200 bar*bad (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	201 - bar*baz (glob)
35176 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	202 - \| fo (re)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35120 diff changeset	203 + foo
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	204
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	205 ERROR: test-failure.t output changed
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	206 !
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	207 Failed test-failure.t: output changed
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	208 # Ran 1 tests, 0 skipped, 1 failed.
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	209 python hash seed: * (glob)
33500 9c6e64911de0 run-tests: disable color on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 33420 diff changeset	210 #endif
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33000 diff changeset	211
33721 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	212 $ cat > test-failure.t << EOF
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	213 > $ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	214 > should go away (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	215 > $ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	216 > should stay (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	217 >
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	218 > Should remove first line, not second or third
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	219 > $ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	220 > baz*foo (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	221 > foobar*foo (glob) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	222 > te*ting (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	223 >
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	224 > Should keep first two lines, remove third and last
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	225 > $ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	226 > test.ng (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	227 > foo.ar (re) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	228 > b.r (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	229 > missing (?)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	230 > awol (true !)
33722 1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	231 >
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	232 > The "missing" line should stay, even though awol is dropped
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	233 > $ echo 'testing'
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	234 > test.ng (re) (true !)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	235 > foo.ar (?)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	236 > awol
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	237 > missing (?)
33721 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	238 > EOF
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	239 $ rt test-failure.t
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	240
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	241 --- $TESTTMP/test-failure.t
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	242 +++ $TESTTMP/test-failure.t.err
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	243 @@ -1,11 +1,9 @@
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	244 $ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	245 - should go away (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	246 $ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	247 should stay (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	248
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	249 Should remove first line, not second or third
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	250 $ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	251 - baz*foo (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	252 foobar*foo (glob) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	253 te*ting (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	254
33722 1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	255 foo.ar (re) (false !)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	256 missing (?)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	257 @@ -13,13 +11,10 @@
33721 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	258 $ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	259 test.ng (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	260 foo.ar (re) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	261 - b.r (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	262 missing (?)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	263 - awol (true !)
33722 1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	264
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	265 The "missing" line should stay, even though awol is dropped
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	266 $ echo 'testing'
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	267 test.ng (re) (true !)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	268 foo.ar (?)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	269 - awol
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33721 diff changeset	270 missing (?)
33721 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	271
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	272 ERROR: test-failure.t output changed
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	273 !
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	274 Failed test-failure.t: output changed
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	275 # Ran 1 tests, 0 skipped, 1 failed.
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	276 python hash seed: * (glob)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	277 [1]
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	278
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	279 basic failing test
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	280 $ cat > test-failure.t << EOF
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	281 > $ echo babar
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	282 > rataxes
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	283 > This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	284 > this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	285 > pad pad pad pad............................................................
c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	286 > pad pad pad pad............................................................
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	287 > pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	288 > pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	289 > pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	290 > pad pad pad pad............................................................
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	291 > EOF
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	292
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	293 >>> fh = open('test-failure-unicode.t', 'wb')
25054 af5a778f8e2e test-run-tests.t: work around file.write() returning an int Augie Fackler <augie@google.com> parents: 24990 diff changeset	294 >>> fh.write(u' $ echo babar\u03b1\n'.encode('utf-8')) and None
af5a778f8e2e test-run-tests.t: work around file.write() returning an int Augie Fackler <augie@google.com> parents: 24990 diff changeset	295 >>> fh.write(u' l\u03b5\u03b5t\n'.encode('utf-8')) and None
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	296
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	297 $ rt
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	298
23348 bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	299 --- $TESTTMP/test-failure.t
bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	300 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	301 @@ -1,5 +1,5 @@
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	302 $ echo babar
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	303 - rataxes
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	304 + babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	305 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	306 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	307 pad pad pad pad............................................................
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	308
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	309 ERROR: test-failure.t output changed
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	310 !.
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	311 --- $TESTTMP/test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	312 +++ $TESTTMP/test-failure-unicode.t.err
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	313 @@ -1,2 +1,2 @@
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	314 $ echo babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	315 - l\xce\xb5\xce\xb5t (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	316 + babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	317
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	318 ERROR: test-failure-unicode.t output changed
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	319 !
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	320 Failed test-failure.t: output changed
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	321 Failed test-failure-unicode.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	322 # Ran 3 tests, 0 skipped, 2 failed.
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	323 python hash seed: * (glob)
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	324 [1]
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	325
32736 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	326 test --outputdir
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	327 $ mkdir output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	328 $ rt --outputdir output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	329
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	330 --- $TESTTMP/test-failure.t
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	331 +++ $TESTTMP/output/test-failure.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	332 @@ -1,5 +1,5 @@
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	333 $ echo babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	334 - rataxes
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	335 + babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	336 This is a noop statement so that
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	337 this test is still more bytes than success.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	338 pad pad pad pad............................................................
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	339
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	340 ERROR: test-failure.t output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	341 !.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	342 --- $TESTTMP/test-failure-unicode.t
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	343 +++ $TESTTMP/output/test-failure-unicode.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	344 @@ -1,2 +1,2 @@
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	345 $ echo babar\xce\xb1 (esc)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	346 - l\xce\xb5\xce\xb5t (esc)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	347 + babar\xce\xb1 (esc)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	348
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	349 ERROR: test-failure-unicode.t output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	350 !
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	351 Failed test-failure.t: output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	352 Failed test-failure-unicode.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	353 # Ran 3 tests, 0 skipped, 2 failed.
32736 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	354 python hash seed: * (glob)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	355 [1]
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	356 $ ls -a output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	357 .
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	358 ..
32737 e5680cb1414f run-tests: write test times to output dir Siddharth Agarwal <sid0@fb.com> parents: 32736 diff changeset	359 .testtimes
32736 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	360 test-failure-unicode.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	361 test-failure.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	362
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	363 test --xunit support
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	364 $ rt --xunit=xunit.xml
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	365
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	366 --- $TESTTMP/test-failure.t
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	367 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	368 @@ -1,5 +1,5 @@
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	369 $ echo babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	370 - rataxes
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	371 + babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	372 This is a noop statement so that
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	373 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	374 pad pad pad pad............................................................
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	375
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	376 ERROR: test-failure.t output changed
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	377 !.
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	378 --- $TESTTMP/test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	379 +++ $TESTTMP/test-failure-unicode.t.err
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	380 @@ -1,2 +1,2 @@
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	381 $ echo babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	382 - l\xce\xb5\xce\xb5t (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	383 + babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	384
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	385 ERROR: test-failure-unicode.t output changed
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	386 !
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	387 Failed test-failure.t: output changed
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	388 Failed test-failure-unicode.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	389 # Ran 3 tests, 0 skipped, 2 failed.
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	390 python hash seed: * (glob)
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	391 [1]
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	392 $ cat xunit.xml
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	393 <?xml version="1.0" encoding="utf-8"?>
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	394 <testsuite errors="0" failures="2" name="run-tests" skipped="0" tests="3">
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	395 <testcase name="test-success.t" time="*"/> (glob)
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	396 <testcase name="test-failure-unicode.t" time="*"> (glob)
32734 ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32724 diff changeset	397 <failure message="output changed" type="output-mismatch">
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	398 <![CDATA[--- $TESTTMP/test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	399 +++ $TESTTMP/test-failure-unicode.t.err
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	400 @@ -1,2 +1,2 @@
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	401 $ echo babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	402 - l\xce\xb5\xce\xb5t (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	403 + babar\xce\xb1 (esc)
32734 ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32724 diff changeset	404 ]]> </failure>
ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32724 diff changeset	405 </testcase>
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	406 <testcase name="test-failure.t" time="*"> (glob)
32734 ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32724 diff changeset	407 <failure message="output changed" type="output-mismatch">
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	408 <![CDATA[--- $TESTTMP/test-failure.t
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	409 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	410 @@ -1,5 +1,5 @@
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	411 $ echo babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	412 - rataxes
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	413 + babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	414 This is a noop statement so that
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	415 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	416 pad pad pad pad............................................................
32734 ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32724 diff changeset	417 ]]> </failure>
ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32724 diff changeset	418 </testcase>
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	419 </testsuite>
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	420
29280 6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	421 $ cat .testtimes
35895 69d7fcd91696 testrunner: fix updating of .testtimes file Martin von Zweigbergk <martinvonz@google.com> parents: 35540 diff changeset	422 test-empty.t * (glob)
38554 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38302 diff changeset	423 test-failure-globs.t * (glob)
29280 6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	424 test-failure-unicode.t * (glob)
6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	425 test-failure.t * (glob)
6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	426 test-success.t * (glob)
32724 1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	427
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	428 $ rt --list-tests
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	429 test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	430 test-failure.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	431 test-success.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	432
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	433 $ rt --list-tests --json
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	434 test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	435 test-failure.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	436 test-success.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	437 $ cat report.json
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	438 testreport ={
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	439 "test-failure-unicode.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	440 "result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	441 },
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	442 "test-failure.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	443 "result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	444 },
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	445 "test-success.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	446 "result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	447 }
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	448 } (no-eol)
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	449
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	450 $ rt --list-tests --xunit=xunit.xml
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	451 test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	452 test-failure.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	453 test-success.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	454 $ cat xunit.xml
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	455 <?xml version="1.0" encoding="utf-8"?>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	456 <testsuite errors="0" failures="0" name="run-tests" skipped="0" tests="0">
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	457 <testcase name="test-failure-unicode.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	458 <testcase name="test-failure.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	459 <testcase name="test-success.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	460 </testsuite>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	461
32738 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	462 $ rt --list-tests test-failure* --json --xunit=xunit.xml --outputdir output
32724 1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	463 test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	464 test-failure.t
32738 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	465 $ cat output/report.json
32724 1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	466 testreport ={
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	467 "test-failure-unicode.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	468 "result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	469 },
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	470 "test-failure.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	471 "result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	472 }
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	473 } (no-eol)
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	474 $ cat xunit.xml
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	475 <?xml version="1.0" encoding="utf-8"?>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	476 <testsuite errors="0" failures="0" name="run-tests" skipped="0" tests="0">
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	477 <testcase name="test-failure-unicode.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	478 <testcase name="test-failure.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	479 </testsuite>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32645 diff changeset	480
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	481 $ rm test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	482
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	483 test for --retest
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	484 ====================
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	485
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	486 $ rt --retest
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	487
23348 bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	488 --- $TESTTMP/test-failure.t
bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	489 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	490 @@ -1,5 +1,5 @@
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	491 $ echo babar
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	492 - rataxes
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	493 + babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	494 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	495 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	496 pad pad pad pad............................................................
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	497
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	498 ERROR: test-failure.t output changed
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	499 !
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	500 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	501 # Ran 2 tests, 1 skipped, 1 failed.
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	502 python hash seed: * (glob)
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	503 [1]
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	504
32736 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	505 --retest works with --outputdir
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	506 $ rm -r output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	507 $ mkdir output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	508 $ mv test-failure.t.err output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	509 $ rt --retest --outputdir output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	510
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	511 --- $TESTTMP/test-failure.t
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	512 +++ $TESTTMP/output/test-failure.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	513 @@ -1,5 +1,5 @@
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	514 $ echo babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	515 - rataxes
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	516 + babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	517 This is a noop statement so that
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	518 this test is still more bytes than success.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	519 pad pad pad pad............................................................
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	520
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	521 ERROR: test-failure.t output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	522 !
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	523 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	524 # Ran 2 tests, 1 skipped, 1 failed.
32736 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	525 python hash seed: * (glob)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	526 [1]
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32735 diff changeset	527
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	528 Selecting Tests To Run
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	529 ======================
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	530
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	531 successful
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	532
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	533 $ rt test-success.t
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	534 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	535 # Ran 1 tests, 0 skipped, 0 failed.
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	536
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	537 success w/ keyword
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	538 $ rt -k xyzzy
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	539 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	540 # Ran 2 tests, 1 skipped, 0 failed.
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	541
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	542 failed
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	543
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	544 $ rt test-failure.t
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	545
23348 bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	546 --- $TESTTMP/test-failure.t
bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	547 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	548 @@ -1,5 +1,5 @@
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	549 $ echo babar
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	550 - rataxes
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	551 + babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	552 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	553 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	554 pad pad pad pad............................................................
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	555
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	556 ERROR: test-failure.t output changed
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	557 !
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	558 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	559 # Ran 1 tests, 0 skipped, 1 failed.
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	560 python hash seed: * (glob)
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	561 [1]
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	562
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	563 failure w/ keyword
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	564 $ rt -k rataxes
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	565
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	566 --- $TESTTMP/test-failure.t
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	567 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	568 @@ -1,5 +1,5 @@
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	569 $ echo babar
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	570 - rataxes
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	571 + babar
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	572 This is a noop statement so that
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	573 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	574 pad pad pad pad............................................................
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	575
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	576 ERROR: test-failure.t output changed
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	577 !
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	578 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	579 # Ran 2 tests, 1 skipped, 1 failed.
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	580 python hash seed: * (glob)
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	581 [1]
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	582
22840 ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	583 Verify that when a process fails to start we show a useful message
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	584 ==================================================================
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	585
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	586 $ cat > test-serve-fail.t <<EOF
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	587 > $ echo 'abort: child process failed to start blah'
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	588 > EOF
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	589 $ rt test-serve-fail.t
36491 51a9f0246931 run-tests: resume raising an exception when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 36468 diff changeset	590
36468 93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35895 diff changeset	591 --- $TESTTMP/test-serve-fail.t
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35895 diff changeset	592 +++ $TESTTMP/test-serve-fail.t.err
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35895 diff changeset	593 @@ -1* +1,2 @@ (glob)
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35895 diff changeset	594 $ echo 'abort: child process failed to start blah'
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35895 diff changeset	595 + abort: child process failed to start blah
22840 ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	596
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	597 ERROR: test-serve-fail.t output changed
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	598 !
36491 51a9f0246931 run-tests: resume raising an exception when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 36468 diff changeset	599 Failed test-serve-fail.t: server failed to start (HGPORT=*) (glob)
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	600 # Ran 1 tests, 0 skipped, 1 failed.
22840 ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	601 python hash seed: * (glob)
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	602 [1]
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	603 $ rm test-serve-fail.t
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	604
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	605 Verify that we can try other ports
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	606 ===================================
37434 3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36706 diff changeset	607
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36706 diff changeset	608 Extensions aren't inherited by the invoked run-tests.py. An extension
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36706 diff changeset	609 introducing a repository requirement could cause this to fail. So we force
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36706 diff changeset	610 HGRCPATH to get a clean environment.
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36706 diff changeset	611
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36706 diff changeset	612 $ HGRCPATH= hg init inuse
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	613 $ hg serve -R inuse -p $HGPORT -d --pid-file=blocks.pid
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	614 $ cat blocks.pid >> $DAEMON_PIDS
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	615 $ cat > test-serve-inuse.t <<EOF
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	616 > $ hg serve -R `pwd`/inuse -p \$HGPORT -d --pid-file=hg.pid
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	617 > $ cat hg.pid >> \$DAEMON_PIDS
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	618 > EOF
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	619 $ rt test-serve-inuse.t
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	620 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	621 # Ran 1 tests, 0 skipped, 0 failed.
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	622 $ rm test-serve-inuse.t
29221 73f58eb14684 test-run-tests: clean up inuse server eagerly timeless <timeless@mozdev.org> parents: 29220 diff changeset	623 $ killdaemons.py $DAEMON_PIDS
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	624
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	625 Running In Debug Mode
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	626 ======================
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	627
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	628 $ rt --debug 2>&1 \| grep -v pwd
23676 e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	629 + echo SALT 0 0 (glob)
e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	630 SALT 0 0 (glob)
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	631 + echo babar
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	632 babar
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	633 + echo SALT 10 0 (glob)
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	634 SALT 10 0 (glob)
27509 6ff90d618d72 test-run-tests: glob away a --debug run difference on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 27395 diff changeset	635 + echo SALT* 0 0 (glob)
23676 e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	636 SALT 0 0 (glob)
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	637 + echo babar
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	638 babar
23676 e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	639 + echo SALT 2 0 (glob)
e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	640 SALT 2 0 (glob)
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	641 + echo xyzzy
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	642 xyzzy
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	643 + echo SALT 9 0 (glob)
220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	644 SALT 9 0 (glob)
28317 8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	645 + printf abc\ndef\nxyz\n (glob)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	646 abc
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	647 def
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	648 xyz
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	649 + echo SALT 15 0 (glob)
220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31678 diff changeset	650 SALT 15 0 (glob)
31829 4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	651 + printf zyx\nwvu\ntsr\n (glob)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	652 zyx
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	653 wvu
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	654 tsr
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	655 + echo SALT 22 0 (glob)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	656 SALT 22 0 (glob)
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	657 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	658 # Ran 2 tests, 0 skipped, 0 failed.
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	659
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	660 Parallel runs
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	661 ==============
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	662
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	663 (duplicate the failing test to get predictable output)
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	664 $ cp test-failure.t test-failure-copy.t
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	665
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	666 $ rt --jobs 2 test-failure*.t -n
23107 5459b30aa498 tests: silence output race in test-run-tests.t Matt Mackall <mpm@selenic.com> parents: 22840 diff changeset	667 !!
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	668 Failed test-failure*.t: output changed (glob)
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	669 Failed test-failure*.t: output changed (glob)
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	670 # Ran 2 tests, 0 skipped, 2 failed.
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	671 python hash seed: * (glob)
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	672 [1]
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	673
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	674 failures in parallel with --first should only print one failure
34894 b63a7d839c33 tests: de-flake test-run-tests.t's "--jobs=2 --first" test Martin von Zweigbergk <martinvonz@google.com> parents: 34842 diff changeset	675 $ rt --jobs 2 --first test-failure*.t
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	676
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	677 --- $TESTTMP/test-failure*.t (glob)
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	678 +++ $TESTTMP/test-failure*.t.err (glob)
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	679 @@ -1,5 +1,5 @@
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	680 $ echo babar
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	681 - rataxes
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	682 + babar
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	683 This is a noop statement so that
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	684 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	685 pad pad pad pad............................................................
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	686
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	687 Failed test-failure*.t: output changed (glob)
34894 b63a7d839c33 tests: de-flake test-run-tests.t's "--jobs=2 --first" test Martin von Zweigbergk <martinvonz@google.com> parents: 34842 diff changeset	688 Failed test-failure*.t: output changed (glob)
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	689 # Ran 2 tests, 0 skipped, 2 failed.
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	690 python hash seed: * (glob)
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	691 [1]
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	692
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	693
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	694 (delete the duplicated test file)
34894 b63a7d839c33 tests: de-flake test-run-tests.t's "--jobs=2 --first" test Martin von Zweigbergk <martinvonz@google.com> parents: 34842 diff changeset	695 $ rm test-failure-copy.t
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	696
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	697
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	698 Interactive run
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	699 ===============
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	700
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	701 (backup the failing test)
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	702 $ cp test-failure.t backup
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	703
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	704 Refuse the fix
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	705
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	706 $ echo 'n' \| rt -i
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	707
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	708 --- $TESTTMP/test-failure.t
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	709 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	710 @@ -1,5 +1,5 @@
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	711 $ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	712 - rataxes
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	713 + babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	714 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	715 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	716 pad pad pad pad............................................................
21763 84cd5ee787ed run-tests: hold iolock across diff/prompt when interactive Matt Mackall <mpm@selenic.com> parents: 21756 diff changeset	717 Accept this change? [n]
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	718 ERROR: test-failure.t output changed
21763 84cd5ee787ed run-tests: hold iolock across diff/prompt when interactive Matt Mackall <mpm@selenic.com> parents: 21756 diff changeset	719 !.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	720 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	721 # Ran 2 tests, 0 skipped, 1 failed.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	722 python hash seed: * (glob)
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	723 [1]
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	724
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	725 $ cat test-failure.t
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	726 $ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	727 rataxes
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	728 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	729 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	730 pad pad pad pad............................................................
c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	731 pad pad pad pad............................................................
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	732 pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	733 pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	734 pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	735 pad pad pad pad............................................................
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	736
22361 eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	737 Interactive with custom view
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	738
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	739 $ echo 'n' \| rt -i --view echo
35400 4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35398 diff changeset	740 $TESTTMP/test-failure.t $TESTTMP/test-failure.t.err
22361 eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	741 Accept this change? [n]* (glob)
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	742 ERROR: test-failure.t output changed
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	743 !.
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	744 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	745 # Ran 2 tests, 0 skipped, 1 failed.
22361 eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	746 python hash seed: * (glob)
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	747 [1]
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	748
22108 ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	749 View the fix
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	750
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	751 $ echo 'y' \| rt --view echo
35400 4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35398 diff changeset	752 $TESTTMP/test-failure.t $TESTTMP/test-failure.t.err
22108 ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	753
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	754 ERROR: test-failure.t output changed
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	755 !.
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	756 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	757 # Ran 2 tests, 0 skipped, 1 failed.
22108 ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	758 python hash seed: * (glob)
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	759 [1]
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	760
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	761 Accept the fix
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	762
35423 417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	763 $ cat >> test-failure.t <<EOF
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	764 > $ echo 'saved backup bundle to \$TESTTMP/foo.hg'
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	765 > saved backup bundle to \$TESTTMP/foo.hg
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	766 > $ echo 'saved backup bundle to \$TESTTMP/foo.hg'
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	767 > saved backup bundle to $TESTTMP\\foo.hg
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	768 > $ echo 'saved backup bundle to \$TESTTMP/foo.hg'
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	769 > saved backup bundle to \$TESTTMP/*.hg (glob)
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35400 diff changeset	770 > EOF
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	771 $ echo 'y' \| rt -i 2>&1
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	772
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	773 --- $TESTTMP/test-failure.t
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	774 +++ $TESTTMP/test-failure.t.err
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	775 @@ -1,5 +1,5 @@
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	776 $ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	777 - rataxes
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	778 + babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	779 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	780 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	781 pad pad pad pad............................................................
35398 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	782 @@ -11,6 +11,6 @@
0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	783 $ echo 'saved backup bundle to $TESTTMP/foo.hg'
0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	784 saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	785 $ echo 'saved backup bundle to $TESTTMP/foo.hg'
35398 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	786 - saved backup bundle to $TESTTMP\foo.hg
0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	787 + saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	788 $ echo 'saved backup bundle to $TESTTMP/foo.hg'
35398 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	789 saved backup bundle to $TESTTMP/*.hg (glob)
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	790 Accept this change? [n] ..
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	791 # Ran 2 tests, 0 skipped, 0 failed.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	792
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	793 $ sed -e 's,(glob)$,&<,g' test-failure.t
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	794 $ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	795 babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	796 This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	797 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	798 pad pad pad pad............................................................
c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	799 pad pad pad pad............................................................
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	800 pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	801 pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	802 pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	803 pad pad pad pad............................................................
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	804 $ echo 'saved backup bundle to $TESTTMP/foo.hg'
35398 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	805 saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	806 $ echo 'saved backup bundle to $TESTTMP/foo.hg'
35398 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35395 diff changeset	807 saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	808 $ echo 'saved backup bundle to $TESTTMP/foo.hg'
31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	809 saved backup bundle to $TESTTMP/*.hg (glob)<
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	810
32998 8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	811 Race condition - test file was modified when test is running
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	812
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	813 $ TESTRACEDIR=`pwd`
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	814 $ export TESTRACEDIR
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	815 $ cat > test-race.t <<EOF
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	816 > $ echo 1
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	817 > $ echo "# a new line" >> $TESTRACEDIR/test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	818 > EOF
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	819
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	820 $ rt -i test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	821
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	822 --- $TESTTMP/test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	823 +++ $TESTTMP/test-race.t.err
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	824 @@ -1,2 +1,3 @@
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	825 $ echo 1
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	826 + 1
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	827 $ echo "# a new line" >> $TESTTMP/test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	828 Reference output has changed (run again to prompt changes)
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	829 ERROR: test-race.t output changed
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	830 !
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	831 Failed test-race.t: output changed
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	832 # Ran 1 tests, 0 skipped, 1 failed.
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	833 python hash seed: * (glob)
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	834 [1]
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	835
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	836 $ rm test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32960 diff changeset	837
33000 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	838 When "#testcases" is used in .t files
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	839
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	840 $ cat >> test-cases.t <<EOF
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	841 > #testcases a b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	842 > #if a
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	843 > $ echo 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	844 > #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	845 > #if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	846 > $ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	847 > #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	848 > EOF
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	849
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	850 $ cat <<EOF \| rt -i test-cases.t 2>&1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	851 > y
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	852 > y
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	853 > EOF
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	854
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	855 --- $TESTTMP/test-cases.t
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	856 +++ $TESTTMP/test-cases.t.a.err
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	857 @@ -1,6 +1,7 @@
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	858 #testcases a b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	859 #if a
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	860 $ echo 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	861 + 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	862 #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	863 #if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	864 $ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	865 Accept this change? [n] .
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	866 --- $TESTTMP/test-cases.t
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	867 +++ $TESTTMP/test-cases.t.b.err
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	868 @@ -5,4 +5,5 @@
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	869 #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	870 #if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	871 $ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	872 + 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	873 #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	874 Accept this change? [n] .
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	875 # Ran 2 tests, 0 skipped, 0 failed.
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	876
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	877 $ cat test-cases.t
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	878 #testcases a b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	879 #if a
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	880 $ echo 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	881 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	882 #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	883 #if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	884 $ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	885 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	886 #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	887
33952 6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	888 $ cat >> test-cases.t <<'EOF'
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	889 > #if a
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	890 > $ NAME=A
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	891 > #else
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	892 > $ NAME=B
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	893 > #endif
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	894 > $ echo $NAME
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	895 > A (a !)
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	896 > B (b !)
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	897 > EOF
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	898 $ rt test-cases.t
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	899 ..
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	900 # Ran 2 tests, 0 skipped, 0 failed.
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33835 diff changeset	901
33000 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	902 $ rm test-cases.t
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32998 diff changeset	903
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	904 (reinstall)
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	905 $ mv backup test-failure.t
21756 f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	906
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	907 No Diff
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	908 ===============
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	909
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	910 $ rt --nodiff
21756 f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	911 !.
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	912 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	913 # Ran 2 tests, 0 skipped, 1 failed.
21756 f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	914 python hash seed: * (glob)
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	915 [1]
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	916
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	917 test --tmpdir support
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	918 $ rt --tmpdir=$TESTTMP/keep test-success.t
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	919
35400 4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35398 diff changeset	920 Keeping testtmp dir: $TESTTMP/keep/child1/test-success.t
4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35398 diff changeset	921 Keeping threadtmp dir: $TESTTMP/keep/child1
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	922 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	923 # Ran 1 tests, 0 skipped, 0 failed.
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	924
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	925 timeouts
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	926 ========
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	927 $ cat > test-timeout.t <<EOF
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	928 > $ sleep 2
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	929 > $ echo pass
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	930 > pass
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	931 > EOF
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	932 > echo '#require slow' > test-slow-timeout.t
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	933 > cat test-timeout.t >> test-slow-timeout.t
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	934 $ rt --timeout=1 --slowtimeout=3 test-timeout.t test-slow-timeout.t
27393 a40b623e6380 run-tests: report timeouts in a less alarming fashion Matt Mackall <mpm@selenic.com> parents: 27141 diff changeset	935 st
32507 c2b7fb580794 tests: hint how to run slow tests when rejecting Kyle Lippincott <spectral@google.com> parents: 32356 diff changeset	936 Skipped test-slow-timeout.t: missing feature: allow slow tests (use --allow-slow-tests)
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	937 Failed test-timeout.t: timed out
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	938 # Ran 1 tests, 1 skipped, 1 failed.
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	939 python hash seed: * (glob)
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	940 [1]
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	941 $ rt --timeout=1 --slowtimeout=3 \
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	942 > test-timeout.t test-slow-timeout.t --allow-slow-tests
27393 a40b623e6380 run-tests: report timeouts in a less alarming fashion Matt Mackall <mpm@selenic.com> parents: 27141 diff changeset	943 .t
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	944 Failed test-timeout.t: timed out
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	945 # Ran 2 tests, 0 skipped, 1 failed.
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	946 python hash seed: * (glob)
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	947 [1]
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	948 $ rm test-timeout.t test-slow-timeout.t
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	949
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	950 test for --time
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	951 ==================
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	952
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	953 $ rt test-success.t --time
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	954 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	955 # Ran 1 tests, 0 skipped, 0 failed.
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	956 # Producing time report
25098 bf84ab53c2fd run-tests: include 'start' and 'end' in --time output Pierre-Yves David <pierre-yves.david@fb.com> parents: 25097 diff changeset	957 start end cuser csys real Test
bf84ab53c2fd run-tests: include 'start' and 'end' in --time output Pierre-Yves David <pierre-yves.david@fb.com> parents: 25097 diff changeset	958 \s[\d\.]{5} \s[\d\.]{5} \s[\d\.]{5} \s[\d\.]{5} \s*[\d\.]{5} test-success.t (re)
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	959
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	960 test for --time with --job enabled
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	961 ====================================
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	962
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	963 $ rt test-success.t --time --jobs 2
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	964 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	965 # Ran 1 tests, 0 skipped, 0 failed.
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	966 # Producing time report
25098 bf84ab53c2fd run-tests: include 'start' and 'end' in --time output Pierre-Yves David <pierre-yves.david@fb.com> parents: 25097 diff changeset	967 start end cuser csys real Test
bf84ab53c2fd run-tests: include 'start' and 'end' in --time output Pierre-Yves David <pierre-yves.david@fb.com> parents: 25097 diff changeset	968 \s[\d\.]{5} \s[\d\.]{5} \s[\d\.]{5} \s[\d\.]{5} \s*[\d\.]{5} test-success.t (re)
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	969
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	970 Skips
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	971 ================
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	972 $ cat > test-skip.t <<EOF
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	973 > $ echo xyzzy
36706 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	974 > #if true
22045 769198c6a62d run-tests: add #require to abort full test Matt Mackall <mpm@selenic.com> parents: 22044 diff changeset	975 > #require false
36706 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	976 > #end
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	977 > EOF
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	978 $ cat > test-noskip.t <<EOF
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	979 > #if false
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	980 > #require false
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	981 > #endif
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	982 > EOF
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	983 $ rt --nodiff
36706 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	984 !.s.
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	985 Skipped test-skip.t: missing feature: nail clipper
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	986 Failed test-failure.t: output changed
36706 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	987 # Ran 3 tests, 1 skipped, 1 failed.
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	988 python hash seed: * (glob)
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	989 [1]
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	990
36706 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36491 diff changeset	991 $ rm test-noskip.t
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	992 $ rt --keyword xyzzy
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	993 .s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	994 Skipped test-skip.t: missing feature: nail clipper
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	995 # Ran 2 tests, 2 skipped, 0 failed.
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	996
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	997 Skips with xml
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	998 $ rt --keyword xyzzy \
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	999 > --xunit=xunit.xml
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	1000 .s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1001 Skipped test-skip.t: missing feature: nail clipper
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1002 # Ran 2 tests, 2 skipped, 0 failed.
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1003 $ cat xunit.xml
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1004 <?xml version="1.0" encoding="utf-8"?>
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	1005 <testsuite errors="0" failures="0" name="run-tests" skipped="2" tests="2">
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1006 <testcase name="test-success.t" time="*"/> (glob)
32735 a4d0e816a672 run-tests: add information about skipped tests to XUnit output Siddharth Agarwal <sid0@fb.com> parents: 32734 diff changeset	1007 <testcase name="test-skip.t">
a4d0e816a672 run-tests: add information about skipped tests to XUnit output Siddharth Agarwal <sid0@fb.com> parents: 32734 diff changeset	1008 <skipped>
a4d0e816a672 run-tests: add information about skipped tests to XUnit output Siddharth Agarwal <sid0@fb.com> parents: 32734 diff changeset	1009 <![CDATA[missing feature: nail clipper]]> </skipped>
a4d0e816a672 run-tests: add information about skipped tests to XUnit output Siddharth Agarwal <sid0@fb.com> parents: 32734 diff changeset	1010 </testcase>
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1011 </testsuite>
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1012
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1013 Missing skips or blacklisted skips don't count as executed:
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1014 $ echo test-failure.t > blacklist
27927 0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1015 $ rt --blacklist=blacklist --json\
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1016 > test-failure.t test-bogus.t
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1017 ss
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1018 Skipped test-bogus.t: Doesn't exist
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1019 Skipped test-failure.t: blacklisted
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1020 # Ran 0 tests, 2 skipped, 0 failed.
27927 0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1021 $ cat report.json
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1022 testreport ={
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1023 "test-bogus.t": {
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1024 "result": "skip"
29199 daff05dcd184 run-tests: handle json.dumps divergence timeless <timeless@mozdev.org> parents: 29173 diff changeset	1025 },
27927 0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1026 "test-failure.t": {
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1027 "result": "skip"
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1028 }
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1029 } (no-eol)
29173 fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1030
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1031 Whitelist trumps blacklist
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1032 $ echo test-failure.t > whitelist
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1033 $ rt --blacklist=blacklist --whitelist=whitelist --json\
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1034 > test-failure.t test-bogus.t
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1035 s
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1036 --- $TESTTMP/test-failure.t
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1037 +++ $TESTTMP/test-failure.t.err
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1038 @@ -1,5 +1,5 @@
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1039 $ echo babar
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1040 - rataxes
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1041 + babar
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1042 This is a noop statement so that
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1043 this test is still more bytes than success.
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1044 pad pad pad pad............................................................
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1045
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1046 ERROR: test-failure.t output changed
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1047 !
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1048 Skipped test-bogus.t: Doesn't exist
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1049 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1050 # Ran 1 tests, 1 skipped, 1 failed.
29173 fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1051 python hash seed: * (glob)
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1052 [1]
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1053
34270 1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1054 Ensure that --test-list causes only the tests listed in that file to
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1055 be executed.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1056 $ echo test-success.t >> onlytest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1057 $ rt --test-list=onlytest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1058 .
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1059 # Ran 1 tests, 0 skipped, 0 failed.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1060 $ echo test-bogus.t >> anothertest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1061 $ rt --test-list=onlytest --test-list=anothertest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1062 s.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1063 Skipped test-bogus.t: Doesn't exist
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1064 # Ran 1 tests, 1 skipped, 0 failed.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1065 $ rm onlytest anothertest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34058 diff changeset	1066
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1067 test for --json
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1068 ==================
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1069
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1070 $ rt --json
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1071
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1072 --- $TESTTMP/test-failure.t
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1073 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1074 @@ -1,5 +1,5 @@
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1075 $ echo babar
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1076 - rataxes
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1077 + babar
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1078 This is a noop statement so that
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1079 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1080 pad pad pad pad............................................................
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1081
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1082 ERROR: test-failure.t output changed
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1083 !.s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1084 Skipped test-skip.t: missing feature: nail clipper
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1085 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1086 # Ran 2 tests, 1 skipped, 1 failed.
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1087 python hash seed: * (glob)
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1088 [1]
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1089
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1090 $ cat report.json
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1091 testreport ={
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1092 "test-failure.t": [\{] (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1093 "csys": "\s*[\d\.]{4,5}", ? (re)
d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1094 "cuser": "\s*[\d\.]{4,5}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1095 "diff": "---.+\+\+\+.+", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1096 "end": "\s*[\d\.]{4,5}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1097 "result": "failure", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1098 "start": "\s*[\d\.]{4,5}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1099 "time": "\s*[\d\.]{4,5}" (re)
d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1100 }, ? (re)
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1101 "test-skip.t": {
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1102 "csys": "\s*[\d\.]{4,5}", ? (re)
d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1103 "cuser": "\s*[\d\.]{4,5}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1104 "diff": "", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1105 "end": "\s*[\d\.]{4,5}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1106 "result": "skip", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1107 "start": "\s*[\d\.]{4,5}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1108 "time": "\s*[\d\.]{4,5}" (re)
d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1109 }, ? (re)
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1110 "test-success.t": [\{] (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1111 "csys": "\s*[\d\.]{4,5}", ? (re)
d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1112 "cuser": "\s*[\d\.]{4,5}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1113 "diff": "", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1114 "end": "\s*[\d\.]{4,5}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1115 "result": "success", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1116 "start": "\s*[\d\.]{4,5}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1117 "time": "\s*[\d\.]{4,5}" (re)
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1118 }
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1119 } (no-eol)
32738 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1120 --json with --outputdir
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1121
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1122 $ rm report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1123 $ rm -r output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1124 $ mkdir output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1125 $ rt --json --outputdir output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1126
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1127 --- $TESTTMP/test-failure.t
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1128 +++ $TESTTMP/output/test-failure.t.err
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1129 @@ -1,5 +1,5 @@
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1130 $ echo babar
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1131 - rataxes
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1132 + babar
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1133 This is a noop statement so that
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1134 this test is still more bytes than success.
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1135 pad pad pad pad............................................................
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1136
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1137 ERROR: test-failure.t output changed
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1138 !.s
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1139 Skipped test-skip.t: missing feature: nail clipper
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1140 Failed test-failure.t: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1141 # Ran 2 tests, 1 skipped, 1 failed.
32738 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1142 python hash seed: * (glob)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1143 [1]
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1144 $ f report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1145 report.json: file not found
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1146 $ cat output/report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1147 testreport ={
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1148 "test-failure.t": [\{] (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1149 "csys": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1150 "cuser": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1151 "diff": "---.+\+\+\+.+", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1152 "end": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1153 "result": "failure", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1154 "start": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1155 "time": "\s*[\d\.]{4,5}" (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1156 }, ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1157 "test-skip.t": {
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1158 "csys": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1159 "cuser": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1160 "diff": "", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1161 "end": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1162 "result": "skip", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1163 "start": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1164 "time": "\s*[\d\.]{4,5}" (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1165 }, ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1166 "test-success.t": [\{] (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1167 "csys": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1168 "cuser": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1169 "diff": "", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1170 "end": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1171 "result": "success", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1172 "start": "\s*[\d\.]{4,5}", ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1173 "time": "\s*[\d\.]{4,5}" (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1174 }
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1175 } (no-eol)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1176 $ ls -a output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1177 .
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1178 ..
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1179 .testtimes
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1180 report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32737 diff changeset	1181 test-failure.t.err
22579 36a940d82f88 test: protect the run-tests.py --json test behind an hghave rule Pierre-Yves David <pierre-yves.david@fb.com> parents: 22486 diff changeset	1182
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1183 Test that failed test accepted through interactive are properly reported:
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1184
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1185 $ cp test-failure.t backup
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1186 $ echo y \| rt --json -i
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1187
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1188 --- $TESTTMP/test-failure.t
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1189 +++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1190 @@ -1,5 +1,5 @@
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1191 $ echo babar
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1192 - rataxes
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1193 + babar
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1194 This is a noop statement so that
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1195 this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1196 pad pad pad pad............................................................
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1197 Accept this change? [n] ..s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1198 Skipped test-skip.t: missing feature: nail clipper
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1199 # Ran 2 tests, 1 skipped, 0 failed.
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1200
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1201 $ cat report.json
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1202 testreport ={
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1203 "test-failure.t": [\{] (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1204 "csys": "\s*[\d\.]{4,5}", ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1205 "cuser": "\s*[\d\.]{4,5}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1206 "diff": "", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1207 "end": "\s*[\d\.]{4,5}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1208 "result": "success", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1209 "start": "\s*[\d\.]{4,5}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1210 "time": "\s*[\d\.]{4,5}" (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1211 }, ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1212 "test-skip.t": {
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1213 "csys": "\s*[\d\.]{4,5}", ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1214 "cuser": "\s*[\d\.]{4,5}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1215 "diff": "", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1216 "end": "\s*[\d\.]{4,5}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1217 "result": "skip", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1218 "start": "\s*[\d\.]{4,5}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1219 "time": "\s*[\d\.]{4,5}" (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1220 }, ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1221 "test-success.t": [\{] (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1222 "csys": "\s*[\d\.]{4,5}", ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1223 "cuser": "\s*[\d\.]{4,5}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1224 "diff": "", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1225 "end": "\s*[\d\.]{4,5}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1226 "result": "success", ? (re)
25097 a4fce7905721 run-tests: track start and end time of tests Pierre-Yves David <pierre-yves.david@fb.com> parents: 25054 diff changeset	1227 "start": "\s*[\d\.]{4,5}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1228 "time": "\s*[\d\.]{4,5}" (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1229 }
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1230 } (no-eol)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1231 $ mv backup test-failure.t
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1232
24811 a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1233 backslash on end of line with glob matching is handled properly
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1234
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1235 $ cat > test-glob-backslash.t << EOF
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1236 > $ echo 'foo bar \\'
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1237 > foo * \ (glob)
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1238 > EOF
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1239
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1240 $ rt test-glob-backslash.t
24811 a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1241 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1242 # Ran 1 tests, 0 skipped, 0 failed.
24811 a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1243
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1244 $ rm -f test-glob-backslash.t
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1245
31678 6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1246 Test globbing of local IP addresses
29518 348b2b9da703 run-tests: add support for using 127.0.0.1 as a glob Augie Fackler <raf@durin42.com> parents: 29280 diff changeset	1247 $ echo 172.16.18.1
31678 6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1248 $LOCALIP (glob)
6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1249 $ echo dead:beef::1
6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1250 $LOCALIP (glob)
29518 348b2b9da703 run-tests: add support for using 127.0.0.1 as a glob Augie Fackler <raf@durin42.com> parents: 29280 diff changeset	1251
25728 905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1252 Test reusability for third party tools
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1253 ======================================
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1254
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1255 $ mkdir "$TESTTMP"/anothertests
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1256 $ cd "$TESTTMP"/anothertests
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1257
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1258 test that `run-tests.py` can execute hghave, even if it runs not in
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1259 Mercurial source tree.
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1260
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1261 $ cat > test-hghave.t <<EOF
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1262 > #require true
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1263 > $ echo foo
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1264 > foo
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1265 > EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1266 $ rt test-hghave.t
25728 905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1267 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1268 # Ran 1 tests, 0 skipped, 0 failed.
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1269
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1270 test that RUNTESTDIR refers the directory, in which `run-tests.py` now
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1271 running is placed.
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1272
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1273 $ cat > test-runtestdir.t <<EOF
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1274 > - $TESTDIR, in which test-run-tests.t is placed
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1275 > - \$TESTDIR, in which test-runtestdir.t is placed (expanded at runtime)
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1276 > - \$RUNTESTDIR, in which run-tests.py is placed (expanded at runtime)
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1277 >
27057 c281c20ad0ad test-run-tests: conditionalize the $TESTDIR check for Windows separator Matt Harbison <matt_harbison@yahoo.com> parents: 26432 diff changeset	1278 > #if windows
c281c20ad0ad test-run-tests: conditionalize the $TESTDIR check for Windows separator Matt Harbison <matt_harbison@yahoo.com> parents: 26432 diff changeset	1279 > $ test "\$TESTDIR" = "$TESTTMP\anothertests"
c281c20ad0ad test-run-tests: conditionalize the $TESTDIR check for Windows separator Matt Harbison <matt_harbison@yahoo.com> parents: 26432 diff changeset	1280 > #else
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1281 > $ test "\$TESTDIR" = "$TESTTMP"/anothertests
27057 c281c20ad0ad test-run-tests: conditionalize the $TESTDIR check for Windows separator Matt Harbison <matt_harbison@yahoo.com> parents: 26432 diff changeset	1282 > #endif
35395 c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35250 diff changeset	1283 > If this prints a path, that means RUNTESTDIR didn't equal
c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35250 diff changeset	1284 > TESTDIR as it should have.
c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35250 diff changeset	1285 > $ test "\$RUNTESTDIR" = "$TESTDIR" \|\| echo "\$RUNTESTDIR"
c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35250 diff changeset	1286 > This should print the start of check-code. If this passes but the
c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35250 diff changeset	1287 > previous check failed, that means we found a copy of check-code at whatever
c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35250 diff changeset	1288 > RUNTESTSDIR ended up containing, even though it doesn't match TESTDIR.
32955 7fe1f9785c75 tests: sed away python #! in test-run-tests.t to avoid some upcoming insanity Augie Fackler <augie@google.com> parents: 32740 diff changeset	1289 > $ head -n 3 "\$RUNTESTDIR"/../contrib/check-code.py \| sed 's@.!.*python@#!USRBINENVPY@'
7fe1f9785c75 tests: sed away python #! in test-run-tests.t to avoid some upcoming insanity Augie Fackler <augie@google.com> parents: 32740 diff changeset	1290 > #!USRBINENVPY
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1291 > #
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1292 > # check-code - a style and portability checker for Mercurial
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1293 > EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1294 $ rt test-runtestdir.t
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1295 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1296 # Ran 1 tests, 0 skipped, 0 failed.
25730 c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1297
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1298 #if execbit
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1299
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1300 test that TESTDIR is referred in PATH
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1301
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1302 $ cat > custom-command.sh <<EOF
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1303 > #!/bin/sh
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1304 > echo "hello world"
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1305 > EOF
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1306 $ chmod +x custom-command.sh
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1307 $ cat > test-testdir-path.t <<EOF
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1308 > $ custom-command.sh
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1309 > hello world
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1310 > EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1311 $ rt test-testdir-path.t
25730 c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1312 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1313 # Ran 1 tests, 0 skipped, 0 failed.
25730 c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1314
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1315 #endif
26109 bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1316
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1317 test support for --allow-slow-tests
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1318 $ cat > test-very-slow-test.t <<EOF
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1319 > #require slow
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1320 > $ echo pass
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1321 > pass
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1322 > EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1323 $ rt test-very-slow-test.t
26109 bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1324 s
32507 c2b7fb580794 tests: hint how to run slow tests when rejecting Kyle Lippincott <spectral@google.com> parents: 32356 diff changeset	1325 Skipped test-very-slow-test.t: missing feature: allow slow tests (use --allow-slow-tests)
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1326 # Ran 0 tests, 1 skipped, 0 failed.
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1327 $ rt $HGTEST_RUN_TESTS_PURE --allow-slow-tests test-very-slow-test.t
26109 bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1328 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1329 # Ran 1 tests, 0 skipped, 0 failed.
28180 2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1330
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1331 support for running a test outside the current directory
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1332 $ mkdir nonlocal
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1333 $ cat > nonlocal/test-is-not-here.t << EOF
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1334 > $ echo pass
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1335 > pass
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1336 > EOF
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1337 $ rt nonlocal/test-is-not-here.t
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1338 .
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1339 # Ran 1 tests, 0 skipped, 0 failed.
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1340
35024 d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1341 support for automatically discovering test if arg is a folder
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1342 $ mkdir tmp && cd tmp
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1343
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1344 $ cat > test-uno.t << EOF
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1345 > $ echo line
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1346 > line
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1347 > EOF
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1348
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1349 $ cp test-uno.t test-dos.t
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1350 $ cd ..
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1351 $ cp -R tmp tmpp
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1352 $ cp tmp/test-uno.t test-solo.t
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1353
35250 2a99c5bfea47 test-run-tests: do not rebuild hg in the test Jun Wu <quark@fb.com> parents: 35200 diff changeset	1354 $ rt tmp/ test-solo.t tmpp
35024 d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1355 .....
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1356 # Ran 5 tests, 0 skipped, 0 failed.
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1357 $ rm -rf tmp tmpp
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35018 diff changeset	1358
35018 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1359 support for running run-tests.py from another directory
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1360 $ mkdir tmp && cd tmp
35120 fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1361
35018 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1362 $ cat > useful-file.sh << EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1363 > important command
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1364 > EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1365
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1366 $ cat > test-folder.t << EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1367 > $ cat \$TESTDIR/useful-file.sh
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1368 > important command
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1369 > EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1370
35120 fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1371 $ cat > test-folder-fail.t << EOF
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1372 > $ cat \$TESTDIR/useful-file.sh
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1373 > important commando
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1374 > EOF
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1375
35018 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1376 $ cd ..
35250 2a99c5bfea47 test-run-tests: do not rebuild hg in the test Jun Wu <quark@fb.com> parents: 35200 diff changeset	1377 $ rt tmp/test-*.t
35120 fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1378
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1379 --- $TESTTMP/anothertests/tmp/test-folder-fail.t
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1380 +++ $TESTTMP/anothertests/tmp/test-folder-fail.t.err
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1381 @@ -1,2 +1,2 @@
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1382 $ cat $TESTDIR/useful-file.sh
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1383 - important commando
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1384 + important command
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1385
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1386 ERROR: test-folder-fail.t output changed
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1387 !.
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1388 Failed test-folder-fail.t: output changed
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1389 # Ran 2 tests, 0 skipped, 1 failed.
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1390 python hash seed: * (glob)
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35092 diff changeset	1391 [1]
35018 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1392
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1393 support for bisecting failed tests automatically
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1394 $ hg init bisect
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1395 $ cd bisect
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1396 $ cat >> test-bisect.t <<EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1397 > $ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1398 > pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1399 > EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1400 $ hg add test-bisect.t
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1401 $ hg ci -m 'good'
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1402 $ cat >> test-bisect.t <<EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1403 > $ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1404 > fail
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1405 > EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1406 $ hg ci -m 'bad'
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1407 $ rt --known-good-rev=0 test-bisect.t
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1408
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1409 --- $TESTTMP/anothertests/bisect/test-bisect.t
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1410 +++ $TESTTMP/anothertests/bisect/test-bisect.t.err
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1411 @@ -1,4 +1,4 @@
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1412 $ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1413 pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1414 $ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1415 - fail
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1416 + pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1417
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1418 ERROR: test-bisect.t output changed
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1419 !
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1420 Failed test-bisect.t: output changed
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1421 test-bisect.t broken by 72cbf122d116 (bad)
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1422 # Ran 1 tests, 0 skipped, 1 failed.
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1423 python hash seed: * (glob)
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1424 [1]
32356 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1425
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1426 $ cd ..
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1427
34058 40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1428 support bisecting a separate repo
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1429
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1430 $ hg init bisect-dependent
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1431 $ cd bisect-dependent
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1432 $ cat > test-bisect-dependent.t <<EOF
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1433 > $ tail -1 \$TESTDIR/../bisect/test-bisect.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1434 > pass
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1435 > EOF
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1436 $ hg commit -Am dependent test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1437
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1438 $ rt --known-good-rev=0 test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1439
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1440 --- $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1441 +++ $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t.err
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1442 @@ -1,2 +1,2 @@
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1443 $ tail -1 $TESTDIR/../bisect/test-bisect.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1444 - pass
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1445 + fail
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1446
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1447 ERROR: test-bisect-dependent.t output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1448 !
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1449 Failed test-bisect-dependent.t: output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1450 Failed to identify failure point for test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1451 # Ran 1 tests, 0 skipped, 1 failed.
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1452 python hash seed: * (glob)
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1453 [1]
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1454
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1455 $ rt --bisect-repo=../test-bisect test-bisect-dependent.t
35198 b4b0aed7bfaf run-tests: convert to argparse Gregory Szorc <gregory.szorc@gmail.com> parents: 35176 diff changeset	1456 usage: run-tests.py [options] [tests]
34058 40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1457 run-tests.py: error: --bisect-repo cannot be used without --known-good-rev
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1458 [2]
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1459
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1460 $ rt --known-good-rev=0 --bisect-repo=../bisect test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1461
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1462 --- $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1463 +++ $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t.err
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1464 @@ -1,2 +1,2 @@
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1465 $ tail -1 $TESTDIR/../bisect/test-bisect.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1466 - pass
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1467 + fail
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1468
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1469 ERROR: test-bisect-dependent.t output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1470 !
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1471 Failed test-bisect-dependent.t: output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1472 test-bisect-dependent.t broken by 72cbf122d116 (bad)
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1473 # Ran 1 tests, 0 skipped, 1 failed.
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1474 python hash seed: * (glob)
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1475 [1]
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1476
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1477 $ cd ..
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33952 diff changeset	1478
32645 931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1479 Test a broken #if statement doesn't break run-tests threading.
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1480 ==============================================================
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1481 $ mkdir broken
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1482 $ cd broken
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1483 $ cat > test-broken.t <<EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1484 > true
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1485 > #if notarealhghavefeature
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1486 > $ false
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1487 > #endif
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1488 > EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1489 $ for f in 1 2 3 4 ; do
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1490 > cat > test-works-$f.t <<EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1491 > This is test case $f
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1492 > $ sleep 1
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1493 > EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1494 > done
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1495 $ rt -j 2
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1496 ....
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1497 # Ran 5 tests, 0 skipped, 0 failed.
32645 931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1498 skipped: unknown feature: notarealhghavefeature
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1499
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1500 $ cd ..
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1501 $ rm -rf broken
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32507 diff changeset	1502
32356 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1503 Test cases in .t files
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1504 ======================
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1505 $ mkdir cases
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1506 $ cd cases
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1507 $ cat > test-cases-abc.t <<'EOF'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1508 > #testcases A B C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1509 > $ V=B
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1510 > #if A
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1511 > $ V=A
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1512 > #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1513 > #if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1514 > $ V=C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1515 > #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1516 > $ echo $V \| sed 's/A/C/'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1517 > C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1518 > #if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1519 > $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1520 > #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1521 > #if A
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1522 > $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1523 > [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1524 > #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1525 > #if no-C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1526 > $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1527 > [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1528 > #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1529 > $ [ $V = D ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1530 > [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1531 > EOF
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1532 $ rt
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1533 .
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1534 --- $TESTTMP/anothertests/cases/test-cases-abc.t
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1535 +++ $TESTTMP/anothertests/cases/test-cases-abc.t.B.err
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1536 @@ -7,7 +7,7 @@
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1537 $ V=C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1538 #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1539 $ echo $V \| sed 's/A/C/'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1540 - C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1541 + B
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1542 #if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1543 $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1544 #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1545
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1546 ERROR: test-cases-abc.t#B output changed
32356 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1547 !.
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1548 Failed test-cases-abc.t#B: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1549 # Ran 3 tests, 0 skipped, 1 failed.
32356 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1550 python hash seed: * (glob)
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1551 [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1552
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1553 --restart works
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1554
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1555 $ rt --restart
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1556
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1557 --- $TESTTMP/anothertests/cases/test-cases-abc.t
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1558 +++ $TESTTMP/anothertests/cases/test-cases-abc.t.B.err
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1559 @@ -7,7 +7,7 @@
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1560 $ V=C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1561 #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1562 $ echo $V \| sed 's/A/C/'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1563 - C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1564 + B
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1565 #if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1566 $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1567 #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1568
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1569 ERROR: test-cases-abc.t#B output changed
32356 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1570 !.
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1571 Failed test-cases-abc.t#B: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1572 # Ran 2 tests, 0 skipped, 1 failed.
32356 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1573 python hash seed: * (glob)
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1574 [1]
32740 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1575
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1576 --restart works with outputdir
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1577
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1578 $ mkdir output
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1579 $ mv test-cases-abc.t.B.err output
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1580 $ rt --restart --outputdir output
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1581
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1582 --- $TESTTMP/anothertests/cases/test-cases-abc.t
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1583 +++ $TESTTMP/anothertests/cases/output/test-cases-abc.t.B.err
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1584 @@ -7,7 +7,7 @@
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1585 $ V=C
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1586 #endif
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1587 $ echo $V \| sed 's/A/C/'
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1588 - C
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1589 + B
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1590 #if C
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1591 $ [ $V = C ]
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1592 #endif
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1593
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1594 ERROR: test-cases-abc.t#B output changed
32740 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1595 !.
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1596 Failed test-cases-abc.t#B: output changed
32960 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32955 diff changeset	1597 # Ran 2 tests, 0 skipped, 1 failed.
32740 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1598 python hash seed: * (glob)
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32738 diff changeset	1599 [1]
35092 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1600
35540 f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1601 Test TESTCASE variable
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1602
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1603 $ cat > test-cases-ab.t <<'EOF'
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1604 > $ dostuff() {
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1605 > > echo "In case $TESTCASE"
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1606 > > }
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1607 > #testcases A B
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1608 > #if A
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1609 > $ dostuff
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1610 > In case A
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1611 > #endif
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1612 > #if B
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1613 > $ dostuff
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1614 > In case B
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1615 > #endif
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1616 > EOF
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1617 $ rt test-cases-ab.t
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1618 ..
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1619 # Ran 2 tests, 0 skipped, 0 failed.
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35423 diff changeset	1620
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1621 Support running a specific test case
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1622
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1623 $ rt "test-cases-abc.t#B"
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1624
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1625 --- $TESTTMP/anothertests/cases/test-cases-abc.t
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1626 +++ $TESTTMP/anothertests/cases/test-cases-abc.t.B.err
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1627 @@ -7,7 +7,7 @@
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1628 $ V=C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1629 #endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1630 $ echo $V \| sed 's/A/C/'
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1631 - C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1632 + B
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1633 #if C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1634 $ [ $V = C ]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1635 #endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1636
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1637 ERROR: test-cases-abc.t#B output changed
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1638 !
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1639 Failed test-cases-abc.t#B: output changed
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1640 # Ran 1 tests, 0 skipped, 1 failed.
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1641 python hash seed: * (glob)
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1642 [1]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1643
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1644 Support running multiple test cases in the same file
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1645
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1646 $ rt test-cases-abc.t#B test-cases-abc.t#C
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1647
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1648 --- $TESTTMP/anothertests/cases/test-cases-abc.t
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1649 +++ $TESTTMP/anothertests/cases/test-cases-abc.t.B.err
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1650 @@ -7,7 +7,7 @@
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1651 $ V=C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1652 #endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1653 $ echo $V \| sed 's/A/C/'
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1654 - C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1655 + B
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1656 #if C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1657 $ [ $V = C ]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1658 #endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1659
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1660 ERROR: test-cases-abc.t#B output changed
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1661 !.
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1662 Failed test-cases-abc.t#B: output changed
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1663 # Ran 2 tests, 0 skipped, 1 failed.
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1664 python hash seed: * (glob)
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1665 [1]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1666
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1667 Support ignoring invalid test cases
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1668
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1669 $ rt test-cases-abc.t#B test-cases-abc.t#D
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1670
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1671 --- $TESTTMP/anothertests/cases/test-cases-abc.t
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1672 +++ $TESTTMP/anothertests/cases/test-cases-abc.t.B.err
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1673 @@ -7,7 +7,7 @@
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1674 $ V=C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1675 #endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1676 $ echo $V \| sed 's/A/C/'
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1677 - C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1678 + B
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1679 #if C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1680 $ [ $V = C ]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1681 #endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1682
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1683 ERROR: test-cases-abc.t#B output changed
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1684 !
38235 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38234 diff changeset	1685 Failed test-cases-abc.t#B: output changed
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1686 # Ran 1 tests, 0 skipped, 1 failed.
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1687 python hash seed: * (glob)
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1688 [1]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1689
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1690 Support running complex test cases names
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1691
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1692 $ cat > test-cases-advanced-cases.t <<'EOF'
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1693 > #testcases simple case-with-dashes casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1694 > $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1695 > simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1696 > EOF
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1697
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1698 $ cat test-cases-advanced-cases.t
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1699 #testcases simple case-with-dashes casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1700 $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1701 simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1702
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1703 $ rt test-cases-advanced-cases.t
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1704
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1705 --- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1706 +++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t.case-with-dashes.err
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1707 @@ -1,3 +1,3 @@
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1708 #testcases simple case-with-dashes casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1709 $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1710 - simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1711 + case-with-dashes
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1712
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1713 ERROR: test-cases-advanced-cases.t#case-with-dashes output changed
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1714 !
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1715 --- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1716 +++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t.casewith_-.chars.err
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1717 @@ -1,3 +1,3 @@
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1718 #testcases simple case-with-dashes casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1719 $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1720 - simple
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1721 + casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1722
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1723 ERROR: test-cases-advanced-cases.t#casewith_-.chars output changed
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1724 !.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1725 Failed test-cases-advanced-cases.t#case-with-dashes: output changed
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1726 Failed test-cases-advanced-cases.t#casewith_-.chars: output changed
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1727 # Ran 3 tests, 0 skipped, 2 failed.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1728 python hash seed: * (glob)
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1729 [1]
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1730
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1731 $ rt "test-cases-advanced-cases.t#case-with-dashes"
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1732
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1733 --- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1734 +++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t.case-with-dashes.err
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1735 @@ -1,3 +1,3 @@
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1736 #testcases simple case-with-dashes casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1737 $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1738 - simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1739 + case-with-dashes
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1740
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1741 ERROR: test-cases-advanced-cases.t#case-with-dashes output changed
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1742 !
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1743 Failed test-cases-advanced-cases.t#case-with-dashes: output changed
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1744 # Ran 1 tests, 0 skipped, 1 failed.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1745 python hash seed: * (glob)
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1746 [1]
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1747
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1748 $ rt "test-cases-advanced-cases.t#casewith_-.chars"
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1749
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1750 --- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1751 +++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t.casewith_-.chars.err
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1752 @@ -1,3 +1,3 @@
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1753 #testcases simple case-with-dashes casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1754 $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1755 - simple
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1756 + casewith_-.chars
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1757
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1758 ERROR: test-cases-advanced-cases.t#casewith_-.chars output changed
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1759 !
38302 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38257 diff changeset	1760 Failed test-cases-advanced-cases.t#casewith_-.chars: output changed
38257 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1761 # Ran 1 tests, 0 skipped, 1 failed.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1762 python hash seed: * (glob)
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1763 [1]
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38235 diff changeset	1764
35092 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1765 Test automatic pattern replacement
38234 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37892 diff changeset	1766 ==================================
35092 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1767
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1768 $ cat << EOF >> common-pattern.py
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1769 > substitutions = [
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1770 > (br'foo-(.*)\\b',
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1771 > br'\$XXX=\\1\$'),
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1772 > (br'bar\\n',
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1773 > br'\$YYY$\\n'),
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1774 > ]
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1775 > EOF
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1776
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1777 $ cat << EOF >> test-substitution.t
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1778 > $ echo foo-12
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1779 > \$XXX=12$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1780 > $ echo foo-42
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1781 > \$XXX=42$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1782 > $ echo bar prior
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1783 > bar prior
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1784 > $ echo lastbar
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1785 > last\$YYY$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1786 > $ echo foo-bar foo-baz
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1787 > EOF
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1788
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1789 $ rt test-substitution.t
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1790
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1791 --- $TESTTMP/anothertests/cases/test-substitution.t
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1792 +++ $TESTTMP/anothertests/cases/test-substitution.t.err
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1793 @@ -7,3 +7,4 @@
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1794 $ echo lastbar
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1795 last$YYY$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1796 $ echo foo-bar foo-baz
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1797 + $XXX=bar foo-baz$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1798
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1799 ERROR: test-substitution.t output changed
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1800 !
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1801 Failed test-substitution.t: output changed
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1802 # Ran 1 tests, 0 skipped, 1 failed.
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1803 python hash seed: * (glob)
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 35024 diff changeset	1804 [1]
35200 073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1805
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1806 --extra-config-opt works
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1807
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1808 $ cat << EOF >> test-config-opt.t
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1809 > $ hg init test-config-opt
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1810 > $ hg -R test-config-opt purge
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1811 > EOF
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1812
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1813 $ rt --extra-config-opt extensions.purge= test-config-opt.t
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1814 .
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35198 diff changeset	1815 # Ran 1 tests, 0 skipped, 0 failed.

Mercurial > public > mercurial-scm > hg-stable

annotate tests/test-run-tests.t @ 38554:3fb46734508d