support platform config for virtual tests
Added platform config to allow devs to specify on which platforms
to run a virtual test suites, in the hope we can reduce the number
of tests on some platforms.
Update the documentation also.
Bug: 1234863
Change-Id: I2470671b5efb774275bca83da72d5ef6b698e0aa
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/3530131
Reviewed-by: Xianzhu Wang <[email protected]>
Commit-Queue: Weizhong Xia <[email protected]>
Cr-Commit-Position: refs/heads/main@{#984521}
diff --git a/docs/testing/web_tests.md b/docs/testing/web_tests.md
index 1a702bcb..010e27f 100644
--- a/docs/testing/web_tests.md
+++ b/docs/testing/web_tests.md
@@ -278,6 +278,7 @@
```json
{
"prefix": "blocking_repaint",
+ "platforms": ["Linux", "Mac", "Win"],
"bases": ["compositing", "fast/repaint"],
"args": ["--blocking-repaint"]
}
@@ -310,6 +311,10 @@
This will also let any real tests under `web_tests/virtual/blocking_repaint`
directory run with the `--blocking-repaint` flag.
+The "platforms" configuration can be used to skip tests on some platforms. If
+a virtual test suites uses more than 5% of total test time, we should consider
+to skip the test suites on some platforms.
+
The "prefix" value should be unique. Multiple directories with the same flags
should be listed in the same "bases" list. The "bases" list can be empty,
in case that we just want to run the real tests under `virtual/<prefix>`
