forked from ray-project/ray
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[ci] add script to filter out flaky tests targets (ray-project#42717)
the script takes test target names from stdin, and filters out all flaky ones based on the test state in the database. this script is required for macos test invocation on the pipeline. --------- Signed-off-by: khluu <[email protected]> Signed-off-by: Lonnie Liu <[email protected]> Co-authored-by: Lonnie Liu <[email protected]>
Showing
4 changed files
with
143 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,30 @@ | ||
import sys | ||
|
||
from ci.ray_ci.utils import filter_out_flaky_tests | ||
from ray_release.configs.global_config import init_global_config | ||
from ray_release.bazel import bazel_runfile | ||
|
||
|
||
def main(): | ||
""" | ||
Filter out flaky tests. | ||
Input (stdin) as a list of test names. | ||
Output (stdout) as a list of test names without flaky tests. | ||
Args: | ||
prefix: Prefix to query tests with. | ||
""" | ||
# Process arguments | ||
if len(sys.argv) != 2: | ||
raise ValueError("Invalid number of arguments.") | ||
|
||
prefix = sys.argv[1] | ||
|
||
# Initialize global config | ||
init_global_config(bazel_runfile("release/ray_release/configs/oss_config.yaml")) | ||
|
||
filter_out_flaky_tests(sys.stdin, sys.stdout, prefix) | ||
|
||
|
||
if __name__ == "__main__": | ||
main() |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters