Skip to content

Commit

Permalink
[tests] Skip bad ray memory call in shuffle nightly tests if it fails r…
Browse files Browse the repository at this point in the history
…ay-project#29403

ray memory sometimes fails if the cluster is under load. It's only used in the nightly test for debugging, so skip it if it fails.
  • Loading branch information
stephanie-wang authored Oct 19, 2022
1 parent 9575c17 commit 72c570e
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion release/nightly_tests/dataset/sort.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
import resource
import time
from typing import List
import traceback

import numpy as np
import psutil
Expand Down Expand Up @@ -134,7 +135,11 @@ def make_block(count: int, num_columns: int) -> Block:
rss = int(process.memory_info().rss)
print(f"rss: {rss / 1e9}/GB")

print(memory_summary(stats_only=True))
try:
print(memory_summary(stats_only=True))
except Exception:
print("Failed to retrieve memory summary")
print(traceback.format_exc())
print("")

print(ds.stats())
Expand Down

0 comments on commit 72c570e

Please sign in to comment.