Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: ignore flaky tests #947

Merged
merged 1 commit into from
Dec 20, 2024
Merged

fix: ignore flaky tests #947

merged 1 commit into from
Dec 20, 2024

Conversation

andysim3d
Copy link
Collaborator

[Closes/Fixes] #

Proposed Changes

Copy link

codecov bot commented Dec 20, 2024

Codecov Report

Attention: Patch coverage is 0% with 4 lines in your changes missing coverage. Please review.

Project coverage is 58.78%. Comparing base (e6440e0) to head (eb0f453).
Report is 1 commits behind head on main.

Files with missing lines Patch % Lines
crates/provider/src/alloy/mod.rs 0.00% 4 Missing ⚠️
Additional details and impacted files

Impacted file tree graph

Files with missing lines Coverage Δ
crates/provider/src/alloy/mod.rs 0.00% <0.00%> (-85.97%) ⬇️

... and 3 files with indirect coverage changes

Flag Coverage Δ
unit-tests 58.78% <0.00%> (-0.73%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
rundler binary 0.00% <ø> (ø)
builder 65.09% <ø> (ø)
dev ∅ <ø> (∅)
pool 66.20% <ø> (ø)
provider 19.47% <0.00%> (-6.75%) ⬇️
rpc 26.71% <ø> (ø)
sim 77.03% <ø> (ø)
tasks ∅ <ø> (∅)
types 67.61% <ø> (-2.06%) ⬇️
utils 30.06% <ø> (ø)

@@ -78,29 +78,30 @@ mod tests {

use crate::new_alloy_provider;
fn setup() {
let server = Server::http("0.0.0.0:8000").unwrap();
let server = Server::http("0.0.0.0:9009").unwrap();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm concerned that this will still be flaky in case something is using this port. Is there a way to let the OS assign an open port and retrieve it after? Sometimes this is done by setting the port to :0

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You may be able to use that and then do .server_addr to get the port it was bound to by the OS

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You may need to use bind and then from_listener to create the server.

Copy link
Collaborator Author

@andysim3d andysim3d Dec 20, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I mark the test to ignore for now. it should only run on local box.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, we should eventually fix this

@andysim3d andysim3d merged commit 2b5621d into main Dec 20, 2024
11 checks passed
@andysim3d andysim3d deleted the andy/fix-flaky-tests branch December 20, 2024 16:46
dancoombs pushed a commit that referenced this pull request Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants