Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

019 optimise extraction #186

Merged
merged 67 commits into from
Jan 22, 2025
Merged

019 optimise extraction #186

merged 67 commits into from
Jan 22, 2025

Conversation

b-barton
Copy link
Collaborator

The code now takes the boundary points and identifies discrete chunks based on breaks in the boundary from land, corners or long diagonals. This will reduce the memory required for reading in source data as strips are taken rather than the whole domain. This also fixes the issue with a large source domain needed for a boundary or regional model that wraps the east-west line.

I've written unit tests for the new functionality which pass. The code runs with the AMM15 test case and produces a reasonable solution. The 1-2-1 filter made the solution marginally different from the master at the corners so this has been turned off to have a consistent solution regardless of chunks. This closes #19.

…e is still a problem with z_dist and/or z_ind that mean the results aren't identical
…d values in arithmetic and unaccounted for in self.z_dist holding array.
…ake it easier to find later. Removed some mroe prints
…tion to fix a bug with running the AMM15 example and get it ready to pull to master
@b-barton b-barton added the enhancement New feature or request label Jan 22, 2025
@b-barton b-barton requested a review from jdha January 22, 2025 13:45
@b-barton b-barton linked an issue Jan 22, 2025 that may be closed by this pull request
@b-barton b-barton self-assigned this Jan 22, 2025
Copy link
Collaborator

@jdha jdha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't gone through the extract routine changes in great detail - but happy to approve as it's reproducible. Would be interesting to know if there's any difference in the exception time between new and old code.

@b-barton b-barton merged commit cce1677 into master Jan 22, 2025
5 checks passed
@b-barton b-barton deleted the 019-optimise-extraction branch January 22, 2025 16:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Optimise extraction process
2 participants