Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

syncIO 'random access' #16

Open
cwsmith opened this issue Jan 17, 2017 · 0 comments
Open

syncIO 'random access' #16

cwsmith opened this issue Jan 17, 2017 · 0 comments

Comments

@cwsmith
Copy link
Contributor

cwsmith commented Jan 17, 2017

The functionality is already implemented but in two different ways for the old posix code and for the syncio code.

  • The syncio code relies on the lookup table stored in the master header to get the the right address of a field in the file. Currently, this lookup table is activat only when the phastaIO lib is used in parallel with global access from all ranks but we are clearly missing the interface for a single rank to access it independently from the other ranks (back to "serial processing" in the wish list)
  • The old posix code jumps from one field header to the next one (the size of the data block associated with each field is stored in its header between the < > signs) until it finds the target field. The current posix implementation cannot work with the current syncio files simply because it does not how to handle the master header (and jump over it). If the posix code starts a new search from its current location and has not found the target when it reaches the bottom of the files, it rewinds and start over until it finds the target (or reaches the starting point in the file and declare in this case that the field is missing).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant