Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Readers: PyTorch Reader #123

Open
wants to merge 8 commits into
base: develop
Choose a base branch
from
Open

Readers: PyTorch Reader #123

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
2f62801
initial commit
Jan 13, 2024
86bbfd7
minor
Jan 23, 2024
f41c674
changes for rank
adityaranjan Apr 9, 2024
2a2cbc1
parallelize
adityaranjan Apr 9, 2024
b800638
making filtering more concise
adityaranjan Apr 9, 2024
ef6bd05
added todos
adityaranjan Apr 9, 2024
dcb1402
fixes issue with same timestamps messing up the ordering of events
adityaranjan Apr 10, 2024
e2f3d04
cleaning up
adityaranjan Apr 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
added todos
  • Loading branch information
@adityaranjan
adityaranjan committed Apr 9, 2024
commit ef6bd05db58ca10e45e9436ccdb2ebefd80451c4
6 changes: 6 additions & 0 deletions pipit/readers/pytorch_reader.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,12 @@
import multiprocessing as mp


# TODO: also, all the columns need to be made numeric, categorical, etc
# TODO: compare with HTA tool reader
# TODO: add comments
# TODO: unit tests


class PytorchReader:
def __init__(self, dir_name, num_processes=None, create_cct=False):
self.dir_name = dir_name
Expand Down
Loading