Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

in splitCsv operator, allow specifying comment char #3632

Open
notestaff opened this issue Feb 9, 2023 · 3 comments
Open

in splitCsv operator, allow specifying comment char #3632

notestaff opened this issue Feb 9, 2023 · 3 comments

Comments

@notestaff
Copy link

In the splitCsv operator, can an option be added to specify a "comment char", such that lines starting with that char (e.g. '#') are ignored?
Thanks!

@bentsherman
Copy link
Member

Maybe something like the skiprows option in pandas.read_csv(): https://pandas.pydata.org/docs/reference/api/pandas.read_csv.html#pandas.read_csv

It can be a number to skip the first n lines, or a closure to filter lines e.g. based on a comment char

@bentsherman
Copy link
Member

Actually the splitCsv operator already has a skipLines option, so just need to extend it to allow a closure

@stale
Copy link

stale bot commented Aug 12, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants