Skip to content

Commit

Permalink
[Breaking] Switch text loading to multi-threaded PyArrow loading (hug…
Browse files Browse the repository at this point in the history
…gingface#548)

* Switch text loading to multi-threaded PyArrow loading

* updating script

* try to pin some dependencies for our benchmarks

* run benchmarks in venv

* test

* remove venv in benchmarks...

* try using python3

* revert pip install changes for dvc benchmarks

* go back to python instead of python3

Co-authored-by: Quentin Lhoest <[email protected]>
  • Loading branch information
thomwolf and lhoestq authored Sep 8, 2020
1 parent b74eed3 commit 6f74779
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -73,9 +73,10 @@
]

BENCHMARKS_REQUIRE = [
'tensorflow',
'torch',
'transformers',
'numpy==1.18.5',
'tensorflow==2.3.0',
'torch==1.6.0',
'transformers==3.0.2',
]

TESTS_REQUIRE = [
Expand Down

0 comments on commit 6f74779

Please sign in to comment.