Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 24, 2023

• fix partitioning

  ehsan

  committed
  77d15c6

• Implement distributed downloading

  ehsan

  committed
  a3516ab

• fix return statements

  

  Daiqing

  committed
  6496648

• catch exceptions

  

  Daiqing

  committed
  437671b

Commits on Nov 23, 2023

• return results back

  ehsan

  committed
  2e0748d

• use 8 threads

  ehsan

  committed
  42b1ec3

• count success/fail correctly

  ehsan

  committed
  46b62ea

• Merge branch 'ehsan/parallel_resize' of github.com:playgroundai/img2dataset into ehsan/parallel_resize

  

  Daiqing

  committed
  c3569e1

• fix var name

  ehsan

  committed
  311c303

• Merge branch 'main' into ehsan/parallel_resize

  

  Daiqing

  committed
  cbd46ef

• fix crop_mode

  

  Daiqing

  committed
  a8a8b5d

• Do the resize/crop in parallel

  ehsan

  committed
  b3df852

Commits on Nov 20, 2023

• Do size checks after cropping

  ehsan

  committed
  1023e49

• bug fixes

  ehsan

  committed
  517edcd

• Add single_process mode for debugging

  ehsan

  committed
  383ec9e

Commits on Nov 18, 2023

• initial commit

  ehsan

  committed
  5006244

Commits on Oct 26, 2023

• Fix startup issues with SSL cert store

  

  Daiqing

  committed
  7878fd3

• better rate limit handling

  

  Daiqing

  committed
  d4cd14b

Commits on Sep 20, 2023

• fix some data types to get LAION conversion working

  aykamko

  committed
  1e935a8

Commits on Sep 14, 2023

• fix fs rm bug at the end

  

  root

  committed
  728d6ee

Commits on Sep 13, 2023

• remove size limit and add coco example

  

  root

  committed
  268328b

Commits on Sep 12, 2023

• make it easier to set GCS credentials for Mosaic writer

  aykamko

  committed
  f0cc45d

• Merge pull request #1 from playgroundai/aleks/mosaic_writer

  Show description for fcd670c
  aykamko

  authored
  fcd670c

• add new writer for mosaic, add new temp_download_folder arg

  aykamko

  committed
  a2c0458

Commits on Aug 27, 2023

• Add sshfs to doc on filesystem in readme.

  rom1504

  authored
  4608958

Commits on Aug 20, 2023

• Release 1.42.0

  rom1504

  committed
  91514e8

• Adding ray as a distributor (rom1504#272)

  Show description for 171e3cd
  

  3 peopleauthored
  171e3cd

Commits on Aug 10, 2023

• Add link to DataToML

  rom1504

  authored
  359cbd8

Commits on Aug 6, 2023

• minor fix laion-high-resolution.md (rom1504#335)

  Show description for 19f7f28
  ShoufaChen

  authored
  19f7f28

Commits on Jul 15, 2023

• support more intput formats (txt.gz, csv.gz, json.gz, jsonl, jsonl.gz) and add test cases for it (rom1504#326)

  ldfandian

  authored
  f0188ae

Commits on Jul 12, 2023

• Adding DataComp-1B info (rom1504#328)

  Show description for 4393c44
  gabrielilharco

  authored
  4393c44

Commits on Jun 12, 2023

• Remove tmp_dir only if the output dir is not in s3 (rom1504#320)

  Show description for ba85691
  erezzarum

  authored
  ba85691

Commits on May 28, 2023

• Add code highlighting to the README (rom1504#309)

  Show description for 6adc82b
  bryant1410

  authored
  6adc82b

• Correct webp lossless statement (rom1504#297)

  jonasricker

  authored
  8ad0ece

Commits on Apr 28, 2023

• Adding CommonPool instructions (rom1504#306)

  gabrielilharco

  authored
  21c297b

Pagination

PreviousNext