Skip to content

Commit

Permalink
baselines
Browse files Browse the repository at this point in the history
  • Loading branch information
ellisk42 committed Apr 9, 2020
1 parent 9e1c906 commit b36af00
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions official_experiments
Original file line number Diff line number Diff line change
Expand Up @@ -178,6 +178,7 @@ for SEED in `seq 0 4`; do python bin/launch.py -c -k -z n1-highmem-64 tower_no_
for SEED in `seq 0 4`; do python bin/launch.py -c -k -z n1-highmem-64 tower_no_recognition_batch_50_3600 "python bin/tower.py -g -t 3600 --pseudoCounts 30 --tasks new --aic 1.0 --structurePenalty 1.5 --topK 2 --arity 3 --maximumFrontier 5 -i 20 --storeTaskMetrics --split 0.5 --testingTimeout 600 --taskReranker randomShuffle --taskBatchSize 50 --primitives new --seed $SEED" ; done
for SEED in `seq 0 4`; do python bin/launch.py -c -k -z n1-highmem-64 baseline_ec_tower "python bin/tower.py -g -t 3600 --pseudoCounts 30 --tasks new --aic 1.0 --structurePenalty 1.5 --topK 2 --arity 0 --maximumFrontier 5 -i 20 --storeTaskMetrics --split 0.5 --testingTimeout 600 --taskReranker randomShuffle --taskBatchSize 50 --primitives new --seed $SEED" ; done
for SEED in `seq 0 4`; do python bin/launch.py -c -k -z n1-highmem-64 tower_memorize "python bin/tower.py --compressor memorize -t 3600 --pseudoCounts 30 --tasks new --aic 1.0 --structurePenalty 1.5 --topK 2 --arity 3 --maximumFrontier 5 -i 20 --storeTaskMetrics --split 0.5 --testingTimeout 600 --biasOptimal --contextual --taskReranker randomShuffle --taskBatchSize 50 --primitives new --recognitionTimeout 3600 -RS 5000 --seed $SEED" ; done
for SEED in `seq 0 4`; do python bin/launch.py -c -k -z n1-highmem-64 tower_memorize_no_recognition "python bin/tower.py --compressor memorize -g -t 3600 --pseudoCounts 30 --tasks new --aic 1.0 --structurePenalty 1.5 --topK 2 --arity 3 --maximumFrontier 5 -i 20 --storeTaskMetrics --split 0.5 --testingTimeout 600 --taskReranker randomShuffle --taskBatchSize 50 --primitives new --seed $SEED" ; done

The hyper parameters here are not consistent. A key thing we need to
do is make sure that we are always using the same hyper parameters, or
Expand Down

0 comments on commit b36af00

Please sign in to comment.