Skip to content

Latest commit

 

History

History

misc

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
query-sets
query-sets
 
 
Freebase_queries.txt
Freebase_queries.txt
 
 
README.md
README.md
 
 
allq-l1000.txt
allq-l1000.txt
 
 
broccoli_docs_file_to_orig_text_file.py
broccoli_docs_file_to_orig_text_file.py
 
 
broccoli_ontology_txt_to_nt.py
broccoli_ontology_txt_to_nt.py
 
 
broccoli_words_file_to_context_file.py
broccoli_words_file_to_context_file.py
 
 
check_binary_index_equality.sh
check_binary_index_equality.sh
 
 
clueweb_bash_for_loop.txt
clueweb_bash_for_loop.txt
 
 
clueweb_sentences_to_context_and_orig_files.py
clueweb_sentences_to_context_and_orig_files.py
 
 
compare_performance.py
compare_performance.py
 
 
compare_performance_only_own.py
compare_performance_only_own.py
 
 
compare_performance_permutate_queries.py
compare_performance_permutate_queries.py
 
 
compare_shuffled.py
compare_shuffled.py
 
 
convertUnicodeRegexes.py
convertUnicodeRegexes.py
 
 
cost_factors.default.tsv
cost_factors.default.tsv
 
 
cost_factors.filter.tsv
cost_factors.filter.tsv
 
 
cost_factors.nofilter.tsv
cost_factors.nofilter.tsv
 
 
cost_factors.tuned.tsv
cost_factors.tuned.tsv
 
 
create_boxplot_from_compare_out.py
create_boxplot_from_compare_out.py
 
 
ctest-output-to-executables.py
ctest-output-to-executables.py
 
 
fb_compare_performance.py
fb_compare_performance.py
 
 
fix_nt_file.py
fix_nt_file.py
 
 
format-check.sh
format-check.sh
 
 
move_language_into_relation.py
move_language_into_relation.py
 
 
multiplicity-problem.txt
multiplicity-problem.txt
 
 
query_planning_and_text.txt
query_planning_and_text.txt
 
 
reduce_ram_and_startup_time.txt
reduce_ram_and_startup_time.txt
 
 
test_join.py
test_join.py
 
 
tiny-example.docsfile.tsv
tiny-example.docsfile.tsv
 
 
tiny-example.kb.nt
tiny-example.kb.nt
 
 
tiny-example.wordsfile.tsv
tiny-example.wordsfile.tsv
 
 
transform_queries.py
transform_queries.py
 
 
words-and-docs-file-from-nt.py
words-and-docs-file-from-nt.py
 
 
wordsfile_to_context_literals.py
wordsfile_to_context_literals.py
 
 
wordsfile_to_nt.py
wordsfile_to_nt.py
 
 

README.md

Performance Comparison Scripts

Note: This information is incomplete and may be wrong as it has been added after the fact using guesses and the original code

compare_performance_only_own.py: This script is used to performance test different QLever SparqlEngineMain binaries (e.g. after a performance relevant change)

An example using the FreebaseEasy index and the query-file-notext.txt query set with nicer TSV output can be run as follows:

./compare_performance_only_own.py \
   --index <path-to-wikipedia-freebase-easy>/wikipedia-freebase-easy \
   --queryfile query-sets/query-file-notext.txt \
   qlever-version-name ../build/SparqlEngineMain cost_factors.default.tsv \
   | column -t -s $'\t' | less -S

Sadly it seems no check for valid execution is performed. The query sets still use the old <in-text> yet no errors are reported.