GitHub - rnagamatsu/textanalytics_group2: textanalytics

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 57 Commits
flores200_group2		flores200_group2
ChatGPT_Tokenization&BLEU&NIST.ipynb		ChatGPT_Tokenization&BLEU&NIST.ipynb
Copy_of_main_code_3.ipynb		Copy_of_main_code_3.ipynb
FinalDraft_Group2.ipynb		FinalDraft_Group2.ipynb
GoogleTranslate_API.ipynb		GoogleTranslate_API.ipynb
GoogleTranslate_API_v2.ipynb		GoogleTranslate_API_v2.ipynb
IBM Watson Language Translator		IBM Watson Language Translator
IBM_Watson_Language_Translator.ipynb		IBM_Watson_Language_Translator.ipynb
Linking_OpenAI.ipynb		Linking_OpenAI.ipynb
README		README
TA_Group2.ipynb		TA_Group2.ipynb
TA_Group2_ChatGPTSection.ipynb		TA_Group2_ChatGPTSection.ipynb
TA_Group2_ChatGPTSection_Tokenization&BLEU.ipynb		TA_Group2_ChatGPTSection_Tokenization&BLEU.ipynb
TA_Group2_googleUpdate+Evaluation.ipynb		TA_Group2_googleUpdate+Evaluation.ipynb
TA_Group2_googleUpdate.ipynb		TA_Group2_googleUpdate.ipynb
download_and_processing.ipynb		download_and_processing.ipynb
en_ja_test.ipynb		en_ja_test.ipynb
group_number_2.ipynb		group_number_2.ipynb
main_code.ipynb		main_code.ipynb
main_code_3.ipynb		main_code_3.ipynb
metadata_dev.tsv		metadata_dev.tsv
metadata_devtest.tsv		metadata_devtest.tsv

Repository files navigation

FLORES 200 dataset

1) dev/ and devtest/ contains the sentences in same order for each language. 
2) metadata_dev.tsv and metadata_devtest.tsv contains tab separated metadata for each of the sentences. The sentences are in same order as of dev/<lang>.dev and devtest/<lang>.devtest