This document contains bitext metadata information for Large-Scale Machine Translation Evaluation for African Languages
Columns are:
corpora_or_ccwet document_sha1 document_url line_number paragraph_digest sentence_digest lid_score laser_score direction language original_line_number
hashes are computed with xxh3_64_intdigest.
Sentences can be extracted from paragraphs using the sentence splitter available here.
| direction | link |
|---|---|
| afr-eng | afr-eng |
| afr-som | afr-som |
| amh-eng | amh-eng |
| amh-fra | amh-fra |
| amh-nya | amh-nya |
| amh-orm | amh-orm |
| amh-sna | amh-sna |
| amh-som | amh-som |
| amh-ssw | amh-ssw |
| amh-swh | amh-swh |
| amh-tsn | amh-tsn |
| amh-tso | amh-tso |
| amh-umb | amh-umb |
| amh-xho | amh-xho |
| amh-yor | amh-yor |
| amh-zul | amh-zul |
| eng-fuv | eng-fuv |
| eng-hau | eng-hau |
| eng-ibo | eng-ibo |
| eng-kam | eng-kam |
| eng-kin | eng-kin |
| eng-lin | eng-lin |
| eng-lug | eng-lug |
| eng-luo | eng-luo |
| eng-nso | eng-nso |
| eng-nya | eng-nya |
| eng-orm | eng-orm |
| eng-sna | eng-sna |
| eng-som | eng-som |
| eng-ssw | eng-ssw |
| eng-swh | eng-swh |
| eng-tsn | eng-tsn |
| eng-tso | eng-tso |
| eng-umb | eng-umb |
| eng-wol | eng-wol |
| eng-xho | eng-xho |
| eng-yor | eng-yor |
| eng-zul | eng-zul |
| fra-hau | fra-hau |
| fra-ibo | fra-ibo |
| fra-kam | fra-kam |
| fra-kin | fra-kin |
| fra-lin | fra-lin |
| fra-lug | fra-lug |
| fra-luo | fra-luo |
| fra-nso | fra-nso |
| fra-nya | fra-nya |
| fra-orm | fra-orm |
| fra-som | fra-som |
| fra-ssw | fra-ssw |
| fra-swh | fra-swh |
| fra-tsn | fra-tsn |
| fra-tso | fra-tso |
| fra-umb | fra-umb |
| fra-wol | fra-wol |
| fra-xho | fra-xho |
| fra-zul | fra-zul |
| fuv-hau | fuv-hau |
| fuv-ibo | fuv-ibo |
| fuv-kam | fuv-kam |
| fuv-kin | fuv-kin |
| fuv-lug | fuv-lug |
| fuv-luo | fuv-luo |
| fuv-nso | fuv-nso |
| fuv-nya | fuv-nya |
| fuv-orm | fuv-orm |
| fuv-sna | fuv-sna |
| fuv-som | fuv-som |
| fuv-ssw | fuv-ssw |
| fuv-swh | fuv-swh |
| fuv-tsn | fuv-tsn |
| fuv-tso | fuv-tso |
| fuv-umb | fuv-umb |
| fuv-xho | fuv-xho |
| fuv-yor | fuv-yor |
| fuv-zul | fuv-zul |
| hau-ibo | hau-ibo |
| hau-kam | hau-kam |
| hau-kin | hau-kin |
| hau-lug | hau-lug |
| hau-luo | hau-luo |
| hau-nso | hau-nso |
| hau-nya | hau-nya |
| hau-orm | hau-orm |
| hau-sna | hau-sna |
| hau-som | hau-som |
| hau-ssw | hau-ssw |
| hau-swh | hau-swh |
| hau-tsn | hau-tsn |
| hau-tso | hau-tso |
| hau-umb | hau-umb |
| hau-xho | hau-xho |
| hau-yor | hau-yor |
| hau-zul | hau-zul |
| ibo-kam | ibo-kam |
| ibo-kin | ibo-kin |
| ibo-lug | ibo-lug |
| ibo-luo | ibo-luo |
| ibo-nso | ibo-nso |
| ibo-nya | ibo-nya |
| ibo-orm | ibo-orm |
| ibo-sna | ibo-sna |
| ibo-som | ibo-som |
| ibo-ssw | ibo-ssw |
| ibo-swh | ibo-swh |
| ibo-tsn | ibo-tsn |
| ibo-tso | ibo-tso |
| ibo-umb | ibo-umb |
| ibo-xho | ibo-xho |
| ibo-yor | ibo-yor |
| ibo-zul | ibo-zul |
| kam-kin | kam-kin |
| kam-lug | kam-lug |
| kam-luo | kam-luo |
| kam-nso | kam-nso |
| kam-nya | kam-nya |
| kam-orm | kam-orm |
| kam-sna | kam-sna |
| kam-som | kam-som |
| kam-ssw | kam-ssw |
| kam-swh | kam-swh |
| kam-tsn | kam-tsn |
| kam-tso | kam-tso |
| kam-umb | kam-umb |
| kam-xho | kam-xho |
| kam-yor | kam-yor |
| kam-zul | kam-zul |
| kin-lug | kin-lug |
| kin-luo | kin-luo |
| kin-nso | kin-nso |
| kin-nya | kin-nya |
| kin-orm | kin-orm |
| kin-sna | kin-sna |
| kin-som | kin-som |
| kin-ssw | kin-ssw |
| kin-swh | kin-swh |
| kin-tsn | kin-tsn |
| kin-tso | kin-tso |
| kin-umb | kin-umb |
| kin-xho | kin-xho |
| kin-yor | kin-yor |
| kin-zul | kin-zul |
| lug-luo | lug-luo |
| lug-nso | lug-nso |
| lug-nya | lug-nya |
| lug-orm | lug-orm |
| lug-sna | lug-sna |
| lug-som | lug-som |
| lug-ssw | lug-ssw |
| lug-swh | lug-swh |
| lug-tsn | lug-tsn |
| lug-tso | lug-tso |
| lug-umb | lug-umb |
| lug-xho | lug-xho |
| lug-yor | lug-yor |
| lug-zul | lug-zul |
| luo-nso | luo-nso |
| luo-nya | luo-nya |
| luo-orm | luo-orm |
| luo-sna | luo-sna |
| luo-som | luo-som |
| luo-ssw | luo-ssw |
| luo-swh | luo-swh |
| luo-tsn | luo-tsn |
| luo-tso | luo-tso |
| luo-umb | luo-umb |
| luo-xho | luo-xho |
| luo-yor | luo-yor |
| luo-zul | luo-zul |
| nso-nya | nso-nya |
| nso-orm | nso-orm |
| nso-sna | nso-sna |
| nso-som | nso-som |
| nso-ssw | nso-ssw |
| nso-swh | nso-swh |
| nso-tsn | nso-tsn |
| nso-tso | nso-tso |
| nso-umb | nso-umb |
| nso-xho | nso-xho |
| nso-yor | nso-yor |
| nso-zul | nso-zul |
| nya-orm | nya-orm |
| nya-sna | nya-sna |
| nya-som | nya-som |
| nya-ssw | nya-ssw |
| nya-swh | nya-swh |
| nya-tsn | nya-tsn |
| nya-tso | nya-tso |
| nya-umb | nya-umb |
| nya-xho | nya-xho |
| nya-yor | nya-yor |
| nya-zul | nya-zul |
| orm-sna | orm-sna |
| orm-som | orm-som |
| orm-ssw | orm-ssw |
| orm-swh | orm-swh |
| orm-tsn | orm-tsn |
| orm-tso | orm-tso |
| orm-umb | orm-umb |
| orm-xho | orm-xho |
| orm-yor | orm-yor |
| orm-zul | orm-zul |
| sna-som | sna-som |
| sna-ssw | sna-ssw |
| sna-swh | sna-swh |
| sna-tsn | sna-tsn |
| sna-tso | sna-tso |
| sna-umb | sna-umb |
| sna-xho | sna-xho |
| sna-yor | sna-yor |
| sna-zul | sna-zul |
| som-ssw | som-ssw |
| som-swh | som-swh |
| som-tsn | som-tsn |
| som-tso | som-tso |
| som-umb | som-umb |
| som-wol | som-wol |
| som-xho | som-xho |
| som-yor | som-yor |
| som-zul | som-zul |
| ssw-swh | ssw-swh |
| ssw-tsn | ssw-tsn |
| ssw-tso | ssw-tso |
| ssw-umb | ssw-umb |
| ssw-xho | ssw-xho |
| ssw-yor | ssw-yor |
| ssw-zul | ssw-zul |
| swh-tsn | swh-tsn |
| swh-tso | swh-tso |
| swh-umb | swh-umb |
| swh-xho | swh-xho |
| swh-yor | swh-yor |
| swh-zul | swh-zul |
| tsn-tso | tsn-tso |
| tsn-umb | tsn-umb |
| tsn-xho | tsn-xho |
| tsn-yor | tsn-yor |
| tsn-zul | tsn-zul |
| tso-umb | tso-umb |
| tso-xho | tso-xho |
| tso-yor | tso-yor |
| tso-zul | tso-zul |
| umb-xho | umb-xho |
| umb-yor | umb-yor |
| umb-zul | umb-zul |
| xho-yor | xho-yor |
| xho-zul | xho-zul |
| yor-zul | yor-zul |