![[ICO]](/icons/blank.gif){kind=icon}
![[PARENTDIR]](/icons/back.gif){kind=icon}
![[TXT]](/icons/text.gif){kind=icon}
![[DIR]](/icons/folder.gif){kind=icon}
| Name | Last modified | Size | Description |
|---|---|---|---|---|
| Parent Directory | - | ||
| README.md | 2025-05-05 04:48 | 626 | |
| binarize.py | 2025-05-05 04:48 | 6.8K | |
| check_iswlt_test_data.py | 2025-05-05 04:48 | 2.7K | |
| check_self_overlaps.py | 2025-05-05 04:48 | 3.6K | |
| check_valid_test_overlaps.py | 2025-05-05 04:48 | 4.4K | |
| dedup_all.py | 2025-05-05 04:48 | 1.8K | |
| download_ML50_v1.sh | 2025-05-05 04:48 | 964 | |
| download_af_xh.sh | 2025-05-05 04:48 | 4.3K | |
| download_flores_data.sh | 2025-05-05 04:48 | 9.5K | |
| download_iitb.sh | 2025-05-05 04:48 | 1.0K | |
| download_iwslt_and_extract.sh | 2025-05-05 04:48 | 6.1K | |
| download_lotus.sh | 2025-05-05 04:48 | 1.8K | |
| download_ted_and_extract.py | 2025-05-05 04:48 | 12K | |
| download_wat19_my.sh | 2025-05-05 04:48 | 1.2K | |
| download_wmt19_and_before.py | 2025-05-05 04:48 | 37K | |
| download_wmt20.sh | 2025-05-05 04:48 | 23K | |
| preprocess_ML50_v1.sh | 2025-05-05 04:48 | 846 | |
| remove_valid_test_in_train.py | 2025-05-05 04:48 | 11K | |
| requirement.txt | 2025-05-05 04:48 | 11 | |
| utils/ | 2025-05-05 04:48 | - | |