HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 62.1k • 812
Edit Datasets filters
English
French
Chinese
French
Spanish
Russian
German
Japanese
Arabic
Korean
Portuguese
English
Italian
Vietnamese
Turkish
Hindi
Indonesian
Dutch
Polish
Bengali
Thai
Persian
Czech
Tamil
Swedish
Romanian
Ukrainian
Danish
Greek
Finnish
Catalan
Telugu
Hungarian
Spanish
Urdu
German
Swahili
Bulgarian
Marathi
Hebrew
Estonian
Malayalam
Basque
Slovak
Slovenian
Gujarati
Lithuanian
Croatian
Kannada
Malay
Latvian
Serbian
code
Panjabi
Amharic
Italian
Kazakh
Nepali
Norwegian
Burmese
Uzbek
Indonesian
Azerbaijani
Portuguese
Oriya
Yoruba
Hausa
Afrikaans
Sinhala
Icelandic
multilingual
Galician
Russian
Irish
Assamese
Khmer
Breton
Belarusian
Latin
Maltese
Georgian
Tagalog
Welsh
Vietnamese
Macedonian
Dutch
Armenian
Igbo
Albanian
Polish
Active filters: crh
openlanguagedata/flores_plus
Viewer • Updated • 883k • 17.1k • 142
omarkamali/wikipedia-monthly
Viewer • Updated • 195M • 11.7k • 70
Muennighoff/flores200
Updated • 2.76k • 22
CohereLabs/xP3x
Viewer • Updated • 434M • 262k • 95
ayymen/Pontoon-Translations
Viewer • Updated • 3.56M • 1.7k • 19
HPLT/HPLT2.0_cleaned
Viewer • Updated • 9.03B • 52.8k • 43
nativemind/kene_multimodal_gift
Viewer • Updated • 36 • 56 • 1
HPLT/HPLT3.0
Updated • 88 • 20
HuggingFaceFW/finetranslations
Viewer • Updated • 3.33B • 10.6k • 292
commoncrawl/CommonLID
Viewer • Updated • 373k • 227 • 53
open-index/open-wikipedia-markdown
Updated • 5.67k • 14
Reubencf/Adaption-multilingual-sentences
Viewer • Updated • 10k • 49 • 1
neurlang/ipa-lexicon-4v0-7M
Viewer • Updated • 6.91M • 472 • 5
legacy-datasets/wikipedia
Updated • 107k • 636
wikimedia/wikipedia
Viewer • Updated • 61.6M • 247k • 1.24k
facebook/flores
Viewer • Updated • 1.23M • 15.3k • 103
HuggingFaceFW/finepdfs
Viewer • Updated • 476M • 63.4k • 872
Helsinki-NLP/kde4
Updated • 1.5k • 25
Helsinki-NLP/opus_gnome
Viewer • Updated • 59.5k • 885 • 1
Helsinki-NLP/opus_ubuntu
Viewer • Updated • 37.4k • 1.41k • 4
Helsinki-NLP/tatoeba
Updated • 3.39k • 56
community-datasets/udhr
Updated • 159 • 2
unimorph/universal_morphologies
Updated • 175 • 20
unimelb-nlp/wikiann
Viewer • Updated • 2M • 40.3k • 121
MartinThoma/wili_2018
Viewer • Updated • 235k • 494 • 5
tner/wikiann
Updated • 1.36k • 5
olm/wikipedia
Updated • 286 • 37
reyoung/wikipedia
Updated • 31 • 1
vpermilp/nllb-200-distilled-600M-rust
Updated • 66 • 1