Issues

• FastTextClassifierFilter raises TypeError when neither keep_labels nor remove_labels is set

  huggingface/datatrove#562 · Filter by author RaphaelFakhri opened on Oct 19, 2026

• URLFilter: banned-word and domain block-list checks are case-sensitive on the URL side (lists are lowercased, URL is not)

  huggingface/datatrove#553 · Filter by author JoeyTan21 opened on Oct 5, 2026

• C4BadWordsFilter: word-list entries containing an uppercase character can never match (text is lowercased, list entries are not, no IGNORECASE)

  huggingface/datatrove#529 · Filter by author shaurya416 opened on Sep 24, 2026

• ReadabilityInscriptis fails dependency validation and the sandbox's empty warmup

  huggingface/datatrove#521 · Filter by author lpla opened on Sep 8, 2026

• xxhash is pinned to <4: the proper fix needs a decision on str-vs-bytes hashing

  huggingface/datatrove#508 · Filter by author davanstrien opened on Aug 13, 2026

• Docs idea: add a small dataset-audit example using filters, exclusion_writer, and summary stats

  huggingface/datatrove#485 · Filter by author Alfonsobang opened on May 17, 2026

• datatrove 0.9.0 VLLMServer is incompatible with newer vLLM CLI (--disable-log-requests removed)

  huggingface/datatrove#480 · Filter by author Nkluge-correa opened on Apr 9, 2026
  2

• Question: could url_filterblacklistsv0_3_0.tar.gz be hosted externally?

  huggingface/datatrove#477 · Filter by author juancorro77 opened on Apr 8, 2026

• Overloaded dependencies with inference feature

  huggingface/datatrove#476 · Filter by author PoorRican opened on Apr 2, 2026

• Conflicting library requirements for datatrove==0.7.0

  huggingface/datatrove#443 · Filter by author RKurbanov95 opened on Feb 7, 2026

• ModuleNotFoundError: No module named 'datatrove.pipeline.media'

  huggingface/datatrove#413 · Filter by author xiaoma-cloud opened on Jan 13, 2026
  3

• Deduplication Configuration

  huggingface/datatrove#376 · Filter by author yongkangzhao opened on Jul 17, 2025

• Set log level

  huggingface/datatrove#375 · Filter by author baon6052 opened on Jul 10, 2025

• TypeError: DatatroveFolderDataset.__init__() got an unexpected keyword argument 'eos_token_id'

  huggingface/datatrove#374 · Filter by author BakingBrains opened on Jul 9, 2025
  8

• Pipeline for data contamination

  huggingface/datatrove#373 · Filter by author fabiancpl opened on Jul 7, 2025

• Minhash Deduplication Between Two Datasets

  huggingface/datatrove#370 · Filter by author yjha9649 opened on Jun 12, 2025
  1

• Wrong stats files at the end when the job is relaunch

  huggingface/datatrove#360 · Filter by author jgcb00 opened on Apr 24, 2025
  2

• saving .clusters in rust mh3

  huggingface/datatrove#359 · Filter by author jordane95 opened on Apr 17, 2025

• DocumentTokenizer with document.metadata

  huggingface/datatrove#358 · Filter by author prasannapattam opened on Mar 30, 2025
  1

• AssertionError: Need to run with n_tasks = n_files. len(sequence_file)=1, len(sequence_file)=1, len(byte_range_file)=0

  huggingface/datatrove#357 · Filter by author hour opened on Mar 30, 2025
  1

• Installation istructions don't seem to work EXACLY as given; there is a workaround but it appears to lose the ability to customize the flavour install

  huggingface/datatrove#353 · Filter by author frogeyedpeas opened on Mar 22, 2025
  2

• question about hypothetical SQL datasources

  huggingface/datatrove#352 · Filter by author seralf opened on Mar 13, 2025

• question about min hash deduplication process, how many .remove files I should be expecting with 14 buckets?

  huggingface/datatrove#351 · Filter by author yongkangzhao opened on Mar 12, 2025

• feat request: thread executor

  huggingface/datatrove#348 · Filter by author jordane95 opened on Mar 3, 2025

• memory leak on linux

  huggingface/datatrove#347 · Filter by author klarakaleb opened on Feb 20, 2025
  2