All pull requests

Pull requests

• chore(deps): bump the actions group with 2 updates

  dependenciesgithub_actions
  #575·dependabot[bot] opened Nov 3, 2026Bot·

  ·

• Document the output files of MinhashDedupCluster

  #574·ShabnamKSoni1502 opened Oct 27, 2026·

  ·

• feat(inference): replace the hand-rolled HTTP client with pooled aiohttp

  #570·davanstrien opened Oct 23, 2026Member·

  ·

• fix: make banned-word and domain blocklist checks case insensitive

  #566·Davda-James opened Oct 21, 2026·

  ·
  1

• fix(filters): allow FastTextClassifierFilter without keep_labels or remove_labels

  #563·RaphaelFakhri opened Oct 19, 2026·

  ·
  1

• fix(media): expand media filename template tags

  #561·BSAIPF opened Oct 18, 2026·

  ·

• Replace ray orchestration with native Ray tasks

  #560·vdecaro opened Oct 15, 2026·

  ·
  5

• Declare requests as an optional dependency of HTTPFetchReader

  #559·li12345678990 opened Oct 12, 2026·

  ·
  1

• fix(inference): apply request_timeout to the built-in HTTP client

  #558·apex-mochen opened Oct 12, 2026·

  ·

• fix(inference): keep the model on endpoint retries and let skip_bad_requests catch endpoint 400s

  #557·apex-mochen opened Oct 12, 2026·

  ·

• fix(inference): track resumed checkpoint records by position, not id

  #556·apex-mochen opened Oct 12, 2026·

  ·

• [Jobs] Run coordinator in HF Jobs

  #555·lhoestq opened Oct 6, 2026Member·

  ·
  8

• Fix default staging in HuggingFaceDatasetWriter

  #552·lpla opened Oct 3, 2026·

  ·
  5

• Fix Parquet writes with chunked string columns

  #551·lpla opened Oct 2, 2026·

  ·

• Load MinHash cluster metadata when a rank has no removals

  #550·lpla opened Oct 2, 2026·

  ·

• Fix the default SentenceDedupSignature configuration

  #549·lpla opened Oct 2, 2026·

  ·

• Cover skip limits and stable IDs in streaming Hugging Face reads

  #548·lpla opened Oct 1, 2026·

  ·

• test: known-bug tests (WIP, do not review)

  #547·davanstrien opened Sep 30, 2026Member·

  ·

• fix(c4): drop a line whose word count only came from citations

  #545·SashaMIT opened Sep 29, 2026·

  ·

• fix(readers): keep line endings inside quoted CSV fields

  #541·davanstrien opened Sep 29, 2026Member·

  ·

• Use the HTTP charset when decoding WARC responses

  #538·lpla opened Sep 28, 2026·

  ·

• fix(filters): GopherQualityFilter raises ZeroDivisionError on empty documents

  #531·linhongyu510 opened Sep 25, 2026·

  ·
  2

• fix(filters): lowercase C4BadWordsFilter list entries so mixed-case words can match

  #530·shaurya416 opened Sep 25, 2026·

  ·
  1

• Add configurable DATATROVE_LOG_LEVEL env var (#375)

  #527·AmulyaP07-15 opened Sep 17, 2026·

  ·
  1

  1

• feat(inference): include model in rollout results

  #524·jisang-park opened Sep 14, 2026·

  ·