Skip to content

Pull requests: huggingface/trl

New pull request New
175 Open 3,651 Closed
175 Open 3,651 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix biased cross-rank aggregation of token-weighted metrics (GRPO, RLOO)
#6380 opened Jul 13, 2026 by qgallouedec Member Loading…
3
Fix async GRPO clip-ratio extrema to global per-completion
#6379 opened Jul 13, 2026 by qgallouedec Member Loading…
3
Simplify AsyncGRPOTrainer: drop redundant metric guards, merge train-begin callbacks
#6378 opened Jul 13, 2026 by qgallouedec Member Loading…
1
Align AsyncGRPOTrainer args handling with stable trainers
#6377 opened Jul 13, 2026 by qgallouedec Member Loading…
8 tasks
6
Align AsyncGRPOTrainer clip-ratio comment with GRPOTrainer
#6376 opened Jul 13, 2026 by qgallouedec Member Loading…
8 tasks
1
Align AsyncGRPOTrainer.processing_class docstring with GRPOTrainer
#6375 opened Jul 13, 2026 by qgallouedec Member Loading…
8 tasks
1
Align AsyncGRPOConfig.max_completion_length description with GRPOConfig
#6374 opened Jul 13, 2026 by qgallouedec Member Loading…
8 tasks
1
Fix formatting of error message for loss_type
#6373 opened Jul 13, 2026 by qgallouedec Member Loading…
8 tasks
1
Fix DPO/KTO use_liger_kernel under DeepSpeed ZeRO-3
#6372 opened Jul 13, 2026 by qgallouedec Member Loading…
1
6
Test all supported eval_dataset input types in core trainer evaluate() tests
#6371 opened Jul 13, 2026 by albertvillanova Member Loading…
1 task
1
Fix DPO/KTO evaluate crash with a dict eval_dataset and precompute_ref_log_probs
#6370 opened Jul 13, 2026 by albertvillanova Member Loading…
5
Stop overcounting dead groups and increase your accuracy
#6368 opened Jul 13, 2026 by SushantDaga Loading…
4 of 8 tasks
1
3
Avoid in-place mutation of input prompts in DPPO environments loop
#6366 opened Jul 12, 2026 by albertvillanova Member Loading…
4
Avoid in-place mutation of input prompts in GRPO environments loop
#6364 opened Jul 12, 2026 by albertvillanova Member Loading…
6
Fix corrupted reasoning blocks in Qwen3-family training chat templates
#6363 opened Jul 12, 2026 by qgallouedec Member Loading…
1
1
Bump the actions group with 9 updates dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#6360 opened Jul 11, 2026 by dependabot Bot Loading…
@albertvillanova
1
Truncate GOLD on-policy prompts before generation, keeping the prompt end
#6359 opened Jul 11, 2026 by roycho96 Contributor Loading…
3 tasks done
@kashif @cmpatino
2
Add trl.environments submodule with SandboxEnvironment
#6358 opened Jul 11, 2026 by qgallouedec Member • Draft
Fix EOS being masked when pad_token_id equals eos_token_id in GKD and GOLD
#6357 opened Jul 11, 2026 by roycho96 Contributor Loading…
3 tasks done
@kashif @cmpatino
Force use_reentrant=True for PEFT + ZeRO-3 + gradient checkpointing in all trainers
#6356 opened Jul 10, 2026 by qgallouedec Member Loading…
1
3
Support iterable datasets in GRPO and RLOO
#6351 opened Jul 10, 2026 by albertvillanova Member Loading…
1
10
Environment-owned dataset: make train_dataset optional
#6349 opened Jul 10, 2026 by qgallouedec Member Loading…
1
16
Add LoRA support for AsyncGRPO
#6344 opened Jul 9, 2026 by jonahsamost Loading…
1 of 8 tasks
@AmineDiro
11
Preserve model forward signature in the chunked CE lm_head patch
#6342 opened Jul 9, 2026 by sergiopaniego Member Loading…
3 of 6 tasks
3
Fix SDPO scale_rewards CLI parsing and warn on ignored feedback
#6341 opened Jul 9, 2026 by sergiopaniego Member Loading…
3 of 6 tasks
1
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.