Fix test_vllm_npu_worker_class_resolves: tolerate version mismatch - #1

Open

UsernameFull wants to merge 102 commits into

mainfrom

Commits on Jan 28, 2026

feat: add NPU device_memory_used and vllm support

UsernameFull
authored and
PanAndy
committed
9744713

Commits on Feb 4, 2026

(feat): publish roll v0.2.0.

committed
3077bef

Commits on Feb 5, 2026

(chore): append commiter for v0.2.0.
PanAndy
committed
c8f8029
(chore): append commiter for v0.2.0.

PanAndy
and
taoluo
committed
f41a8f1

Commits on Feb 7, 2026

Remove upload_to_mos call after checkpoint save

chocoded
authored and
HuangJoJo
committed
f3f13dc

Commits on Feb 9, 2026

fix: correct typo in async_parallel_rollout.md

WeiyaoLuo
authored and
PanAndy
committed
4a0ce56
feat: add katex to docs markdown
kkkky123
committed
777dad6

Commits on Feb 10, 2026

(docs): update readme.
PanAndy
committed
4a49bab

Commits on Feb 12, 2026

(fix): use default_factory for mutable SequencePackingConfig field.

hydrozhao
authored and
PanAndy
committed
afc4d30

Commits on Feb 13, 2026

(fix): fix train_infer_is_weight KeyError for rlvr_vlm_pipeline and remove rlvr_math_vlm_pipeline

guoshengCS
authored and
HuangJoJo
committed
ae69fd8

Commits on Feb 28, 2026

(fix): handle is_last_step in DeepSpeedTrainStrategy.save_checkpoint

XucSh
authored and
PanAndy
committed
c70c473
fix: address resource leaks and code quality issues

authored and
PanAndy
committed
ce4e3a2

Commits on Mar 9, 2026

(fix): set vllm VLLM_USE_FLASHINFER_SAMPLER=0 for torch 280.
PanAndy
committed
bec2a4b
(fix): set sglang port range to avoid conflicting.

HuangJoJo
authored and
PanAndy
committed
81e9c5c
(fix): fix sglang multi-nodes fail when worker num > 1.

emiedon
authored and
PanAndy
committed
1054785
(fix): optimize port allocation logic with atomic operation.

wangshangquan.wsq
authored and
PanAndy
committed
c72d283
(chore): fix qwen3-vl-32B 80GB config.

HuangJoJo
authored and
PanAndy
committed
2e783fe
(fix): hardcode default async concurrency limit to 1000 to remove dependency on ray._private.ray_constants.

hydrozhao
authored and
PanAndy
committed
d6dad8f
(fix): fix reward metrics expo.
PanAndy
committed
526f7b5
(fix): fix batch num tokens.
PanAndy
committed
53c6da3
(fix): fix vllm process weights.
PanAndy
committed
3b0398a
(fix): fix func download get_node_ip.
PanAndy
committed
cda8262
(fix): fix sglang process weights.

hydrozhao
authored and
PanAndy
committed
ae0a39b
(fix): Make offload states configurable and Fix batch size setting in DPO pipeline.

Schnabel-8
authored and
PanAndy
committed
ca8e9e5
(feat): support vllm 0.15.1.

hydrozhao
authored and
PanAndy
committed
36d0064
(fix): FSDP2 DCP Saving when CPU Offload.

dilixiati.dlxtmhte
authored and
PanAndy
committed
c356bb9
(feat): support sglang-router.

hydrozhao
authored and
PanAndy
committed
c601cd1
(feat): add Dockerfile for torch2.10.0, support vllm 0.16.dev.

hydrozhao
authored and
PanAndy
committed
9087c02
(fix): pyarrow>15.0.0 jemalloc coredump, add torch2.10.0 deps, fix rollout chat_template function typo.

HuangJoJo
authored and
PanAndy
committed
85100e8
(feat): update mcore adapter.

chocoded
authored and
PanAndy
committed
f33540c
(feat): support training for qwen3.5-27B.

xuehuanran
authored and
PanAndy
committed
4449a31
(fix): refactor sharded state dict metadata handling and integrate into training strategy.

chocoded
authored and
PanAndy
committed
a35fbce
(chore): move EnvAffinityRouter and PartialGPUManager to router.py.

hydrozhao
authored and
PanAndy
committed
b4facdd
(fix): gracefully shutdown of Router.

hydrozhao
authored and
PanAndy
committed
5dfecbb
(chore): release docker image for torch2.10.0.

hydrozhao
authored and
PanAndy
committed
31c99c9
(feat): add example config for qwen3_5_35ba3.

xuehuanran
authored and
PanAndy
committed
16b3ca8
(fix): correct parameter name when constructing reward cluster.

hydrozhao
authored and
PanAndy
committed
50c8954
(feat): support onpolicy distillation.

Schnabel-8
authored and
PanAndy
committed
82436a5
(fix): fix version compare of torch for pg_options_param_name.

hydrozhao
authored and
PanAndy
committed
5b488cc
(fix): separated the system role check from the skip_mock_system_prompt check.

hydrozhao
authored and
PanAndy
committed
16d2113
(fix): prevent sync generate request execution during shutdown.

hydrozhao
authored and
PanAndy
committed
0257ca3
(docs): update readme.
PanAndy
committed
921dc28
(fix): FSDP2 Model Initialization & Casting.

dilixiati.dlxtmhte
authored and
PanAndy
committed
d2dcd86
fix bugs in strategy config and opd config

Schnabel-8
authored and
PanAndy
committed
b63b3a4
(fix): add context parallel loss reduction in trainer.

chocoded
authored and
PanAndy
committed
2eba7c3

Commits on Mar 10, 2026

fix: add sft support on npu

UsernameFull
authored and
PanAndy
committed
5cd926f
feat: add npu mindspeed

jiaqiw09
authored and
PanAndy
committed
d133109
feat: add NPU (Ascend) support for FSDP2, vLLM, model update, and platform detection

UsernameFull
authored and
PanAndy
committed
7f56229
Revert "adapt mindspeed"

UsernameFull
authored and
PanAndy
committed
9640566
fix: rng_state on npu

UsernameFull
authored and
PanAndy
committed
91085a8
fix: DeepSpeedEngine.load_checkpoint method doesn't take an is_last_step argument

UsernameFull
authored and
PanAndy
committed
079bd47
platform add empty_cache get_rng_state set_rng_state

UsernameFull
authored and
PanAndy
committed
562c25a
fix: support _set_allocator_settings in NPU

UsernameFull
authored and
PanAndy
committed
3210f2b
feat: add reward model cluster mode for LLM-as-judge in RLVR pipeline

authored and
PanAndy
committed
bd17364

Commits on Mar 17, 2026

Add notable works section to README

taoluo
authored and
PanAndy
committed
53eddee
Enhance model saving with PEFT support

chocoded
authored and
PanAndy
committed
2d6ab4f
Import is_peft_available from transformers.utils

chocoded
authored and
PanAndy
committed
13a5027
Rename linear_attention_type to experimental_attention_variant

chocoded
authored and
PanAndy
committed
0ce37ff
Rename linear_attention_type to experimental_attention_variant

chocoded
authored and
PanAndy
committed
a26d90a
Rename linear_attention_type to experimental_attention_variant

chocoded
authored and
PanAndy
committed
f16628f
feat: support rock native env and provide demo to run agent rollout and train
jingyushen
committed
2fd2606

Commits on Mar 18, 2026

docs: Add Huawei Ascend hardware support doc

UsernameFull
authored and
HuangJoJo
committed
c0f40a3
fix: fix rlvr metrics update

UsernameFull
authored and
HuangJoJo
committed
9de2784

Commits on Mar 19, 2026

fix: MultipleChoiceBoxedRuleRewardWorker returns a zero reward

luyouqi233
authored and
PanAndy
committed
9c6ce5c

Commits on Mar 20, 2026

Revise RLix description for clarity and detail

taoluo
authored and
PanAndy
committed
cb617db

Commits on Mar 24, 2026

Add Qwen3.5 ROCK agentic SWE example

shamanez
authored and
PanAndy
committed
4fd4147
minor comment.

shamanez
authored and
PanAndy
committed
6190d06
fix: disable reward normalization for SWE configs with group_size=1

shamanez
authored and
PanAndy
committed
52e0978
Update config name in run_onpolicy_distill_pipeline.sh

joeyzyz
authored and
PanAndy
committed
345edea

Commits on Mar 26, 2026

add reference to notable work

pUmpKin-Co
authored and
PanAndy
committed
f509efc

Commits on Mar 31, 2026

added OpenRewards

shamanez
authored and
PanAndy
committed
53fce5a
added the openreward support.

shamanez
authored and
PanAndy
committed
bc9af12
revert agent_native_env_manager.py to upstream version

authored and
PanAndy
committed
6e1a5df
remove IPA config yaml not needed for OpenReward integration

authored and
PanAndy
committed
b39681b

Commits on Apr 1, 2026

fix: use Cluster instead of WorkerConfig for dynamic batching dp_size

dubin555
authored and
PanAndy
committed
a49a915

Commits on Apr 7, 2026

add initial trackio integration for roll.

ParagEkbote
authored and
PanAndy
committed
7526682

Commits on Apr 29, 2026

(feat): tensorboard log in new executor.
PanAndy
committed
3432271

Commits on Apr 30, 2026

feat: add npu dockerfile and useage

UsernameFull
authored and
HuangJoJo
committed
942703d
feat: add npu dockerfile and useage

UsernameFull
authored and
HuangJoJo
committed
034d38e

Commits on May 7, 2026

Optimize ROCm for send_recv and model_update

aaab8b
authored and
PanAndy
committed
19e740d
Update README.md

histmeisah
authored and
PanAndy
committed
4bb7d74

Commits on May 12, 2026

Add support for ROCm 7.2 and PyTorch 2.10

authored and
PanAndy
committed
2611542
feat(agentic): integrate Atropos environment as gem.Env adapter

RUFFY-369
authored and
PanAndy
committed
084f0ed
docs: add atropos-gsm8k training demo configuration and launch script

RUFFY-369
authored and
PanAndy
committed
4960b49
fix: move max_steps to yaml to avoid unrecognized cli args in start_pipeline

RUFFY-369
authored and
PanAndy
committed
6069cda
fix(yaml): remove duplicate max_steps key

RUFFY-369
authored and
PanAndy
committed
6d0df55
fix(yaml): add explicit val_env_manager and RL params to avoid config leakage

RUFFY-369
authored and
PanAndy
committed
190f124
fix(yaml): resolve ZeroDivisionError by providing valid val_env_config

RUFFY-369
authored and
PanAndy
committed
e91f69e
fix(scheduler): defensive Ray resource allocation for modern versions

RUFFY-369
authored and
PanAndy
committed
5b45342
feat: integrate Atropos deep reasoning with GRPO and universal reward bridge

RUFFY-369
authored and
PanAndy
committed
8a53cb1
fix: restore OpenReward demo config mistakenly pruned during cleanup

RUFFY-369
authored and
PanAndy
committed
e5c91c7
refactor: simplify resource allocation and restore original node sorting logic

RUFFY-369
authored and
PanAndy
committed
aa2052b

Commits on May 15, 2026

docs: Add Huawei Ascend hardware support doc

UsernameFull
authored and
HuangJoJo
committed
9ec88d6
add npu doc

UsernameFull
authored and
HuangJoJo
committed
5d1e3c3
[ascend adapt] qwen3-30b model vllm fsdp2

shun001
authored and
HuangJoJo
committed
c09bc8b

Commits on May 19, 2026

fix: correct typos and broken link in README

Galleons2029
authored and
PanAndy
committed
5d6d554

Commits on May 21, 2026

docs: add careers page
kkkky123
committed
2640a80
docs: add careers application links
kkkky123
committed
baaa682

Commits on May 26, 2026

[bugfix] ascend qwen3-30b fsdp2 model update bugfix and update yaml

shun001
authored and
PanAndy
committed
47202f5
fix image mismatch

sanmuf
authored and
PanAndy
committed
ae4c065

Commits on Jun 12, 2026

feat: add npu ci yaml and fix tests
UsernameFull
committed
02b8736
fix: fix TestVllmStrategyBeamSearch test
UsernameFull
committed
6de0a69