feat(rl): add decoupled Miles RL adapter lifecycle - #43

Open

AlexEisie wants to merge 58 commits into

mainfrom

feat/miles_rl_adapter_complete

Commits on Jul 30, 2026

Commits on Jul 31, 2026

docs(rl): record current Miles validation
AlexEisie
committed
8e1eef9
docs(benchmarks): publish Miles RL results
AlexEisie
committed
bb3ecda

Commits on Aug 4, 2026

merge: sync Miles RL branch with origin/main
AlexEisie
committed
0e6ec5a
feat(sft): add causal LoRA adapter lifecycle
AlexEisie
committed
e36f5d8
fix(sft): normalize adapter resume recipe defaults
AlexEisie
committed
4c3b935
feat(rl): add local PPO and CyberGym integration
AlexEisie
committed
06ba71d
feat(rl): add existing-host SSH acceptance harness
AlexEisie
committed
0a0d843
feat(benchmarks): extend Miles RL run controls
AlexEisie
committed
33214ae
chore(sft): trim adapter lifecycle integration
AlexEisie
committed
35fb4c3
fix(benchmark): pass audit directory to RL workers

WaldenLee2005
authored and
WaldenLee2005
committed
00460ec

Commits on Aug 5, 2026

docs(rl): document Miles RL synchronization
AlexEisie
committed
ab168ca
feat(rl): add decoupled Miles synchronization
AlexEisie
committed
0016409
test(rl): cover decoupled Miles lifecycle
AlexEisie
committed
0f9cdcb
feat(benchmarks): compare decoupled Miles RL
AlexEisie
committed
9d4abd1
docs(rl): add decoupled DiLoCo design
AlexEisie
committed
18a396c
fix(rl): zero-token tolerance and ssh harness dashboard default value
AlexEisie
committed
9fedf78
fix(syncer): replay pulls only after reconnect
AlexEisie
committed
9f32ddf
fix(cybergym): serialize identical reward submissions
AlexEisie
committed
f9aff3c
feat(rl): start decoupled phases from exported adapters
AlexEisie
committed
41bb8ac
fix(rl): add curriculum and variance-aware CyberGym sampling

WaldenLee2005
authored and
WaldenLee2005
committed
22922e8
fix(rl): bound variance sampling and offload weight sync

WaldenLee2005
authored and
WaldenLee2005
committed
f4282df
fix(rl): wake offloaded actor before initial export

WaldenLee2005
authored and
WaldenLee2005
committed
beb519f

Commits on Aug 6, 2026

fix(rl): use actor group onload for offloaded export

WaldenLee2005
authored and
WaldenLee2005
committed
e8d2e37
Verify decoupled RL SSH artifacts
AlexEisie
committed
37c9f90
Fix Miles RL runtime attestation and offload lifecycle
AlexEisie
committed
94f423c
fix(rl): delegate initial offload lifecycle to Miles
AlexEisie
committed
2806dca
fix(rl): finalize offload-safe Miles publication
AlexEisie
committed
b31e3fa
Add CyberGym text Level 1 prompts
AlexEisie
committed
8b8e2b4
Support shaped CyberGym reward scoring
AlexEisie
committed
d9d1f07
Handle large Level 1 source archives
AlexEisie
committed
d4a6e25
Fix AFL++ CyberGym coverage runner
AlexEisie
committed
3bc5854

Commits on Aug 7, 2026

Relocate CyberGym coverage setup
AlexEisie
committed
cf40eaf
Keep decoupled RL design notes local
AlexEisie
committed
470e2da
fix: pin RL SGLang source to the patched revision
AlexEisie
committed
3296df9
fix: forward RL chat template kwargs through SSH harness
AlexEisie
committed
afd2988
fix: exclude benchmark reports from SSH RL deploys
AlexEisie
committed
158bee4
fix: pin Miles SGLang host compatibility update
AlexEisie
committed
388e36c
fix: pin compatible Miles runtime
AlexEisie
committed
c876901
fix: pin repaired Miles RL image
AlexEisie
committed
a0480ae
fix: pin lazy p2p Miles import
AlexEisie
committed
96eb95d
fix: pin compatible SGLang LoRA transport
AlexEisie
committed
6a12ee8

Commits on Aug 10, 2026

docs(rl): align Miles and CyberGym task docs
AlexEisie
committed
209af59
merge: sync feature branch with origin/main
AlexEisie
committed
6f738db
test(rl): remove syncer artifact dependency
AlexEisie
committed
3bc0790

Commits on Aug 11, 2026

Commits on Aug 18, 2026

Add opt-in W&B telemetry for fleets
claude
committed
3df3701
Stream syncer metrics in local controller mode too
claude
committed
6953f7d
Fix two gaps the H200 two-island run exposed
claude
committed
f0714a0
Merge W&B telemetry and extend it to RL islands
claude
committed
181c158
Wire telemetry through the SSH harness too
claude
committed
1f8b929
Fix an RL x-axis that no real event carries
claude
committed
640e600