Skip to content

Phase 3: real FSDP, jit+NamedSharding, measurement, mid-epoch resume - #15

Closed
AshishKumar4 wants to merge 5 commits into
revamp/phase-4-flow-matchingfrom
revamp/phase-3-parallelism
Closed

Phase 3: real FSDP, jit+NamedSharding, measurement, mid-epoch resume#15
AshishKumar4 wants to merge 5 commits into
revamp/phase-4-flow-matchingfrom
revamp/phase-3-parallelism

test(trainer): cover gradient accumulation across the sharding heuristic

1587b09
Select commit
Loading
Failed to load commit list.

There are no checks for this commit