Distributed RL training across heterogeneous global clusters reduces need for massive contiguous GPU clusters
Fireworks' architecture disaggregates training (needs high-bandwidth interconnect) from inference (can run on smaller, heterogeneous, cheaper clusters worldwide), using delta weight synchro…