riserally blog
Engineering blog by riserally — updates, benchmarks, and technical deep-dives on Rust-accelerated reinforcement learning.
Introducing rlox: Rust-Accelerated Reinforcement Learning
Today we’re open-sourcing rlox, a reinforcement learning framework that applies the Polars architecture pattern to RL: a Rust data plane for the heavy lifting, a Python control plane for everything else. The Problem If you’ve trained RL agents with Stable-Baselines3 or TorchRL, you’ve probably noticed something frustrating: your GPU sits idle while Python loops through environment steps, shuffles replay buffers, and computes advantages. The GIL turns embarrassingly parallel work into a serial bottleneck. ...