Expand description
Sequence replay buffer for recurrent/transformer-based RL algorithms.
Wraps a ReplayBuffer and EpisodeTracker to provide sampling of
contiguous transition sequences that never cross episode boundaries.
Used by DreamerV3, R2D2, and other sequence-based algorithms.
Structsยง
- Sequence
Batch - A batch of sampled sequences.
- Sequence
Replay Buffer - Replay buffer that samples contiguous sequences of transitions.