Struct SequenceReplayBuffer 

pub struct SequenceReplayBuffer { /* private fields */ }

Replay buffer that samples contiguous sequences of transitions.

Wraps a ReplayBuffer for storage and an EpisodeTracker for episode-aware sequence sampling. Sequences never cross episode boundaries.

Implementations

impl SequenceReplayBuffer

pub fn new(capacity: usize, obs_dim: usize, act_dim: usize) -> Self

Create a new sequence replay buffer with given capacity and dimensions.

pub fn push_slices( &mut self, obs: &[f32], next_obs: &[f32], action: &[f32], reward: f32, terminated: bool, truncated: bool, ) -> Result<(), RloxError>

Push a single transition, notifying the episode tracker.

pub fn sample_sequences( &self, batch_size: usize, seq_len: usize, seed: u64, ) -> Result<SequenceBatch, RloxError>

Sample batch_size sequences of seq_len consecutive transitions.

Each sequence is guaranteed to be within a single episode.

pub fn sample( &self, batch_size: usize, seed: u64, ) -> Result<SampledBatch, RloxError>

Delegate to inner buffer for standard i.i.d. sampling.

pub fn len(&self) -> usize

Number of valid transitions currently stored.

pub fn is_empty(&self) -> bool

Whether the buffer is empty.

pub fn num_complete_episodes(&self) -> usize

Number of complete episodes currently tracked.

Trait Implementations

impl Debug for SequenceReplayBuffer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.