Module priority

Module priority 

Source
Expand description

Sum-tree backed prioritized experience replay.

Provides O(log N) prefix-sum sampling and priority updates for Prioritized Experience Replay (Schaul et al., 2015).

Structs§

LAPConfig
Loss-Adjusted Prioritization (LAP) configuration.
PrioritizedReplayBuffer
Prioritized experience replay buffer backed by a sum-tree.
PrioritizedSampledBatch
A sampled batch with importance-sampling weights.
SumTree
Binary sum-tree for O(log N) prefix-sum queries.

Functions§

compute_lap_priorities
Compute LAP priorities from TD errors and losses.
compute_td_priorities
Convenience: compute priorities from TD errors only (standard PER).