compute_gae_batched

Function compute_gae_batched 

Source
pub fn compute_gae_batched(
    rewards: &[f64],
    values: &[f64],
    dones: &[f64],
    last_values: &[f64],
    n_steps: usize,
    gamma: f64,
    gae_lambda: f64,
) -> (Vec<f64>, Vec<f64>)
Expand description

Batched GAE: compute GAE for multiple environments in a single call.

All inputs are flat slices of length n_envs * n_steps, laid out as [env0_step0, env0_step1, ..., env1_step0, env1_step1, ...]. last_values has length n_envs.

Returns (advantages, returns) each of length n_envs * n_steps.

ยงPanics

Panics in debug builds if input slice lengths do not match n_envs * n_steps.