compute_token_kl

rlox_core::llm::ops::f32_ops

Function compute_token_kl 

Source 
pub fn compute_token_kl(
    log_probs_policy: &[f32],
    log_probs_ref: &[f32],
) -> Result<f32, RloxError>
Expand description

Token-level KL divergence: sum(exp(log_p) * (log_p - log_q)).