oa::ml::matrix::silu_mul

Apply SiLU(gate) * up to concatenated halves of the final input axis. Errors Returns an error unless input is F32 with final extent exactly twice the nonzero intermediate_size, or runtime recording fails.

FnRust public API

Function Documentation

pub fn silu_mul(
	input: &Matrix,
	intermediate_size: usize
) -> Result<Matrix>

Apply SiLU(gate) * up to concatenated halves of the final input axis. Errors Returns an error unless input is F32 with final extent exactly twice the nonzero intermediate_size, or runtime recording fails.