oa::ml::matrix::swiglu

Apply SiLU(gate) * up elementwise. Errors Returns an error unless both inputs are equal-shape F32 on the same engine, or runtime recording fails.

FnRust public API

Function Documentation

pub fn swiglu(
	gate: &Matrix,
	up: &Matrix
) -> Result<Matrix>

Apply SiLU(gate) * up elementwise. Errors Returns an error unless both inputs are equal-shape F32 on the same engine, or runtime recording fails.