oa::ml::nn::Swiglu
Donor-compatible SwiGLU MLP with optional projection biases.
Declaration
pub struct Swiglu { /* private fields */ }Public Rust declaration.
Public Methods
Associated Functions
Public Method Documentation
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
No public source comment is attached to this declaration.
Construct gate, up, and down projections with deterministic Xavier weights. Errors Returns an error when dimensions are zero, shape arithmetic overflows, or parameter allocation and registration fail.
No public source comment is attached to this declaration.