oa::ml::byte
Module published by the oa::ml module.
MdRust public API
Public Functions
Public Constants & Variables
Function Documentation
Greedily decode one byte from each FP32 logit row. This is an explicit submission, completion, and compact host-read boundary. Errors Returns an error unless logits are rank-one [256] or rank-two [N, 256] FP32, or execution/readback fails.
Greedily decode logits and require exact UTF-8 output. Errors Returns the errors from decode or crate::ErrorKind::DataLoss when the decoded byte stream is not UTF-8.
Upload raw bytes as a rank-one U8 Matrix on this thread’s default engine. Errors Returns an error when the default engine cannot be initialized or when allocation or upload fails.
Upload raw bytes as one batched U8 sequence [1, S] on this thread’s default engine. Errors Returns an error when the default engine cannot be initialized or when allocation or upload fails.
Upload raw bytes as one batched U8 sequence [1, S] on a particular engine. Errors Returns an error when allocation or upload fails.
Upload raw bytes as a rank-one U8 Matrix on a particular engine. Errors Returns an error when allocation or upload fails.
Upload UTF-8 text without tokenization or normalization on this thread’s default engine. Errors Returns an error when the default engine cannot be initialized or when allocation or upload fails.
Upload UTF-8 text without tokenization or normalization on a particular engine. Errors Returns an error when allocation or upload fails.
Sample one byte from each FP32 logit row. Errors Returns an error for an invalid 256-class logit contract, sampling contract, execution, or readback failure.