Ai2 releases Llama-B-8B, a Llama 3 8B model retrofitted to operate on bytes

Ai2 has released Llama-B-8B on Hugging Face, a byte-level autoregressive language model retrofitted from Llama 3 8B through a short additional training procedure.

The model operates over bytes instead of tokens and is licensed under the Llama 3 Community License for research and educational use.

It requires transformers 4.57.3 and the xlstm package, and the source notes that model outputs can be inaccurate and should be verified.