Ai2 releases new Stage 1 checkpoints with byte-level components pretrained
Original titleWe're making new Stage 1 checkpoints available with the byte-level components already trained & the original model's weights unchanged.
AISummary
Ai2 is making new Stage 1 checkpoints available, with the byte-level components already trained and the original model's weights left unchanged. Researchers can use them to test new architectures and train the full system without repeating that initial stage.
Source: Ai2 · x.comPublished · added here