Talkie: open-weight 13B LLM trained only on pre-1930 data

Researchers including David Duvenaud and Alec Radford announced Talkie, an open-weight 13B-parameter LLM trained and finetuned on a newly curated dataset containing only pre-1930 text. Soumith Chintala shared it as a fun test of time for the model.