Get the ffizzi app! Create & share event invites
All Wisconsin Events
Weekly Highlight · Wisconsin Oct 5–12, 2026

An AI That Never Heard of 1930

Two researchers bring a language model trained only on pre-1931 print to a free talk at UW-Madison's Memorial Library.

Wisconsin flag

Ask the machine about television and it hesitates. The word sits oddly in its ear. Perhaps you mean a tele-vision apparatus, it offers — Mr. Baird's curious invention for transmitting moving images by wireless, demonstrated at Selfridges last spring. It doubts the device will ever supplant the wireless set.

This is not a chatbot pretending to be a man from 1930. It is a 13-billion-parameter language model that has read nothing published after December 31, 1930 — no Wikipedia, no web crawl, no Reddit, no modern code. Its entire world ends at midnight on New Year's Eve, 1930, and it knows it not at all. On Wednesday, October 7, two of the researchers behind it, Nick Levine and Alec Radford, will present the project in a free public talk at 224 Memorial Library on the UW-Madison campus, from 4 to 5:30 p.m.

The model is called talkie-1930-13b, and it was trained on 260 billion tokens of historical English text: books, newspapers, scientific journals, patents, periodicals, and case law. The team — Levine, University of Toronto computer science professor David Duvenaud, and Radford, the lead author of OpenAI's original GPT-1 and GPT-2 papers — released it in April 2026 under an Apache 2.0 license, with both a base checkpoint and an instruction-tuned variant. That tuned version learned to follow instructions not from the post-2020 datasets every modern assistant relies on, but from period etiquette manuals, letter-writing guides, and encyclopedias. The team also trained an identical twin on modern web text, FineWeb, so the two could be compared on equal architecture and parameter count.

The idea belongs to a small but growing research tradition. The team credits Owain Evans with the phrase "vintage language models" — LMs trained only on historical text — and points to earlier projects including Ranke-4B, Mr. Chatterbox, and Machina Mirabilis. Talkie is, by the team's account, the largest vintage model yet built, and they say they are already training a GPT-3-level successor.

The point is not nostalgia. It is contamination. Modern language models are so thoroughly steeped in the internet that researchers struggle to tell what a model genuinely reasons out from what it has memorized. Benchmarks leak into training data; capabilities get overestimated. A model trained only on pre-1931 print is contamination-free by construction — nothing from HumanEval, or any other benchmark written after 1930, could possibly appear in its corpus. That makes it an unusually clean testbed for asking how a model generalizes, predicts, and reasons when it has never seen the answers.

The experiments get strange fast. The team measured how "surprising" short descriptions of historical events were to the model, and found the surprise rising after its knowledge cutoff — sharply in the 1950s and 1960s, then leveling off. They are testing whether a model trained up to 1911 could, in principle, arrive at general relativity the way Einstein did in 1915. And they have watched the model pick up skills no one in 1930 could have taught it: given in-context examples, talkie has written its first lines of Python, a language that would not exist for decades.

It also, inevitably, knows things it shouldn't. The team's own write-up notes that talkie's detailed grasp of the Roosevelt presidency and New Deal legislation — a president who took office in 1933, policies enacted years after the cutoff — is an example of imperfect filtering of the pre-training corpus. Some text about the future slipped through the archive's net. The model's public chat interface carries a blunt disclaimer: talkie reflects the culture and values of the texts it was trained on, not the views of its authors, and it can produce outputs that are inaccurate or offensive. Outputs are moderated, though the moderation only applies at the end of a streaming reply, so objectionable content can flash by before it is flagged.

That tension — between a clean historical record and the messy reality of archives — is exactly what the Memorial Library talk is framed around. The event description promises discussion of historical simulation, data stewardship, and the ethics of digital archives. It is a fitting setting. Room 224 sits inside the library's Digital Scholarship Hub, a second-floor space in the same building that houses the university's microforms and media collection, its reference stacks, and its East European and East Asian collections. The questions the researchers raise — who decides what gets digitized, what a corpus leaves out, what it accidentally carries forward — are the daily work of the librarians down the hall.

The talk follows a burst of attention that pushed the project well beyond the AI research bubble. By midday on April 28, 2026, the release had hit the front page of Hacker News, drawn a write-up from Simon Willison, and set off debate on r/singularity about what a model with no modern knowledge reveals about reasoning itself. The New York Times' Hard Fork podcast took it up on May 1, 2026, describing it as a vintage LLM trained exclusively on pre-1931 data and built by three researchers, including "the lead author of the GPT-1 paper." A companion app, Talk to the Past, later put the model behind a period-typography interface — IM Fell English for letters, Cutive Mono for transmitted dispatches, cream paper and ink-blue type — billing its correspondent as a stranger who has read Wodehouse and Woolf, Poe and Conan Doyle, Edith Wharton, and the Times of London through October 1930, and not a word published after.

Radford's presence is part of the draw. He is a former OpenAI researcher whose fingerprints are on GPT-1, GPT-2, DALL-E, and Whisper — a résumé that makes his turn toward a deliberately crippled, deliberately antique model read as a statement about what modern AI evaluation can and cannot prove. Duvenaud, his collaborator, is a University of Toronto professor and a former alignment-evals lead at Anthropic. Levine rounds out the trio.

There is no ticketing and no capacity gate for the Memorial Library event. It is free, open, and walk-in, hosted under the university libraries' events calendar and tagged for computer science, humanities, and digital scholarship. Accommodation requests can be made by emailing [email protected].

What an audience will actually see is a model that can discuss the moving pictures — All Quiet on the Western Front at the Capitol Theatre — or mention Lindbergh and the new aerodromes, and that grows charmingly bewildered when asked about the future. That bewilderment is not a feature. It is the absence of training data after 1930, the sound of a mind that stops at a date and cannot be told what came next.

ffizzi weekly highlight · independent recap, not an official Talkie: A Vintage Language Model from 1930 publication