Every major AI model in the order it shipped — from AlexNet and Google's Transformer paper to trillion-parameter open weights landing weekly. Expand any release to see what actually changed, in plain English.
174
releases tracked
43
labs
91
open weights
New here? How AI grew up, in six steps
Pick a step to read what changed and see only its releases.
Bars are the number of releases in each step. Most of this timeline shipped in the last two years.
In 1997 the state of the art was remembering the start of a sentence by the time you reached the end. Today a model opens a laptop and works on its own for hours.
see→read→help→perceive→think→do
Each step is the moment the kind of progress changed. Pick one above to read what happened and see only its releases — or scroll on for the full timeline, every release in order.
1
Learning to see and remember
Like a small child learning to recognise things, pick up what words mean, and hold a thought in their head long enough to finish a sentence.
Networks learned to label photographs, to place words with similar meanings near each other, and — with LSTM — to remember the start of a sentence by the time they reached the end. Then the Transformer stopped reading one word at a time and took in a whole page at once.
Why it mattered: Reading everything at once instead of word by word is what made training on the entire internet affordable. Nothing after this works without it.
LSTMAlexNetword2vecTransformer
2
Reading the whole library
Like someone who has read every book ever written and can finish any sentence you start — but has no idea what you actually want from them.
Feed a Transformer enough text and it predicts the next word extremely well. Make it big enough — GPT-3 at 175 billion parameters — and it starts handling tasks nobody trained it on, from a couple of examples in the prompt. A second track ran quietly alongside: the same design pointed at images (ViT), pictures generated from noise (diffusion), and CLIP linking words to visuals.
Why it mattered: Scale alone produced surprising ability. But a model that can continue any text is not the same as a model that will help you — and the vision work happening in parallel is what made the multimodal models of step 4 possible.
GPT-1BERTGPT-3ViTdiffusionCLIP
3
Learning manners
Like a brilliant but rambling graduate who is finally taught to answer the question you actually asked.
People ranked competing answers and the model was trained toward what they preferred. A model 100× smaller, trained this way, was preferred over raw GPT-3. Wrap that in a chat box and you get ChatGPT.
Why it mattered: Being helpful turned out to be a training choice, not a size problem. This is the step that turned a research curiosity into a product.
InstructGPTChatGPTStable Diffusion
4
Gaining eyes, ears and specialists
Like gaining sight and hearing — and learning to consult the right specialist instead of doing everything personally.
Models began handling images, audio and video in the same system as text. At the same time, mixture-of-experts split a huge model into specialists and woke only a couple per word, so models could grow enormous without costing enormous amounts to run.
Why it mattered: Total size and running cost stopped being the same thing. That split is why frontier-quality AI became cheap enough for everyday use.
GPT-4GeminiMixtralGPT-4o
5
Learning to think before speaking
Like being taught to work the problem out on paper first, instead of blurting out the first thing that comes to mind.
Models were trained to reason privately before answering — sometimes for minutes. On a qualifying exam for the International Mathematics Olympiad this took one model from roughly 13% to 83%.
Why it mattered: A second way to get smarter, with nothing to do with size: let the model think for longer at the moment you ask it. Suddenly there were two dials, not one.
o1DeepSeek-R1Claude 3.7Gemini 2.5
6
Doing the work, not just advising
Like an assistant who stops giving you suggestions, opens the laptop, and gets on with the task for the rest of the afternoon.
Models started using tools mid-thought, driving a real mouse and keyboard, and holding a single job together for hours rather than minutes. Releases went from roughly annual to weekly, and open weights caught up to within touching distance of the closed frontier.
Why it mattered: The product stopped being an answer and became work performed. That is what everything on this page has been building toward.
Three tiers after a staged government-safety review from late June. Sol is tuned for biology, chemistry and cybersecurity, and reported ~54% more token-efficient on coding.
What changed in this release
Three tiers: Sol, Terra and Luna, from strongest to cheapest.
Held back for a staged government safety review before public release.
Sol is reported to be about 54% more token-efficient on coding, and is tuned for biology, chemistry and cybersecurity.
What it means
The safety review is the story. Governments now sit between a frontier model being finished and being released.
Started a from-scratch open family for agents, with Super and Ultra promised for 2026.
What changed in this release
NVIDIA's first new Nemotron generation since 2024, and a genuinely new family rather than a retuned version of someone else's model — the Llama-Nemotron releases in between were fine-tunes and distills of Meta's Llama.
30 billion parameters in total but only about 3 billion used per word, small enough to run on a single workstation GPU.
Shipped as the first of three sizes, with Super and Ultra announced for 2026.
What it means
The company that sells the hardware also giving away the models is a hedge: NVIDIA earns nothing directly from Nemotron, but every open model that runs well on its GPUs makes the GPUs harder to replace.
Generation and editing in one open model, aimed at production pipelines rather than demos.
What changed in this release
A 32-billion-parameter rebuild of FLUX.1, handling both generating an image from scratch and editing an existing one in a single model.
Built around production use — consistent characters and readable text across a series of images, rather than one impressive sample.
What it means
Image models had been judged on single showpiece outputs. Getting the same face and the same logo to survive across a whole set is what a real design or marketing pipeline actually needs.
Cut to 10B active parameters, making agentic tool-calling cheap enough to run in a loop.
What changed in this release
Dropped from M1's 45.9 billion active parameters to 10 billion, while keeping 230 billion in reserve.
Tuned for agentic work — long chains of tool calls rather than single answers.
What it means
An agent re-reads and re-answers dozens of times to finish one task, so the cost per step is what decides whether it is affordable to run at all. Cutting the active size is what moved agents from demo to routine.
A trillion open-weight parameters tuned for tool use, top of Hugging Face downloads within a day.
What changed in this release
A trillion parameters in total, but only 32 billion used for any given word, so it runs far cheaper than its size suggests.
Trained specifically to use tools — calling out to search, code and APIs mid-answer rather than replying from memory alone.
Released under a near-MIT licence that permits commercial use.
What it means
It became the fastest-downloaded model on Hugging Face within a day of release. The largest open-weight model to date was also one of the most permissively licensed, which set the terms every later Chinese open release had to match.
Hybrid attention bought a million-token window and 80k tokens of visible reasoning.
What changed in this release
Mixed two kinds of attention — the mechanism a model uses to look back over what it has read — so the expensive kind runs only where it is needed.
That bought a one-million-token context window and up to 80,000 tokens of visible reasoning, with the weights released openly.
What it means
Long context had been a premium feature of closed models. Handing it to anyone with the hardware to run it made whole-codebase and whole-archive work an open capability.
Native 2K output in about three seconds, and small text that stayed legible.
What changed in this release
Produced 2K-resolution images directly, rather than generating something smaller and upscaling it afterwards.
Roughly three seconds per image, and small text inside the picture — signage, labels, packaging — came out readable, which had been the standard failure of image models.
What it means
Legible small text is the difference between a picture of a poster and a usable poster. It is what moved image generation from illustration into commercial design work.
TikTok's owner reached the frontier tier and priced it to be undercut by nobody.
What changed in this release
ByteDance's first model to trade blows with GPT-4o and Claude 3.5 Sonnet rather than trailing them.
Priced at a small fraction of the American models, and still claimed to be sold at a profit.
Shipped alongside vision and real-time voice versions built on the same backbone.
What it means
TikTok's owner has more places to put a model in front of people than almost any lab on earth. Its arrival at the frontier tier is why Chinese model prices fell across the board through 2025.
Shipped the same day as DeepSeek-R1 — the o1 recipe reproduced twice at once.
What changed in this release
Moonshot's first reasoning model — one that works through a problem step by step before answering, rather than replying immediately.
Reached roughly the level of OpenAI's o1, and was trained with reinforcement learning that scaled the length of its own reasoning.
What it means
It shipped the same day as DeepSeek-R1. Two Chinese labs independently matching o1 within hours of each other said the reasoning recipe had stopped being a secret.
Answered Sora seven days later at 4K, and understood lens and framing terms.
What changed in this release
Arrived seven days after Sora opened to the public, at up to 4K against Sora's 1080p.
Followed camera language in the prompt — lens type, depth of field, shot framing — rather than just the subject.
What it means
Taking direction in the vocabulary a director already uses is what makes a video tool something a crew can brief, instead of a slot machine you re-roll until a clip looks right.
5T tokens with the data, code and checkpoints published alongside the weights.
What changed in this release
Ai2 published not just the weights but the training data, the code, the recipe and the half-finished checkpoints from partway through training.
Trained on 5 trillion words of text, enough to pass OpenAI's GPT-3.5 Turbo on common tests.
What it means
Most 'open' models release only the finished weights, which lets you run the model but not check how it was made. This one could be audited and rebuilt from scratch — the difference between free software and a free binary.
Spent inference-time compute on a hidden chain of thought. Opened a second scaling axis after pre-training.
What changed in this release
Thinks privately before answering, sometimes for minutes.
Trained to reason through problems rather than to produce a fluent answer immediately.
Jumped from roughly 13% to 83% on a qualifying exam for the International Mathematics Olympiad.
What it means
A second way to make AI smarter that has nothing to do with size: let it think longer at the moment you ask. This is the origin of every 'reasoning' model below.
Ran on a single H100 while trading blows with models twice its size.
What changed in this release
Google's small open models were rebuilt so the 27-billion-parameter version fits on a single high-end GPU.
At that size it matched models with roughly twice as many parameters, which had not been true of the first Gemma.
What it means
Running a capable model became a single-machine decision rather than a cluster decision — the practical start of open weights being a deployment choice instead of a compromise.
Two minutes of finished song — vocals, lyrics and backing — from one prompt.
What changed in this release
Generated a complete song — vocals, lyrics, instruments and arrangement together — from a single text prompt, rather than an instrumental loop or a synthesised voice on its own.
Two minutes of finished audio in seconds, and the first version opened to everyone rather than a waitlist.
What it means
Music had been the last creative field where the AI output was obviously unusable. This is where that stopped being true, and where the argument over training on copyrighted recordings stopped being hypothetical.
The most serious challenger to attention: a state-space model that scales linearly with length instead of quadratically. Influential, but the Transformer held the frontier.
What changed in this release
Attention compares every word with every other word, so doubling the input roughly quadruples the work.
Mamba keeps a running summary instead, so cost grows in a straight line with length — around 5× faster on long inputs.
What it means
The most credible attempt to replace the Transformer. It did not win — attention still holds the frontier — but the ideas turn up inside hybrid models, and it is worth knowing the field did try alternatives.
80+ languages, with the training data and filtering published — an open answer to Copilot.
What changed in this release
An open code model trained on more than 80 programming languages, released with the training data, the filtering rules and the evaluation code alongside the weights.
Let repository owners check whether their code was used and ask for it to be removed — the first code model to take that seriously.
What it means
GitHub Copilot had made code generation useful and closed at the same time, and its training on public repositories was already in dispute. This was the open counter-proposal: same capability, with the provenance of the training data open to inspection.
Open weights that ran on a consumer GPU. Spawned an entire ecosystem of forks, LoRAs and UIs.
What changed in this release
Ran the diffusion process in a compressed space, cutting the compute needed by roughly 50×.
Released the full weights publicly, so it ran on an ordinary gaming graphics card.
What it means
Image generation stopped being something you rented from a company and became something you owned. Both the creative explosion and the flood of misuse start here.
Showed the field had been training models far too large on far too few tokens. Redirected everyone's compute budgets.
What changed in this release
Found that everyone had been building models too big and feeding them too little text.
A 70B model trained on far more data beat a 280B model trained the old way.
What it means
Redirected the industry's spending overnight. Bigger stopped being automatically better, and smaller-but-better-fed models made AI dramatically cheaper to run.
Trained on human preference rankings (RLHF) so the model followed instructions instead of just continuing text. The technique behind ChatGPT.
What changed in this release
Humans ranked competing model answers, and the model was trained to produce what they preferred.
This is 'RLHF' — reinforcement learning from human feedback.
A 1.3B model trained this way was preferred over the 175B GPT-3.
What it means
The step that turned a text-continuation engine into an assistant that does what you ask. Being helpful turned out to be a training choice, not a size problem.
DeepMind's first large-scale LM study, published alongside a detailed harms analysis.
What changed in this release
DeepMind's systematic study of what does and does not improve as models get bigger.
Published alongside an unusually frank analysis of the harms.
What it means
Showed scale helps enormously with knowledge and comprehension, but barely at all with logical reasoning — a gap that took another three years to close.
Trained on 400M image–caption pairs to place pictures and the words describing them in the same space. This is what lets you type a prompt and get a matching image.
What changed in this release
Trained on 400 million image–caption pairs scraped from the web.
Learned to put a picture and the words describing it in the same mathematical space, so 'a dog on a skateboard' sits near an actual photo of one.
Could classify images it was never explicitly trained on, just by comparing against text descriptions.
What it means
The missing link between language and pictures. Typing a prompt and getting a matching image only works because something taught the machine which words go with which visuals — this is that something.
Chopped an image into patches and fed them to a Transformer like words. One architecture now covered both text and vision.
What changed in this release
Cut an image into a grid of small patches and treat each patch like a word in a sentence.
The same Transformer built for text then works on pictures, with no vision-specific machinery.
What it means
One architecture for everything. This is why a single model can now handle text, images, audio and video together instead of needing a separate specialist per sense.
Generate an image by starting from pure noise and repeatedly removing a little of it. The method behind DALL·E 2, Stable Diffusion, Midjourney, Sora and Veo.
What changed in this release
Take a real image, add noise step by step until it is static, then train a network to undo one step at a time.
To generate something new, start from pure static and run the undoing process.
More stable to train and higher quality than GANs, which often collapsed.
What it means
This is the engine inside essentially every AI image and video tool you have used — DALL·E 2, Stable Diffusion, Midjourney, Sora, Veo. The pictures come from noise.
Bidirectional encoder that dominated NLP benchmarks for years. Encoder-only, so it was never built to be prompted.
What changed in this release
Read text in both directions at once by hiding random words and learning to fill the blanks.
Set new records across essentially every language-understanding benchmark on release.
What it means
Quietly went into Google Search in 2019 and improved results for millions of queries. Great at understanding text, but it cannot write — it was never built to be prompted.
Threw out recurrence and kept only attention. Every model below this line — GPT, BERT, Claude, Gemini, Llama — is a Transformer.
What changed in this release
Removed recurrence — the old approach of reading text strictly word by word, in order.
Used only 'attention': every word looks at every other word simultaneously and decides what is relevant.
Because it no longer had to wait for the previous word, training could run massively in parallel on many chips at once.
What it means
The single most important paper on this page. Every major model after 2018 — GPT, BERT, Claude, Gemini, Llama, all of them — is a Transformer. The parallelism it unlocked is what made training on the entire internet financially possible.
Won ImageNet by such a margin that the entire field switched to deep neural networks within a year.
What changed in this release
Trained a deep neural network on two consumer graphics cards instead of ordinary processors.
Cut the ImageNet photo-labelling error rate from about 26% to 15% — a bigger jump than the previous several years combined.
What it means
This is the moment computers got genuinely good at seeing. Almost every AI advance since traces back to the realisation that gaming graphics cards could train neural networks.
Recurrent neural networks (RNNs) read text one step at a time, but forgot the start of a paragraph by the end. LSTM gave them a memory that lasted, and ran speech recognition, translation and text generation for two decades — until the Transformer removed recurrence entirely.
What changed in this release
Plain recurrent networks (RNNs) read a sequence one step at a time, carrying a running memory — but that memory faded within a few dozen steps, so they forgot the start of a paragraph by the end of it.
LSTM added gates that explicitly decide what to keep, what to discard and what to output, so information could survive hundreds of steps.
What it means
The architecture behind roughly two decades of sequence AI — Google Translate, Siri, autocomplete. It is also what the Transformer replaced: reading strictly one step at a time cannot be parallelised, which capped how large these models could ever get.
Open weightsText
Dates are public announcement dates, compiled 28 Jul 2026 from lab documentation, release trackers and public reporting. Anthropic and the pre-2019 research papers are checked against primary sources; the rest are corroborated across independent trackers, and a handful of 2026 dates differ by days between them. Covers the foundational architectures (2012–2017) and foundation-model releases from named labs since — not fine-tunes, distills, quantizations, or per-size variants of a family already listed.