Language models from United States of America in 2021
18
Models
10 organisations
67%
Open weights
12 open, 6 closed
3
Frontier
By Epoch's flag
1.6T
Largest traceable
Switch
2021
Span
13 with a traceable size
Releases
by monthOrganisation
Records
18| Model | Organisation | Released | Parameters | Weights |
|---|---|---|---|---|
| Contriever | Meta AI | 2021-12 | 110M * | Open |
| GLaM | 2021-12 | 1.2T | Closed | |
| LongT5 | Google Research | 2021-12 | 3B | Open |
| T-NLRv5 XXL | Microsoft | 2021-12 | 5B | Closed |
| XGLM-7.5B | Meta AI | 2021-12 | 8B | Open |
| CodeT5-base | Salesforce | 2021-11 | 220M * | Open |
| Megatron-Turing NLG 530B | Microsoft | 2021-10 | 530B | Closed |
| S4 | Stanford University | 2021-10 | 249M * | Open |
| FLAN 137B | Google Research | 2021-09 | 137B | Closed |
| Turing ULRv5 | Microsoft | 2021-09 | 2B | Closed |
| XLMR-XXL | Facebook AI Research | 2021-08 | 11B | Open |
| Codex | OpenAI | 2021-07 | 12B * | Closed |
| DeBERTa | Microsoft | 2021-06 | 2B | Open |
| ByT5-XXL | 2021-05 | 13B * | Open | |
| Generative BST | Facebook AI Research | 2021-03 | 9B | Open |
| Unicorn | Allen Institute for AI | 2021-03 | 11B | Open |
| SRU++ Large | ASAPP | 2021-02 | 234M | Open |
| Switch | 2021-01 | 1.6T | Open |
An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.
Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.
Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.