The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Models in 2019

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
1 filter active, showing 68 of 1,072 recordsClear all

68

Models

34 organisations

46%

Open weights

31 open, 37 closed

10

Frontier

By Epoch's flag

100B

Largest traceable

DLRM-2020

2019

Span

30 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

newest 50 of 68
Models in 2019, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
Big Transfer (BiT-L)Google Brain2019-12928M *Closed
DD-PPOGeorgia Institute of Technology2019-12—Closed
MMLSTM (PTB)Beijing University of Posts and Telecommunications2019-1221M *Closed
MMLSTM (WT-2)Beijing University of Posts and Telecommunications2019-1232M *Closed
OpenAI FiveOpenAI2019-12159MClosed
OpenAI Five RerunOpenAI2019-12159MClosed
StarGAN v2NAVER2019-12—Open
StyleGAN2NVIDIA2019-1230MOpen
Base LM + kNN LM + Continuous CacheStanford University2019-11247M *Closed
CamemBERTFacebook2019-11335MOpen
MoCoFacebook AI2019-11375M *Open
MuZeroDeepMind2019-1137M *Closed
Noisy Student (L2)Carnegie Mellon University (CMU)2019-11480MClosed
Photo-Geometric AutoencoderUniversity of Oxford2019-11—Open
Sandwich TransformerAllen Institute for AI2019-11209M *Closed
Transformer - LibriVox + Decoding/RescoringFacebook2019-11296MOpen
Transformer-XL DeFINE (141M)University of Washington2019-11141M *Closed
XLM-RoBERTaFacebook AI2019-11550MOpen
AlphaStarDeepMind2019-10139MClosed
AlphaX-1Facebook AI Research2019-105MClosed
BART-largeFacebook AI2019-10406M *Open
DistilBERTHugging Face2019-1066MOpen
M4-50BGoogle2019-1050BClosed
T5-11BGoogle2019-1011BOpen
T5-3BGoogle2019-103BOpen
Adaptive Inputs + LayerDropFacebook AI Research2019-09423MOpen
ALBERTToyota Technological Institute at Chicago2019-0918MOpen
Megatron-BERTNVIDIA2019-094BClosed
Megatron-LM (1.2B)NVIDIA2019-091BClosed
Megatron-LM (8.3B)NVIDIA2019-098B *Closed
Mogrifier (d2, MoS2, MC) + dynamic evalDeepMind2019-0935MClosed
UDSMProtFraunhofer Heinrich Hertz Institute2019-0928M *Open
trRosettaNankai University2019-08—Open
BigBiGANGoogle2019-0786M *Open
EN^2AS with performance rewardBeijing Institute of Technology2019-0723M *Closed
PluribusFacebook AI Research2019-07—Closed
RoBERTa LargeFacebook2019-07355MOpen
AWD-LSTM + MoS + Partial ShuffledUniversity of Texas at Austin2019-0635MOpen
Char-CNN-BiLSTMCapital One2019-06—Closed
FixRes ResNeXt-101 WSLFacebook AI2019-06829M *Open
LaNet-L (CIFAR-10)Brown University2019-0644MOpen
PG-SWGANETH Zurich2019-06—Closed
Transformer-XL Large + Phrase InductionMassachusetts Institute of Technology (MIT)2019-06257M *Closed
Walking Minotaur robotUniversity of California (UC) Berkeley2019-06—Closed
XLMFacebook2019-06665M *Open
XLNetCarnegie Mellon University (CMU)2019-06340MOpen
AWD-LSTM-DRILL + dynamic evaluation† (WT2)IDIAP2019-0534M *Open
CPC v2DeepMind2019-05303M *Closed
DLRM-2020Facebook AI2019-05100BClosed
EfficientNet-L2Google2019-05480M *Open

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made