The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Closed-weight models in 2019

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
2 filters active, showing 37 of 1,072 recordsClear all

37

Models

22 organisations

0%

Open weights

0 open, 37 closed

5

Frontier

By Epoch's flag

100B

Largest traceable

DLRM-2020

2019

Span

15 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

37
Closed-weight models in 2019, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
Big Transfer (BiT-L)Google Brain2019-12928M *Closed
DD-PPOGeorgia Institute of Technology2019-12—Closed
MMLSTM (PTB)Beijing University of Posts and Telecommunications2019-1221M *Closed
MMLSTM (WT-2)Beijing University of Posts and Telecommunications2019-1232M *Closed
OpenAI FiveOpenAI2019-12159MClosed
OpenAI Five RerunOpenAI2019-12159MClosed
Base LM + kNN LM + Continuous CacheStanford University2019-11247M *Closed
MuZeroDeepMind2019-1137M *Closed
Noisy Student (L2)Carnegie Mellon University (CMU)2019-11480MClosed
Sandwich TransformerAllen Institute for AI2019-11209M *Closed
Transformer-XL DeFINE (141M)University of Washington2019-11141M *Closed
AlphaStarDeepMind2019-10139MClosed
AlphaX-1Facebook AI Research2019-105MClosed
M4-50BGoogle2019-1050BClosed
Megatron-BERTNVIDIA2019-094BClosed
Megatron-LM (1.2B)NVIDIA2019-091BClosed
Megatron-LM (8.3B)NVIDIA2019-098B *Closed
Mogrifier (d2, MoS2, MC) + dynamic evalDeepMind2019-0935MClosed
EN^2AS with performance rewardBeijing Institute of Technology2019-0723M *Closed
PluribusFacebook AI Research2019-07—Closed
Char-CNN-BiLSTMCapital One2019-06—Closed
PG-SWGANETH Zurich2019-06—Closed
Transformer-XL Large + Phrase InductionMassachusetts Institute of Technology (MIT)2019-06257M *Closed
Walking Minotaur robotUniversity of California (UC) Berkeley2019-06—Closed
CPC v2DeepMind2019-05303M *Closed
DLRM-2020Facebook AI2019-05100BClosed
RaptorX-ContactToyota Technological Institute at Chicago2019-05—Closed
BERT-Large-CAS (PTB+WT2+WT103)Amazon2019-04395M *Closed
MuseNetOpenAI2019-042B *Closed
Neuro-Symbolic Concept LearnerMassachusetts Institute of Technology (MIT)2019-04—Closed
Transformer-XL + RMS dynamic evalUniversity of Edinburgh2019-04257MClosed
True-Regularization+Finetune+Dynamic-EvalMobvoi2019-047MClosed
WeNet (Penn Treebank)Amazon2019-0423M *Closed
Hanabi 4 playerDeepMind2019-02764,000Closed
NMT Transformer 437MGoogle2019-02438MClosed
SDECarnegie Mellon University (CMU)2019-02—Closed
Transformer ELMoAllen Institute for AI2019-0156MClosed

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made