Notable Models

Notable NLP Models

Model
Type
Features

BoW, TF-IDF

Feature Extraction

Sparse representations

Word2Vec

Statistical/Neural

Skip-gram, CBOW

ELMo

Neural (RNN-based)

Contextual embeddings

BERT

Transformer

Bidirectional encoder

GPT-3

Transformer (LLM)

Generative

T5

Transformer (LLM)

Text-to-text

RoBERTa

Optimized Transformer

Better pretraining

ALBERT

Compressed Transformer

Shared parameters

GloVe

Matrix-based Embeddings

Co-occurrence stats

Transformer-XL

Transformer variant

Long context handling

XLNet

Permuted Transformer

Autoregressive + bidirectional

Turing-NLG

Transformer (LLM)

High-quality generation

Last updated