Notable Models
Notable NLP Models
Model
Type
Features
BoW, TF-IDF
Feature Extraction
Sparse representations
Word2Vec
Statistical/Neural
Skip-gram, CBOW
ELMo
Neural (RNN-based)
Contextual embeddings
BERT
Transformer
Bidirectional encoder
GPT-3
Transformer (LLM)
Generative
T5
Transformer (LLM)
Text-to-text
RoBERTa
Optimized Transformer
Better pretraining
ALBERT
Compressed Transformer
Shared parameters
GloVe
Matrix-based Embeddings
Co-occurrence stats
Transformer-XL
Transformer variant
Long context handling
XLNet
Permuted Transformer
Autoregressive + bidirectional
Turing-NLG
Transformer (LLM)
High-quality generation
Last updated