Primers • AI
Overview
- Here’s a hand-picked selection of articles on AI fundamentals/concepts that cover the entire process of building neural nets to training them to evaluating results.
Design/Architecture
- ML Algorithms Comparative Analysis
- DL Architectures Comparative Analysis
- Prompt Engineering
- Generative Adversarial Networks (GANs)
- Diffusion Models
- Graph Neural Networks
- Attention
- Separable Convolutions
- Inductive Bias
- Convolutional Neural Networks
- Deep Reinforcement Learning
- Debugging Model Training
- Standardization vs. Normalization
- Multiclass vs. Multilabel Classification
- MLOps Tooling
- MLOps Testing
Training
- Xavier Initialization
- Padding
- Regularization
- Gradient Descent and Backprop
- Activation Functions
- Loss Functions
- Activation Functions
- Fine-tuning Models
- Splitting Datasets
- Batchnorm
- Dropout
- Double Descent
- Fine-Tuning and Evaluating BERT
- Training Loss > Validation Loss?
- SVM Kernel/Polynomial Trick
- Bias Variance Tradeoff
- Gradient Accumulation and Checkpointing
- Parameter Efficient Fine-Tuning
- Hypernetworks
- Multi-GPU Parallelism
Speech
Vision
Models
NLP
- Word Vectors/Embeddings
- NLP Tasks
- Preprocessing
- Tokenization
- Sampling
- Neural Architectures
- Attention
- Transformers
- Token Sampling Methods: Greedy, Beam Search, Temperature, top-k, top-p
- Autoregressive vs. Autoencoder Models
- Language Models
- Overview of Large Language Models
- Machine Translation
- Knowledge Graphs
- AI Text Detection Techniques
- Named Entity Recognition
- Textual Entailment
- LLMOps
- Convolutional Neural Networks for Text Classification
- Relationship between Hidden Markov Model and Naive Bayes
- Maximum Entropy Markov Models and Logistic Regression
- Conditional Random Fields for Sequence Prediction
Models
Multimodal
Models
Privacy-Preserving/On-Device AI
Evaluation
MLOps/Production
Miscellaneous
- Chain Rule
- Bayes’ Theorem
- Probability Calibration
- N-Dimensional Tensor Product
- PyTorch vs. TensorFlow
- Approximate Nearest Neighbors – Similarity Search
- Transferability Estimation
- TensorBoard
- Information Retrieval Methods