974 technical terms and definitions
leader election algorithms, leader election, election algorithms
Leader Election Algorithms Introduction & Motivation Leader Election Algorithms addresses a central problem in distributed-systems process control and election-time-rounds…
arena, elo
LLM Leaderboards and Rankings Major Leaderboards Chatbot Arena (LMSYS) Human preference-based ranking using Elo scores: Users chat with two anonymous models Choose which response…
evaluation
Leaderboard climbing refers to optimizing specifically for benchmark performance, sometimes at the expense of genuine capability. The problem: Models or training pipelines tuned…
leadframe package warpage cure prediction, leadframe package warpage, package warpage cure, warpage cure prediction, leadframe package, package warpage, warpage cure
Leadframe Package Warpage Cure Prediction with Machine Learning Introduction & Motivation Leadframe Package Warpage Cure Prediction with Machine Learning addresses a central…
industry
A leading-edge or advanced node refers to the latest and smallest process technology available from foundries at any given time. As of 2024-2025, this means 3nm and 2nm class…
business & strategy
Leading-Edge Node is the most advanced production process generation offering highest transistor density and performance potential - It is a core method in advanced semiconductor…
manufacturing operations
Leak Rate is the measured rate of pressure rise or gas ingress indicating chamber sealing integrity - It is a core method in modern semiconductor facility and process execution…
prevent, validate
Data Leakage is the most insidious problem in applied machine learning — where information from outside the training dataset "leaks" into the model, producing artificially…
subthreshold leakage, gate leakage, standby power, junction leakage, GIDL, multi-Vth, power gating, body biasing, high-k dielectric
Leakage current is the current that flows through a transistor even when it's fully switched off, and it exists for several distinct physical reasons rather than one…
leakage current density prediction, leakage current density, current density prediction, leakage current, current density, density prediction
Leakage Current Density Prediction with Machine Learning Introduction & Motivation Leakage Current Density Prediction with Machine Learning addresses a central problem in gate…
subthreshold leakage control, gate leakage reduction, junction leakage mitigation, standby power reduction
Leakage current reduction addresses the power a transistor draws even when it is nominally switched off, a problem that overtook dynamic switching power as the dominant…
metrology
Leakage current test measures unwanted current flow through dielectrics and junctions — quantifying tiny currents at femtoamp to nanoamp levels that indicate defect density, trap…
leakage power distribution prediction, leakage power distribution, power distribution prediction, leakage power, power distribution, distribution prediction
Leakage Power Distribution Prediction with Machine Learning Introduction & Motivation Leakage Power Distribution Prediction with Machine Learning addresses a central problem…
leakage power prediction, leakage power, power prediction
Leakage Power Prediction with Machine Learning Introduction & Motivation Leakage Power Prediction with Machine Learning addresses a central problem in leakage power control…
leaky rectified linear unit, prelu, parametric relu, dying relu fix
Activation functions are the reason depth means anything. Stack a hundred linear layers with no nonlinearity between them and the whole thing collapses algebraically into a single…
reasoning
Lean integration involves connecting large language models with the Lean proof assistant — a modern formal verification system for mathematics and software — enabling AI systems…
production
Lean manufacturing is the the production philosophy that maximizes customer value while minimizing all forms of non-value-added work - it improves flow, quality…
scientific ml
Learnable Physics (Physics-Informed ML) is the interdisciplinary field at the intersection of deep learning and scientific computing that combines data-driven neural network…
Learnable Position Embedding is a position encoding method where position vectors are treated as trainable parameters — each position in the sequence has its own learned embedding…
neural architecture
Learned Layer Selection is a conditional computation method where a trainable routing policy determines which layers or computational blocks to execute for each specific input…
diffusion training, noise schedule
Learned noise schedule is a diffusion model technique where the noise addition schedule is optimized during training — rather than using fixed schedules like linear or cosine…
computer vision
Learned position embeddings are trainable parameter vectors assigned to each spatial position in a Vision Transformer's input sequence — providing the model with spatial location…
architecture
Learned Routing is routing policy optimized from data to map tokens to effective compute pathways - It is a core method in modern semiconductor AI serving…
robotics
Learned SLAM is the family of SLAM systems that replaces or augments classical geometric modules with neural components for feature extraction, matching, optimization, or mapping…
rag
Learned Sparse Retrieval is the retrieval method that learns sparse document representations enabling efficient approximate nearest neighbor search — Learned Sparse Retrieval…
model optimization
Learned Step Size is a quantization approach where scale or step-size parameters are optimized jointly with network weights - It adapts quantization granularity to each layer…
business
Learning curve is the relationship where unit cost or effort declines as cumulative production experience increases - Repetition drives efficiency gains through improved methods…
business & strategy
Learning Curve is the cost and efficiency improvement pattern achieved as cumulative production and operational experience increases - It is a core method in advanced…
neural architecture search
Learning Curve Prediction is forecasting final model performance from early epochs of training trajectories. - It supports early candidate selection and budget-aware search…
rlhf
RLHF (Reinforcement Learning from Human Feedback) is the technique of training AI models using human preferences as the reward signal — instead of a hand-crafted reward function…
hint learning compression, model compression, knowledge distillation
Hint Learning is a knowledge distillation technique that transfers knowledge from intermediate hidden layers of a large teacher network to corresponding layers of a smaller…
peak learning rate, adam learning rate, learning rate decay, learning rate transfer, cosine schedule, warmup steps, warmup ratio, warmup stable decay, maximal update parameterization, mup, critical batch size, hyperparameter transfer
Gradient descent on a quadratic with condition number 1,000 is fastest at a learning rate that is 99.9 percent of the one that blows the run up. Not 50 percent, not the middle…
Cosine Annealing Learning Rate with Warm Restarts SGDR Introduction & Motivation Cosine Annealing Learning Rate with Warm Restarts SGDR addresses a central problem in optimization…
Learning Rate Range Test Introduction & Motivation Learning Rate Range Test addresses a central problem in optimization algorithm tuning and improvement: how to Optimize {target}…
model training
Learning rate schedules adjust learning rate during training to improve convergence and final performance. Why schedule: High LR early for fast progress, lower LR later…
cosine annealing, warmup, learning rate decay
The learning rate is the single most consequential number in a training run: it sets how far each optimizer step moves the weights. Set it too high and the loss diverges; set it…
cosine annealing schedule, step decay learning rate, one cycle learning rate policy, learning rate finder
The learning rate is the single most consequential number in a training run: it sets how far each optimizer step moves the weights. Set it too high and the loss diverges; set it…
learning rate, schedules warmup cosine, bert lr nlp passed, learning rate schedules warmup cosine decay & step decay, learning rate schedules, rate schedules warmup, cosine decay step
Learning Rate Schedules: Warmup, Cosine Decay & Step Decay Introduction & Motivation Learning rate schedule: dynamic adjustment during training. Warmup: ramp from low to target…
warmup strategies, cosine annealing, cyclical learning rates, adaptive optimization
The learning rate is the single most consequential number in a training run: it sets how far each optimizer step moves the weights. Set it too high and the loss diverges; set it…
learning rate scheduling annealing and adaptive learning decay, learning rate scheduling, rate scheduling annealing, scheduling annealing adaptive, annealing adaptive learning
Learning Rate Scheduling Annealing and Adaptive Learning Decay Introduction & Motivation Learning Rate Scheduling Annealing and Adaptive Learning Decay addresses a central problem…
learning rate scheduling strategies, learning rate scheduling, rate scheduling strategies, learning rate, rate scheduling, scheduling strategies
Learning Rate Scheduling Strategies Introduction & Motivation Learning Rate Scheduling Strategies addresses a central problem in ml-training process control…
learning rate scheduling, learning rate, rate scheduling
Learning Rate Scheduling Introduction & Motivation Learning Rate Scheduling addresses a central problem in systems process control and schedule-strategy-decay-warmup prediction…
Learning Rate Schedule Optimization Introduction & Motivation Learning Rate Schedule Optimization addresses a central problem in optimization algorithm tuning and improvement: how…
learning rate, rate scheduling, cifar lr nlp, learning rate scheduling, rate scheduling strategies, scheduling strategies
Learning Rate Scheduling Strategies Introduction & Motivation Learning rate scheduling: vary learning rate during training. Improve convergence and final accuracy. Applications…
cosine annealing schedule, training schedule, optimization convergence, temperature scheduling
The learning rate is the single most consequential number in a training run: it sets how far each optimizer step moves the weights. Set it too high and the loss diverges; set it…
Learning Rate Warmup Strategies Introduction & Motivation Learning Rate Warmup Strategies addresses a central problem in optimization algorithm tuning and improvement: how…
Learning to Learn by Gradient Descent Introduction & Motivation Learning to Learn by Gradient Descent addresses a central problem in metalearning learning and rapid task…
Learning to Learn by Gradient Descent (Extended Study) Introduction & Motivation Learning to Learn by Gradient Descent (Extended Study) addresses a central problem in metalearning…
Learning to Learn by Gradient Descent (Extended Study) Introduction & Motivation Learning to Learn by Gradient Descent (Extended Study) addresses a central problem in metalearning…
machine learning
Learning to rank (LTR) uses machine learning to optimize ranking — training models to order items by relevance, popularity, or other objectives, fundamental to search engines…