Selective Knowledge Distillation
model compression
Selective Knowledge Distillation is a distillation approach that carefully chooses which knowledge to transfer from teacher to student — rather than blindly mimicking all teacher…
1,600 technical terms and definitions
model compression
Selective Knowledge Distillation is a distillation approach that carefully chooses which knowledge to transfer from teacher to student — rather than blindly mimicking all teacher…
selective laser sintering porosity prediction, selective laser sintering, laser sintering porosity, sintering porosity prediction, selective laser, laser sintering
Selective Laser Sintering Porosity Prediction with Machine Learning Introduction & Motivation Selective Laser Sintering Porosity Prediction with Machine Learning addresses…
ai safety
Selective Prediction is a machine learning framework where the model has the option to abstain from making predictions on inputs where it is insufficiently confident, trading…
ai safety
Selective Prediction is a strategy where models abstain on uncertain cases and answer only when confidence exceeds a threshold - It is a core method in modern AI evaluation…
memory efficient, transformer training
Selective Activation Recomputation is an intelligent checkpointing strategy that analyzes the compute cost and memory footprint of each operation to decide which activations…
selective solder defect rate prediction, selective solder defect, solder defect rate, defect rate prediction, selective solder, solder defect, defect rate, rate prediction
Selective Solder Defect Rate Prediction with Machine Learning Introduction & Motivation Selective Solder Defect Rate Prediction with Machine Learning addresses a central problem…
selective solder flux application drift prediction machine learning, selective solder, flux application drift, selective solder flux application drift prediction
Selective Solder Flux Application Drift Prediction with Machine Learning Introduction & Motivation Selective Solder Flux Application Drift Prediction with Machine Learning…
selective solder nozzle wear prediction machine learning, selective solder, nozzle wear prediction, selective solder nozzle wear prediction, selective solder nozzle, nozzle wear
Selective Solder Nozzle Wear Prediction with Machine Learning Introduction & Motivation Selective Solder Nozzle Wear Prediction with Machine Learning addresses a central problem…
L2-SP Selective Weight Regularization to Pretrained Anchors Introduction & Motivation L2-SP Selective Weight Regularization to Pretrained Anchors addresses a central problem…
self-aligned contact etch prediction, self-aligned contact etch, contact etch prediction, self-aligned contact, contact etch, etch prediction
Self-Aligned Contact Etch Prediction with Machine Learning Introduction & Motivation Self-Aligned Contact Etch Prediction with Machine Learning addresses a central problem…
self-aligned double patterning defect prediction, self-aligned double patterning, double patterning defect, patterning defect prediction, self-aligned double
Self-Aligned Double Patterning Defect Prediction with Machine Learning Introduction & Motivation Self-Aligned Double Patterning Defect Prediction with Machine Learning addresses…
self aligned contact process, sagc metallization, contact over active gate coag, buried power rail contact
Self-Aligned Gate Contact (SAGC) is the advanced patterning and etch technique that forms the metal contact directly on top of the gate electrode without requiring a separate…
self-aligned multi-patterning overlay error prediction, self-aligned multi-patterning overlay, multi-patterning overlay error, overlay error prediction
Self-Aligned Multi-Patterning Overlay Error Prediction with Machine Learning Introduction & Motivation Self-Aligned Multi-Patterning Overlay Error Prediction with Machine Learning…
self aligned multiple patterning cd prediction with machine learning, self aligned multiple patterning cd prediction machine learning, self aligned, cd samp
Self-Aligned Multiple Patterning CD Prediction with Machine Learning Introduction & Motivation Self-Aligned Multiple Patterning CD Prediction with Machine Learning addresses…
predicting defects in self-aligned quadruple patterning, predicting defects self-aligned, defects self-aligned quadruple, self-aligned quadruple patterning, predicting defects
Predicting defects in self-aligned quadruple patterning Introduction & Motivation Predicting defects in self-aligned quadruple patterning addresses a central problem…
training techniques
Self-Alignment is alignment methods where models improve behavior through self-generated critiques, preferences, or iterative refinement - It is a core method in modern LLM…
self-assembly in nanostructures, self-assembly nanostructures
Self-Assembly in Nanostructures Introduction & Motivation Self-Assembly in Nanostructures addresses a central problem in self-assembly process control and assembly-error-rate…
Self-Attention GAN Introduction & Motivation Self-Attention GAN addresses a central problem in generative generation and long-range-consistency synthesis: how to Design generative…
neural architecture
Self-Attention in Capsules is the architectural innovation that replaces the original slow iterative routing algorithm in Capsule Networks with the parallelizable self-attention…
self-attention query-key-value projection and similarity prediction, self-attention query-key-value projection, query-key-value projection similarity, query-key-value projection
Self-Attention Query-Key-Value Projection and Similarity Prediction Introduction & Motivation Self-Attention Query-Key-Value Projection and Similarity Prediction addresses…
time series models
Self-attentive Hawkes is a Hawkes-style event model augmented with self-attention to represent nonlocal event influence - Self-attention weights identify which historical events…
self-checking testbench
Self-Checking Testbench Introduction & Motivation Self-Checking Testbench addresses a central problem in verification process control and assertion-density-per-cycle prediction…
ai safety
Self-Critiquing is an AI safety technique where the model evaluates and critiques its own outputs — generating initial responses, then assessing them for errors, harmfulness…
consistency, regularize, augmentation, born-again
Self-distillation trains a model to match its own predictions on augmented or different views of data — using the model itself as both teacher and student to improve consistency…
Self-Distillation Introduction & Motivation Self-Distillation addresses a central problem in reducing the size and cost of compression models: how to Reduce the size and inference…
model compression
Self-Distillation is a knowledge distillation technique where the teacher and student share the same architecture — the model distills knowledge into itself, either by using…
model optimization
Self-Distillation is a method where a model learns from its own earlier states or auxiliary heads - It improves performance without requiring a separate external teacher model.…
Self-Distillation (Extended Study) Introduction & Motivation Self-Distillation (Extended Study) addresses a central problem in reducing the size and cost of compression models…
Self-Distillation (Extended Study) Introduction & Motivation Self-Distillation (Extended Study) addresses a central problem in reducing the size and cost of compression models…
Self-Distillation (Extended Study) Introduction & Motivation Self-Distillation (Extended Study) addresses a central problem in reducing the size and cost of compression models…
domain adaptation
Self-Ensembling for Domain Adaptation refers to domain adaptation methods that use temporal ensembling or mean teacher techniques—where a slowly-updated copy of the model…
senn, explainable ai
SENN (Self-Explaining Neural Networks) are neural networks architecturally designed to produce their own explanations alongside predictions — generating interpretable concept…
Self-Explaining Neural Networks SENN with Concepts Introduction & Motivation Self-Explaining Neural Networks SENN with Concepts addresses a central problem in explainability…
neural architecture
Self-Gating is a mechanism where a neural network layer gates its own activations using a function of the same input — the input multiplied by a sigmoid (or similar gate)…
simulation
Self-heating modeling is the electrothermal modeling of temperature rise generated internally by device operation and limited heat extraction - it predicts local channel…
training techniques
Self-Instruct is a data-generation method where models synthesize instruction-output examples to bootstrap instruction tuning - It is a core method in modern LLM training…
ai agents
Self-Monitoring is continuous tracking of internal agent state to detect loop, drift, or instability conditions - It is a core method in modern semiconductor AI-agent coordination…
Self-Paced Active Learning SPAL with Hardness Regularizer Introduction & Motivation Self-Paced Active Learning SPAL with Hardness Regularizer addresses a central problem…
machine learning
Self-Paced Learning is a curriculum learning variant where the model itself decides which training examples to include — the model's own loss on each example determines…
advanced training
Self-paced learning is a learning approach where models select training samples based on current confidence and difficulty - The model starts with high-confidence examples…
self-paced learning sample weighting and adaptive sampling, self-paced learning sample, learning sample weighting, sample weighting adaptive, weighting adaptive sampling
Self-Paced Learning Sample Weighting and Adaptive Sampling Introduction & Motivation Self-Paced Learning Sample Weighting and Adaptive Sampling addresses a central problem…
Self-Play and Competitive Learning Introduction & Motivation Self-Play and Competitive Learning addresses a central problem in reinforcement policy learning…
alphago, alphazero, self play training, game play ai
Self-Play Reinforcement Learning is the training paradigm where an AI agent improves by playing against copies of itself — generating its own training data through…
Mixup-Induced Consistency Regularization for SSL Introduction & Motivation Mixup-Induced Consistency Regularization for SSL addresses a central problem in semisupervised…
Contrastive Learning for 12-Lead Electrocardiograms Introduction & Motivation Contrastive Learning for 12-Lead Electrocardiograms addresses a central problem in selfsupervised…
Self-Supervised Pretraining with Meta-Metric Fine-Tuning Introduction & Motivation Self-Supervised Pretraining with Meta-Metric Fine-Tuning addresses a central problem in fewshot…
Self-Supervised Few-Shot Introduction & Motivation Self-Supervised Few-Shot addresses a central problem in fewshot and pretraining-via-self-supervised architecture: how…
Self-Supervised Transfer Effectiveness Introduction & Motivation Self-Supervised Transfer Effectiveness addresses a central problem in selfsupervised…
SatMAE Masked Autoencoders for Earth Observation Introduction & Motivation SatMAE Masked Autoencoders for Earth Observation addresses a central problem in selfsupervised…
graph neural networks
Self-Supervised GNN is graph representation learning without manual labels using pretext or contrastive objectives - It enables scalable pretraining from structure and feature…