Self-Distillation-V4 Machine Learning
Self-Distillation (Extended Study) Introduction & Motivation Self-Distillation (Extended Study) addresses a central problem in reducing the size and cost of compression models…
15,418 technical terms and definitions
Self-Distillation (Extended Study) Introduction & Motivation Self-Distillation (Extended Study) addresses a central problem in reducing the size and cost of compression models…
domain adaptation
Self-Ensembling for Domain Adaptation refers to domain adaptation methods that use temporal ensembling or mean teacher techniques—where a slowly-updated copy of the model…
senn, explainable ai
SENN (Self-Explaining Neural Networks) are neural networks architecturally designed to produce their own explanations alongside predictions — generating interpretable concept…
Self-Explaining Neural Networks SENN with Concepts Introduction & Motivation Self-Explaining Neural Networks SENN with Concepts addresses a central problem in explainability…
neural architecture
Self-Gating is a mechanism where a neural network layer gates its own activations using a function of the same input — the input multiplied by a sigmoid (or similar gate)…
simulation
Self-heating modeling is the electrothermal modeling of temperature rise generated internally by device operation and limited heat extraction - it predicts local channel…
training techniques
Self-Instruct is a data-generation method where models synthesize instruction-output examples to bootstrap instruction tuning - It is a core method in modern LLM training…
ai agents
Self-Monitoring is continuous tracking of internal agent state to detect loop, drift, or instability conditions - It is a core method in modern semiconductor AI-agent coordination…
Self-Paced Active Learning SPAL with Hardness Regularizer Introduction & Motivation Self-Paced Active Learning SPAL with Hardness Regularizer addresses a central problem…
machine learning
Self-Paced Learning is a curriculum learning variant where the model itself decides which training examples to include — the model's own loss on each example determines…
advanced training
Self-paced learning is a learning approach where models select training samples based on current confidence and difficulty - The model starts with high-confidence examples…
self-paced learning sample weighting and adaptive sampling, self-paced learning sample, learning sample weighting, sample weighting adaptive, weighting adaptive sampling
Self-Paced Learning Sample Weighting and Adaptive Sampling Introduction & Motivation Self-Paced Learning Sample Weighting and Adaptive Sampling addresses a central problem…
Self-Play and Competitive Learning Introduction & Motivation Self-Play and Competitive Learning addresses a central problem in reinforcement policy learning…
alphago, alphazero, self play training, game play ai
Self-Play Reinforcement Learning is the training paradigm where an AI agent improves by playing against copies of itself — generating its own training data through…
Mixup-Induced Consistency Regularization for SSL Introduction & Motivation Mixup-Induced Consistency Regularization for SSL addresses a central problem in semisupervised…
Contrastive Learning for 12-Lead Electrocardiograms Introduction & Motivation Contrastive Learning for 12-Lead Electrocardiograms addresses a central problem in selfsupervised…
Self-Supervised Pretraining with Meta-Metric Fine-Tuning Introduction & Motivation Self-Supervised Pretraining with Meta-Metric Fine-Tuning addresses a central problem in fewshot…
Self-Supervised Few-Shot Introduction & Motivation Self-Supervised Few-Shot addresses a central problem in fewshot and pretraining-via-self-supervised architecture: how…
Self-Supervised Transfer Effectiveness Introduction & Motivation Self-Supervised Transfer Effectiveness addresses a central problem in selfsupervised…
SatMAE Masked Autoencoders for Earth Observation Introduction & Motivation SatMAE Masked Autoencoders for Earth Observation addresses a central problem in selfsupervised…
graph neural networks
Self-Supervised GNN is graph representation learning without manual labels using pretext or contrastive objectives - It enables scalable pretraining from structure and feature…
Contrastive Deep Graph Infomax for Community Mining Introduction & Motivation Contrastive Deep Graph Infomax for Community Mining addresses a central problem in selfsupervised…
Self-Supervised Graph Learning SGL for RecSys Introduction & Motivation Self-Supervised Graph Learning SGL for RecSys addresses a central problem in recsys systems and {target}…
self-supervised learning, contrastive learning, masked prediction, foundation pretraining
Self-supervised learning learns representations from supervision constructed from the data itself rather than manually assigned task labels. It unlocks web-scale text, images…
pretext tasks, contrastive learning, representation learning, unsupervised pretraining
Self-Supervised Learning and Pretext Tasks — Learning Representations Without Labels Self-supervised learning (SSL) has revolutionized deep learning by enabling models to learn…
self-supervised learning contrastive prediction, self-supervised learning contrastive, learning contrastive prediction, self-supervised learning, learning contrastive
Self-Supervised Learning Contrastive Prediction with Machine Learning Introduction & Motivation Self-Supervised Learning Contrastive Prediction with Machine Learning addresses…
self supervised learning vision, self supervised learning, supervised learning vision, self supervised, supervised learning, learning vision
Self Supervised Learning Vision Introduction & Motivation Self Supervised Learning Vision addresses a central problem in vision process control…
contrastive pretraining image, dino self supervised, mae masked autoencoder, pretext task representation
Self-Supervised Visual Learning is the training paradigm that learns powerful visual representations from unlabeled images by solving pretext tasks (predicting masked patches…
Masked Autoencoding with Positional Perturbation Anomaly Introduction & Motivation Masked Autoencoding with Positional Perturbation Anomaly addresses a central problem in anomaly…
Point-MAE Masked Autoencoders for 3D Point Clouds Introduction & Motivation Point-MAE Masked Autoencoders for 3D Point Clouds addresses a central problem in selfsupervised…
computer vision
Self-supervised pre-training for ViT is the approach of learning strong visual representations from unlabeled images through reconstruction, contrastive, or distillation…
self-supervised pretraining
Self-Supervised Pretraining Introduction & Motivation Self-Supervised Pretraining addresses a central problem in ml-training process control and downstream-accuracy-improvement…
self supervised pretraining, self supervised, supervised pretraining
Self Supervised Pretraining Introduction & Motivation Self Supervised Pretraining addresses a central problem in timeseries process control and self-supervised-learning-unlabeled…
Self-Supervised Vision Pretraining Introduction & Motivation Self-Supervised Vision Pretraining addresses a central problem in vision processing and pretraining-effectiveness…
CURL Contrastive Unsupervised Representations for RL Introduction & Motivation CURL Contrastive Unsupervised Representations for RL addresses a central problem in selfsupervised…
Self-Predictive Representations SPR for Deep RL Introduction & Motivation Self-Predictive Representations SPR for Deep RL addresses a central problem in selfsupervised…
HuBERT Hidden-Unit BERT for Self-Supervised Speech Introduction & Motivation HuBERT Hidden-Unit BERT for Self-Supervised Speech addresses a central problem in selfsupervised…
wav2vec hubert whisper, speech representation learning, audio foundation models, speech pretraining
Self-Supervised Speech Models are foundation models pretrained on large corpora of unlabeled audio that learn general-purpose speech representations through contrastive…
SAINT Self-Attention and Intersample Contrastive for Tabular Introduction & Motivation SAINT Self-Attention and Intersample Contrastive for Tabular addresses a central problem…
Trajectory Contrastive Learning for Autonomous Driving Introduction & Motivation Trajectory Contrastive Learning for Autonomous Driving addresses a central problem…
Contrastive Video Predictive Coding for Unsupervised Actions Introduction & Motivation Contrastive Video Predictive Coding for Unsupervised Actions addresses a central problem…
Contrastive Learning for Photoplethysmography PPG Signals Introduction & Motivation Contrastive Learning for Photoplethysmography PPG Signals addresses a central problem…
Self-Taught Learning via Sparse Dictionary Coding Introduction & Motivation Self-Taught Learning via Sparse Dictionary Coding addresses a central problem in transfer learning…
semi-supervised learning
Self-training uses a model's own predictions on unlabeled data as training labels for semi-supervised learning. Process: Train on labeled data → predict on unlabeled data → select…
advanced training
Self-training is a semi-supervised approach where a model generates labels for unlabeled data and retrains on confident predictions - Pseudo-labeled samples expand training…
pseudo labeling, semi supervised, noisy student, teacher student self training
Self-Training (Pseudo-Labeling) is the semi-supervised learning technique where a model trained on labeled data generates predictions (pseudo-labels) on unlabeled data, then…
Self-Training Domain Adaptation Introduction & Motivation Self-Training Domain Adaptation addresses a central problem in transfer learning and {target} adaptation: how to Apply…
Self-Training Iterative Method Introduction & Motivation Self-Training Iterative Method addresses a central problem in semisupervised and model-improvement-iteration architecture…
Noisy Student Training with Iterative Teacher-Student Loops Introduction & Motivation Noisy Student Training with Iterative Teacher-Student Loops addresses a central problem…
selfies, chemistry ai
SELFIES (Self-Referencing Embedded Strings) is a molecular string representation designed to guarantee that every possible string corresponds to a valid molecular graph…