Self-Instruct
data generation
Self-Instruct is a data-generation pipeline where a model creates synthetic instructions and responses for further tuning - Bootstrapped generation expands instruction coverage…
2,942 technical terms and definitions
data generation
Self-Instruct is a data-generation pipeline where a model creates synthetic instructions and responses for further tuning - Bootstrapped generation expands instruction coverage…
training techniques
Self-Instruct is a data-generation method where models synthesize instruction-output examples to bootstrap instruction tuning - It is a core method in modern LLM training…
ai agents
Self-Monitoring is continuous tracking of internal agent state to detect loop, drift, or instability conditions - It is a core method in modern semiconductor AI-agent coordination…
Self-Paced Active Learning SPAL with Hardness Regularizer Introduction & Motivation Self-Paced Active Learning SPAL with Hardness Regularizer addresses a central problem…
machine learning
Self-Paced Learning is a curriculum learning variant where the model itself decides which training examples to include — the model's own loss on each example determines…
advanced training
Self-paced learning is a learning approach where models select training samples based on current confidence and difficulty - The model starts with high-confidence examples…
self-paced learning sample weighting and adaptive sampling, self-paced learning sample, learning sample weighting, sample weighting adaptive, weighting adaptive sampling
Self-Paced Learning Sample Weighting and Adaptive Sampling Introduction & Motivation Self-Paced Learning Sample Weighting and Adaptive Sampling addresses a central problem…
Self-Play and Competitive Learning Introduction & Motivation Self-Play and Competitive Learning addresses a central problem in reinforcement policy learning…
alphago, alphazero, self play training, game play ai
Self-Play Reinforcement Learning is the training paradigm where an AI agent improves by playing against copies of itself — generating its own training data through…
rag
Self-RAG enables models to decide when retrieval is needed versus generating from internal knowledge. Motivation: Not every query needs retrieval - simple questions answered…
rag
Self-RAG is the retrieval-augmented generation approach where the model learns to reflect on answer quality and decide when to retrieve additional evidence - it integrates…
rag
Self-RAG is a reflective RAG approach where the model decides when to retrieve, evaluate context quality, and revise outputs - It is a core method in modern RAG and retrieval…
prompting
Self-refine is the iterative prompting method where a model repeatedly generates output, evaluates it, and refines it toward better quality - it formalizes draft-to-revision…
prompting techniques
Self-Refine is an iterative generation loop that alternates draft creation, critique, and revision to improve output quality - It is a core method in modern LLM workflow…
Mixup-Induced Consistency Regularization for SSL Introduction & Motivation Mixup-Induced Consistency Regularization for SSL addresses a central problem in semisupervised…
3d vision
Self-supervised depth and ego-motion learning is the joint training paradigm where depth and camera pose networks are optimized using view synthesis consistency instead…
representation learning
Self-Supervised Disentanglement is the representation learning paradigm that learns factorized latent representations without labels, where each latent dimension corresponds to…
Contrastive Learning for 12-Lead Electrocardiograms Introduction & Motivation Contrastive Learning for 12-Lead Electrocardiograms addresses a central problem in selfsupervised…
Self-Supervised Pretraining with Meta-Metric Fine-Tuning Introduction & Motivation Self-Supervised Pretraining with Meta-Metric Fine-Tuning addresses a central problem in fewshot…
Self-Supervised Few-Shot Introduction & Motivation Self-Supervised Few-Shot addresses a central problem in fewshot and pretraining-via-self-supervised architecture: how…
Self-Supervised Transfer Effectiveness Introduction & Motivation Self-Supervised Transfer Effectiveness addresses a central problem in selfsupervised…
SatMAE Masked Autoencoders for Earth Observation Introduction & Motivation SatMAE Masked Autoencoders for Earth Observation addresses a central problem in selfsupervised…
graph neural networks
Self-Supervised GNN is graph representation learning without manual labels using pretext or contrastive objectives - It enables scalable pretraining from structure and feature…
Contrastive Deep Graph Infomax for Community Mining Introduction & Motivation Contrastive Deep Graph Infomax for Community Mining addresses a central problem in selfsupervised…
Self-Supervised Graph Learning SGL for RecSys Introduction & Motivation Self-Supervised Graph Learning SGL for RecSys addresses a central problem in recsys systems and {target}…
self-supervised learning, contrastive learning, masked prediction, foundation pretraining
Self-supervised learning learns representations from supervision constructed from the data itself rather than manually assigned task labels. It unlocks web-scale text, images…
101248 self supervised learning, 101248 self, self supervised, byol cifar, embedding layers & word representations, embedding layers word, layers word representations, embedding layers, layers word
Embedding Layers & Word Representations Introduction & Motivation Embeddings: map discrete to continuous. Word2Vec, GloVe, FastText. Applications: NLP, language understanding.…
pretext tasks, contrastive learning, representation learning, unsupervised pretraining
Self-Supervised Learning and Pretext Tasks — Learning Representations Without Labels Self-supervised learning (SSL) has revolutionized deep learning by enabling models to learn…
self supervised learning contrastive methods learning from unlabeled data, self supervised learning contrastive methods learning unlabeled data, self supervised
Self-Supervised Learning & Contrastive Methods: Learning from Unlabeled Data 1. Introduction & Motivation Self-supervised learning (SSL) represents a paradigm shift: learning…
self-supervised learning contrastive prediction, self-supervised learning contrastive, learning contrastive prediction, self-supervised learning, learning contrastive
Self-Supervised Learning Contrastive Prediction with Machine Learning Introduction & Motivation Self-Supervised Learning Contrastive Prediction with Machine Learning addresses…
self supervised learning contrastive representation learning, self supervised, learning contrastive representation, 2n byol gpu nt passed, self-supervised learning contrastive
Self-Supervised Learning: Contrastive & Representation Learning Introduction & Motivation Self-Supervised Learning: learn from unlabeled data. Contrastive Learning: maximize…
data analysis
Self-Supervised Learning (SSL) for Anomaly Detection is the training of models on only normal (defect-free) data using self-supervised tasks — the model learns the distribution…
self supervised learning methods, self supervised, supervised learning, self-supervised learning, learning methods
Self-Supervised Learning Methods Introduction & Motivation Self-Supervised Learning Methods addresses a central problem in representation learning from unlabeled data: how…
self supervised learning pretext tasks representation learning, self supervised, learning pretext tasks, 1m bert byol cifar gpt nlp, self-supervised learning pretext
Self-Supervised Learning: Pretext Tasks & Representation Learning Introduction & Motivation Self-supervised learning: learn representations from unlabeled data via pretext tasks.…
self supervised learning vision, self supervised learning, supervised learning vision, self supervised, supervised learning, learning vision
Self Supervised Learning Vision Introduction & Motivation Self Supervised Learning Vision addresses a central problem in vision process control…
contrastive pretraining image, dino self supervised, mae masked autoencoder, pretext task representation
Self-Supervised Visual Learning is the training paradigm that learns powerful visual representations from unlabeled images by solving pretext tasks (predicting masked patches…
Masked Autoencoding with Positional Perturbation Anomaly Introduction & Motivation Masked Autoencoding with Positional Perturbation Anomaly addresses a central problem in anomaly…
3d vision
Self-supervised monocular depth estimation is the training approach that learns single-image depth prediction from unlabeled stereo pairs or monocular video using photometric…
Point-MAE Masked Autoencoders for 3D Point Clouds Introduction & Motivation Point-MAE Masked Autoencoders for 3D Point Clouds addresses a central problem in selfsupervised…
computer vision
Self-supervised pre-training for ViT is the approach of learning strong visual representations from unlabeled images through reconstruction, contrastive, or distillation…
self-supervised pretraining
Self-Supervised Pretraining Introduction & Motivation Self-Supervised Pretraining addresses a central problem in ml-training process control and downstream-accuracy-improvement…
self supervised pretraining, self supervised, supervised pretraining
Self Supervised Pretraining Introduction & Motivation Self Supervised Pretraining addresses a central problem in timeseries process control and self-supervised-learning-unlabeled…
Self-Supervised Vision Pretraining Introduction & Motivation Self-Supervised Vision Pretraining addresses a central problem in vision processing and pretraining-effectiveness…
CURL Contrastive Unsupervised Representations for RL Introduction & Motivation CURL Contrastive Unsupervised Representations for RL addresses a central problem in selfsupervised…
Self-Predictive Representations SPR for Deep RL Introduction & Motivation Self-Predictive Representations SPR for Deep RL addresses a central problem in selfsupervised…
HuBERT Hidden-Unit BERT for Self-Supervised Speech Introduction & Motivation HuBERT Hidden-Unit BERT for Self-Supervised Speech addresses a central problem in selfsupervised…
wav2vec hubert whisper, speech representation learning, audio foundation models, speech pretraining
Self-Supervised Speech Models are foundation models pretrained on large corpora of unlabeled audio that learn general-purpose speech representations through contrastive…
SAINT Self-Attention and Intersample Contrastive for Tabular Introduction & Motivation SAINT Self-Attention and Intersample Contrastive for Tabular addresses a central problem…
Trajectory Contrastive Learning for Autonomous Driving Introduction & Motivation Trajectory Contrastive Learning for Autonomous Driving addresses a central problem…
Contrastive Video Predictive Coding for Unsupervised Actions Introduction & Motivation Contrastive Video Predictive Coding for Unsupervised Actions addresses a central problem…