Video Generation
generative models
Video generation creates video sequences from various input modalities — text descriptions, single images, sketches, or other videos — representing one of the most challenging…
520 technical terms and definitions
generative models
Video generation creates video sequences from various input modalities — text descriptions, single images, sketches, or other videos — representing one of the most challenging…
multimodal ai
Video Generation is synthesizing coherent video sequences from learned generative models conditioned on prompts or context - It extends image generation to temporal content…
video understanding
Video grounding is the problem of locating the exact temporal region in a video that corresponds to a text query - given natural language such as an action phrase, the model…
video highlight detection, video highlight, highlight detection
Video Highlight Detection Introduction & Motivation Video Highlight Detection addresses a central problem in vision process control and highlight-detection-interesting-moment…
video generation
Video inpainting is the task of filling missing or masked regions in video frames while preserving spatial realism and temporal continuity - it combines reconstruction, motion…
multimodal ai
Video Inpainting is filling missing or corrupted regions in videos while preserving temporal and semantic consistency - It restores damaged footage and enables object removal…
Video Inpainting and Completion Introduction & Motivation Video Inpainting and Completion addresses a central problem in vision processing and inpainting-temporal-consistency…
video understanding
Video instance segmentation (VIS) is the task of segmenting each object instance in every frame while maintaining consistent identity across time - it unifies detection…
multimodal ai
Video-language pre-training is the multimodal learning paradigm that aligns video representations with textual descriptions such as narration, captions, or transcripts - it…
Video-Language Understanding Introduction & Motivation Video-Language Understanding addresses a central problem in multimodal learning and video-text-alignment-quality alignment…
video generation
Video Matting is a highly advanced, pixel-precise computer vision task that extracts a continuous alpha matte (transparency map with values ranging from to ) for foreground…
video generation
Video object removal is the editing task that removes selected objects from a video and reconstructs believable background content across all affected frames - it combines…
computer vision
Video Object Segmentation (VOS) is a dense prediction task that assigns a pixel-level mask to specific objects in every frame of a video — requiring the model to propagate…
video object segmentation vos, video object segmentation, object segmentation vos, video object, object segmentation, segmentation vos
Video Object Segmentation VOS Introduction & Motivation Video Object Segmentation VOS addresses a central problem in vision process control and object-segmentation-video-temporal…
video object tracking detection, video object tracking, object tracking detection, video object, object tracking, tracking detection
Video Object Tracking Detection Introduction & Motivation Video Object Tracking Detection addresses a central problem in vision process control and tracking-temporal-consistency…
Video Object Tracking Methods Introduction & Motivation Video Object Tracking Methods addresses a central problem in vision processing and tracking-continuity prediction: how…
video understanding
Video panoptic segmentation is the unified dense prediction task that assigns every pixel either a trackable thing instance or a semantic stuff class across time - it extends…
video generation
Video prediction is the sequence modeling task that forecasts future frames from past frames to learn temporal dynamics and scene evolution - this objective can teach motion…
multimodal ai
Video Prediction is forecasting future frames from observed video context using learned dynamics models - It supports planning, simulation, and anticipatory generation tasks. What…
Video Frame Prediction Introduction & Motivation Video Frame Prediction addresses a central problem in generative generation and future-frame-accuracy synthesis: how to Design…
video quality assessment vqa, video quality assessment, quality assessment vqa, video quality, quality assessment, assessment vqa
Video Quality Assessment VQA Introduction & Motivation Video Quality Assessment VQA addresses a central problem in vision process control and video-quality-metric-assessment…
computer vision
Video Question Answering (VideoQA) is a multimodal task where a model answers natural language questions about a video clip — requiring the integration of visual features…
video understanding
Advanced video question answering is the task of answering natural language questions about events, objects, and causal relationships in a video stream - unlike simple…
Video Question Answering Introduction & Motivation Video Question Answering addresses a central problem in multimodal learning and qa-accuracy-comprehension alignment: how…
rag
Video retrieval is the retrieval method that locates relevant videos or time segments using transcript, frame, and metadata signals - segment-level retrieval is key for long…
Video Retrieval by Text Description Introduction & Motivation Video Retrieval by Text Description addresses a central problem in multimodal learning and retrieval-ranking-accuracy…
video generation
Video stabilization is the process of removing unwanted camera shake by estimating motion trajectory and warping frames to a smoothed path - it improves visual comfort…
computer vision
Video style transfer is the technique of applying artistic or photographic styles consistently across video frames — extending image style transfer to temporal sequences while…
video generation
Video stylization is the process of transforming video appearance to a target artistic or visual style while maintaining temporal coherence - it extends image style transfer…
video summarization key frame, video summarization key, summarization key frame, video summarization, summarization key, key frame
Video Summarization Key Frame Introduction & Motivation Video Summarization Key Frame addresses a central problem in vision process control and video-summarization-key-selection…
Text-Guided Video Summarization Introduction & Motivation Text-Guided Video Summarization addresses a central problem in multimodal learning and summary-relevance-quality…
video generation
Video super-resolution (VSR) is the process of reconstructing high-resolution frames from low-resolution video by exploiting temporal redundancy across neighboring frames - unlike…
multimodal ai
Video Super-Resolution is increasing video resolution while preserving temporal coherence across frames - It enhances detail without introducing frame-to-frame instability. What…
Video Super-Resolution Methods Introduction & Motivation Video Super-Resolution Methods addresses a central problem in vision processing and resolution-enhancement-quality…
video understanding
Video Swin Transformer is the 3D extension of shifted-window transformers that performs local attention within spatiotemporal windows and shifts window partitions across layers…
Video Synthesis and Generation Introduction & Motivation Video Synthesis and Generation addresses a central problem in generative generation and temporal-coherence-quality…
Video Temporal Grounding Introduction & Motivation Video Temporal Grounding addresses a central problem in multimodal learning and grounding-accuracy-recall alignment: how…
video understanding
Video transformer architectures are the family of models that apply self-attention to spatiotemporal tokens to capture long-range motion and scene dependencies - they include…
video transformer, action recognition, temporal detection, videomae, slowfast, timesformer
Video understanding models visual events across time for recognition, localization, tracking, retrieval, summarization, and reasoning. It supports sports analysis, content…
video understanding classification, video understanding, understanding classification
Video Understanding Classification Introduction & Motivation Video Understanding Classification addresses a central problem in vision process control…
Video Understanding and Classification Introduction & Motivation Video Understanding and Classification addresses a central problem in vision processing…
video transformer, temporal modeling, video foundation model
Video Understanding Models are deep learning architectures designed to process and comprehend video data — modeling both spatial (per-frame visual content) and temporal (motion…
Video Understanding with Multimodal Input Introduction & Motivation Video Understanding with Multimodal Input addresses a central problem in multimodal learning…
video transformer model, temporal modeling video, action recognition deep learning, video foundation model
Video Understanding and Temporal Modeling is the deep learning discipline that extends image understanding to the temporal dimension — processing sequences of frames to recognize…
video understanding, understanding temporal, 2d 306k 3d cnn hmdb51 i3d, video understanding & temporal modeling, video understanding temporal, understanding temporal modeling, temporal modeling
Video Understanding & Temporal Modeling Introduction & Motivation Video Understanding: recognize actions and events in video sequences. Temporal modeling; motion patterns.…
video understanding temporal modeling and action recognition, video understanding temporal, understanding temporal modeling, temporal modeling action, video understanding
Video Understanding Temporal Modeling and Action Recognition Introduction & Motivation Video Understanding Temporal Modeling and Action Recognition addresses a central problem…
VideoMAE Masked Autoencoders for Self-Supervised Video Introduction & Motivation VideoMAE Masked Autoencoders for Self-Supervised Video addresses a central problem…
3d vision
View direction encoding is the conditioning method that encodes camera ray direction so models can represent view-dependent appearance effects - it enables neural renderers…
thermal management
View Factor is the geometric fraction of radiation leaving one surface that reaches another surface - It determines radiative coupling strength between components in enclosure…
multi-view learning
View Generation in multi-view learning refers to techniques for creating additional views of data when natural multiple views are unavailable, artificially constructing diverse…