1,016 technical terms and definitions
gowning procedure compliance drift prediction machine learning, gowning procedure, compliance drift prediction, gowning procedure compliance drift prediction
Gowning Procedure Compliance Drift Prediction with Machine Learning Introduction & Motivation Gowning Procedure Compliance Drift Prediction with Machine Learning addresses…
facility
Gowning procedures are the standardized protocols for donning cleanroom garments in the correct sequence to contain human-generated contamination — transforming…
gowning protocol contamination risk prediction, gowning protocol contamination, protocol contamination risk, contamination risk prediction, gowning protocol
Gowning Protocol Contamination Risk Prediction with Machine Learning Introduction & Motivation Gowning Protocol Contamination Risk Prediction with Machine Learning addresses…
facility
Semiconductor cleanroom engineering, ultra-pure water synthesis, and advanced facility distribution networks constitute the critical physical infrastructure required to sustain…
foundation model
GPT-4 is OpenAI's multimodal large language model released in March 2023, representing a significant advancement in AI capability across reasoning, knowledge, coding, creativity…
gpt-4v, gpt-4 vision, foundation model
GPT-4V (GPT-4 with Vision) is OpenAI's state-of-the-art multimodal model — capable of analyzing image inputs alongside text with human-level performance on benchmarks, powering…
gpt architecture decoder, causal language modeling, in-context learning gpt, scaling gpt model
GPT Architecture and Autoregressive Language Models is the decoder-only transformer design for next-token prediction that scales to massive parameters — enabling in-context…
code, generate
GPT Engineer is an open-source AI coding agent that attempts to generate entire codebases from a single natural language prompt, pioneering the concept of "agentic software…
gpt, generative pre-trained transformer, foundation model
GPT (Generative Pre-trained Transformer) is OpenAI's family of autoregressive language models that generate text by predicting the next token given all preceding tokens…
gpt generative pre training, gpt generative, generative pre, ai gpt mmlu ppl rag rlhf, gpt generative pre-training, generative pre-training
GPT - Generative Pre-Training Introduction & Motivation GPT: autoregressive language modeling. Left-to-right generation, decoder-only architecture. Applications: text generation…
gpt generative pre-trained transformer and sequential prediction, gpt generative pre-trained, generative pre-trained transformer, pre-trained transformer sequential
GPT Generative Pre-Trained Transformer and Sequential Prediction Introduction & Motivation GPT Generative Pre-Trained Transformer and Sequential Prediction addresses a central…
eleuther, 6b
GPT-J-6B is a six billion parameter open-source language model developed by EleutherAI trained on 400B tokens, achieving strong performance compared to similar-sized proprietary…
eleuther, 20b
GPT-NeoX-20B is a 20 billion parameter open-source causal language model developed by EleutherAI, reaching frontier performance in 2022 — demonstrating that community-driven…
local, desktop
GPT4All is an open-source ecosystem by Nomic AI for running large language models locally on consumer hardware, emphasizing CPU-based inference and complete data privacy…
quantization, method
GPTQ (Generative Pre-trained Transformer Quantization) is a post-training quantization method that achieves 3-4 bit weight quantization for large language models with minimal…
graphics processing unit, ai accelerator, cuda, tensor core, hbm
GPU computing uses graphics processors for general-purpose parallel work beyond raster graphics. GPUs devote large area to throughput-oriented arithmetic and supply high memory…
cluster, deep, learning, training, scale
GPU Cluster Deep Learning Training is a distributed training infrastructure leveraging GPU-accelerated clusters to train massive neural networks across thousands of GPUs — GPU…
cuda atomic, atomic add, atomic cas gpu, atomic contention
GPU Atomic Operations are the hardware-supported read-modify-write operations that enable thread-safe updates to shared memory locations without explicit locking — including…
cuda atomics performance, atomic memory operations, gpu synchronization primitives, cuda atomic optimization
GPU Atomic Operations are the hardware-supported read-modify-write operations that enable thread-safe updates to shared memory locations without explicit locking — including…
high performance networking, roce, adaptive routing, fabric topology, hpc networking
GPU Cluster Networking and HPC Fabric is the high-speed interconnect infrastructure that connects hundreds to tens of thousands of GPU nodes in AI training clusters and HPC…
gpu clusters, dgx cluster, hgx cluster, ai training cluster, accelerator cluster, nvlink, infiniband, roce
GPU cluster is a coordinated fleet of accelerator servers connected by high-bandwidth fabrics and shared data services for distributed training and inference. Frontier-scale AI…
infrastructure
A GPU (graphics processing unit) is the workhorse of modern AI: a massively parallel processor that turns deep learning's core operation — multiplying huge matrices — into tens…
ptx compiler, nvcc optimization, gpu instruction selection, ptx intermediate, gpu code generation
GPU Compiler Pipeline and PTX is the compilation infrastructure that transforms CUDA C++ source code through multiple intermediate representations into machine code optimized…
compute pipeline gpu, general purpose gpu, gpgpu programming, dispatch compute workgroup
GPU Compute Shaders are the programmable pipeline stages that execute general-purpose parallel computations on GPU hardware outside the traditional graphics rendering pipeline…
compute pipeline vulkan, spirv shader, workgroup invocation, vulkan synchronization barrier
Vulkan Compute Shaders enable portable, hardware-agnostic GPU computing across diverse platforms (NVIDIA, AMD, Intel, mobile GPUs), leveraging SPIR-V intermediate representation…
gpgpu, general purpose gpu computing, gpu acceleration
GPU computing definition and practical boundary. uses graphics processors for general-purpose parallel work beyond raster graphics. GPUs devote large area to throughput-oriented…
cooperative kernel launch, thread block cluster, grid level synchronization, cooperative groups cuda
GPU Cooperative Groups is the CUDA programming model extension that provides flexible, hierarchical thread grouping and synchronization primitives beyond the fixed thread-block…
infrastructure
GPUDirect is the set of technologies that enable direct data paths between GPUs and external devices with minimal CPU mediation - it reduces copy hops and latency across GPU…
infrastructure
GPUDirect RDMA is the remote direct memory access capability that lets network adapters move data directly between remote and local GPU memory - it enables low-latency, zero-copy…
gpudirect networking, rdma gpu memory, zero copy gpu transfer, ib verbs gpu
GPU Direct RDMA is the data path that allows network adapters to read and write GPU memory directly without host staging. What It Covers Core concept: cuts copy overhead and host…
cuda fft optimization, cufft performance tuning, fast fourier transform gpu, frequency domain gpu
GPU FFT and Signal Processing is the parallel implementation of Fast Fourier Transform and related signal processing operations on GPUs — where cuFFT library delivers 500-2000…
graphics processing unit, hardware
GPU (Graphics Processing Unit) is the massively parallel processor that has become the primary hardware accelerator for deep learning — containing thousands of cores optimized…
instruction level parallelism gpu, gpu pipeline, gpu instruction scheduling, gpu throughput
GPU Instruction-Level Parallelism (ILP) is the compiler and hardware technique of executing multiple independent instructions from the same thread simultaneously within a GPU…
operator fusion, kernel launch overhead, fused kernel, xla fusion
Kernel fusion (also called operator fusion) is the optimization of combining several separate GPU operations into a single kernel, so that intermediate results stay in fast…
operator fusion optimization, kernel launch overhead, fused kernel computation, memory traffic reduction
GPU Kernel Fusion is the performance optimization technique that combines multiple separate GPU kernels into a single fused kernel — eliminating the overhead of multiple kernel…
cuda kernel launch, kernel fusion motivation, launch latency, gpu dispatch
GPU Kernel Launch Overhead is the fixed latency cost (typically 3-10 microseconds) incurred each time the CPU dispatches a computation kernel to the GPU — which becomes…
gpu kernel launch overhead and host-device synchronization, gpu kernel launch, kernel launch overhead, launch overhead host-device, overhead host-device synchronization, gpu kernel
GPU Kernel Launch Overhead and Host-Device Synchronization Introduction & Motivation GPU Kernel Launch Overhead and Host-Device Synchronization addresses a central problem…
kernel tuning, occupancy optimization, instruction throughput gpu
GPU Kernel Optimization is the systematic process of tuning GPU compute kernels to maximize hardware utilization and minimize execution time, addressing memory access patterns…
gpu kernel optimization techniques, gpu kernel optimization, kernel optimization techniques, gpu kernel, kernel optimization, optimization techniques
GPU Kernel Optimization Techniques Introduction & Motivation GPU Kernel Optimization Techniques addresses a central problem in ml-hardware process control and warp-utilization…
cuda kernel tuning, warp occupancy maximization, shared memory tiling, gpu memory coalescing
GPU Kernel Optimization Techniques — Systematic methods for maximizing throughput and minimizing latency of computational kernels executing on massively parallel GPU…
gpu performance analysis, occupancy analysis, nsight profiling
GPU Kernel Profiling is the systematic measurement and analysis of GPU kernel execution characteristics — occupancy, memory throughput, compute utilization, stall reasons…
gpu memory hierarchy, hbm, gddr, shared memory, gpu registers, l1 l2 cache, unified memory
GPU memory is the hierarchy that stores and moves instructions, model parameters, activations, caches, and intermediate tensors for graphics and accelerator execution. For modern…
coalesced memory access, global memory coalescing, warp memory access pattern, memory transaction efficiency
GPU Memory Coalescing is the hardware mechanism that combines multiple individual memory requests from threads within a warp (32 threads) into a single wide memory transaction…
memory access pattern gpu, global memory transaction, aligned memory access, strided access gpu
GPU Memory Coalescing is the hardware optimization where adjacent threads in a warp (32 threads) that access adjacent memory addresses have their individual memory requests…
coalesced memory access cuda, memory transaction efficiency, global memory access pattern, memory coalescing warp
GPU Memory Coalescing is the hardware mechanism that combines multiple per-thread memory accesses within a warp into fewer, wider memory transactions — achieving maximum global…
hardware
GPU memory hierarchy is the layered organization of storage levels with different capacities and latency-bandwidth characteristics - effective kernel design depends on maximizing…
gpu cache, l1 l2 cache gpu, gpu memory architecture, gpu hbm bandwidth
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
shared memory registers, gpu cache, memory coalescing
GPU Memory Hierarchy is the multi-level storage system in GPU architectures that provides different capacity-bandwidth-latency trade-offs, from per-thread registers (fastest…
shared memory gpu tiling, global memory coalescing, texture cache gpu, register spilling gpu performance
GPU Memory Hierarchy Optimization — GPU performance is fundamentally constrained by memory bandwidth and latency, making effective utilization of the multi-level memory hierarchy…
shared memory cuda, l1 l2 cache gpu, memory bandwidth optimization, global memory access patterns
GPU Memory Hierarchy Optimization is the practice of strategically utilizing the multi-level memory system of modern GPUs — from fast but small shared memory and L1 cache (20…