EXPLORE / 06
Terms index
Specialized AI and software-development terms with concise explanations
Entity records
4517 records · 56/113
- 2201
Regression Testing
Testing method verifying that new code changes do not break existing functionality or performance
Website pending - 2202
Feed-Forward Network (FFN)
Fully connected layer structure in Transformers used for non-linear feature transformation
Website pending - 2203
Parallel Drafting
A strategy generating multiple candidate tokens simultaneously rather than sequentially via autoregression.
Website pending - 2204
SVE256
An implementation of Arm's Scalable Vector Extension instruction set for parallel data processing.
Website pending - 2205
INT8 Quantization
Converting model weights and activations from floating-point to 8-bit integers to accelerate inference.
Website pending - 2206
Day-0 Support
The capability to run a new model seamlessly on specific frameworks or tools on its release day
Website pending - 2207
AllGather
Collective communication primitive gathering data from all nodes and broadcasting to each
Website pending - 2208
mmap
Maps files directly into process virtual address space to avoid redundant copying
Website pending - 2209
Diffusion RL
Technique using reinforcement learning algorithms to optimize diffusion model generation quality
Website pending - 2210
Confidence Head
An additional module in neural networks that outputs reliability scores for predictions.
Website pending - 2211
Non-associativity of Floating Point
The property where changing the order of floating-point additions yields slightly different results due to rounding errors.
Website pending - 2212
Sharded Transfer
Technology that splits large datasets or model weights into smaller chunks for parallel transmission
Website pending - 2213
Online RL
A learning paradigm where agents update policies simultaneously while interacting with the environment
Website pending - 2214
LLM Serving
The technical system for deploying trained large models as online API services.
Website pending - 2215
Prefill/Decode Disaggregation
Separates compute-intensive prefill stages from memory-intensive decode stages.
Website pending - 2216
Preemption
Interrupting current requests to release resources for later reprocessing.
Website pending - 2217
Disaggregated Serving
Architecture separating prefill and decode phases onto different hardware resources to boost throughput
Website pending - 2218
Mixed Precision Quantization
Using different numerical bit-widths across layers or components to balance accuracy and speed.
Website pending - 2219
Bitwise Consistency
Different compute engines producing identical binary outputs for the same inputs.
Website pending - 2220
RL Post-training
The phase of using reinforcement learning to optimize alignment or reasoning after pretraining.
Website pending - 2221
CUDA Operator
High-performance parallel computing kernel functions written based on the NVIDIA CUDA platform.
Website pending - 2222
DSpark
An enhanced block-level speculative decoding algorithm proposed by DeepSeek, aiming to improve token coherence and acceptance length.
Website pending - 2223
Hardware Decoding
Technology using dedicated chip circuits rather than general-purpose CPUs to decompress video streams.
Website pending - 2224
PD Disaggregation
An architecture that deploys prefill and decode phases of LLM inference on separate compute resources to optimize throughput and latency.
Website pending - 2225
Time to First Token (TTFT)
Latency from request initiation to first token generation, measuring responsiveness
Website pending - 2226
Paged Attention
Manages KV cache dynamically using virtual memory principles to eliminate fragmentation
Website pending - 2227
Output Distribution
The set of probability predictions for the next token, reflecting language modeling capability
Website pending - 2228
Adaptive Thinking
A technique where the model dynamically adjusts internal reasoning depth or computational resource allocation based on task complexity.
Website pending - 2229
Runtime Configuration
The ability to dynamically adjust parameters or components during program execution rather than fixing them at compile time.
Website pending - 2230
CUDA Graphs
Technology capturing GPU operation sequences as static graphs to reduce launch overhead
Website pending - 2231
Hot Reloading
Dynamically updating code or configuration without restarting services or interrupting sessions
Website pending - 2232
Agent Trajectory
Sequence of states, actions, and feedback recorded during an agent's task execution
Website pending - 2233
Capability Commoditization
The process where once-scarce advanced AI functions become low-cost generic services as technology spreads
Website pending - 2234
Marginal Value of Intelligence
The additional economic benefit generated by each incremental unit of frontier AI capability
Website pending - 2235
NAND Flash
Non-volatile storage technology widely used in SSDs and mobile devices, characterized by high density.
Website pending - 2236
DRAM
Dynamic Random Access Memory, the primary form of volatile computer main memory requiring periodic refresh.
Website pending - 2237
Subliminal Learning
Behavioral changes induced by implicit signals or indirect data transmission
Website pending - 2238
Self-Modeling
Internal representation and cognition of a model's own capabilities, states, and outputs
Website pending - 2239
Emergent Misalignment
Unexpected harmful behaviors emerging despite good performance on specific tasks
Website pending - 2240
Proprietary Data
Exclusive datasets owned by entities, often used to train models with unique advantages in vertical domains
Website pending