Results for "data distribution"

312 results

Temperature Intermediate

Scales logits before sampling; higher increases randomness/diversity, lower increases determinism.

Foundations & Theory
Softmax Intermediate

Converts logits to probabilities by exponentiation and normalization; common in classification and LMs.

Foundations & Theory
Fisher Information Intermediate

Measures how much information an observable random variable carries about unknown parameters.

AI Economics & Strategy
Sim-to-Real Gap Advanced

Performance drop when moving from simulation to reality.

Simulation & Sim-to-Real
Imitation Learning Advanced

Learning policies from expert demonstrations.

Reinforcement Learning
Model Release Control Intermediate

Restricting distribution of powerful models.

Governance & Ethics
Data Drift Intermediate

Shift in feature distribution over time.

MLOps & Infrastructure
Model Inversion Intermediate

Inferring sensitive features of training data.

AI Economics & Strategy
Data Governance Intermediate

Processes and controls for data quality, access, lineage, retention, and compliance across the AI lifecycle.

Foundations & Theory
Data Lineage Intermediate

Tracking where data came from and how it was transformed; key for debugging and compliance.

Foundations & Theory
Online Learning Intermediate

Learning where data arrives sequentially and the model updates continuously, often under changing distributions.

Machine Learning
Latent Space Intermediate

The internal space where learned representations live; operations here often correlate with semantics or generative factors.

Foundations & Theory
Gradient Leakage Intermediate

Recovering training data from gradients.

AI Economics & Strategy
Latent Diffusion Advanced

Diffusion performed in latent space for efficiency.

Diffusion & Generative Models
Tool-Augmented Prompt Intro

Enables external computation or lookup.

Prompting & Instructions
Sharp Minimum Intermediate

A narrow minimum often associated with poorer generalization.

AI Economics & Strategy
Inductive Bias Intermediate

Built-in assumptions guiding learning efficiency and generalization.

AI Economics & Strategy
Meta-Learning Intermediate

Methods that learn training procedures or initializations so models can adapt quickly to new tasks with little data.

Machine Learning
Regularization Intermediate

Techniques that discourage overly complex solutions to improve generalization (reduce overfitting).

Foundations & Theory
Boltzmann Machine Intermediate

Probabilistic energy-based neural network with hidden variables.

Model Architectures
Hallucination Intermediate

Model-generated content that is fluent but unsupported by evidence or incorrect; mitigated by grounding and verification.

Model Failure Modes
Conditional Random Field Intermediate

Probabilistic graphical model for structured prediction.

Model Architectures
Change Point Detection Intermediate

Identifying abrupt changes in data generation.

Time Series
Domain Randomization Advanced

Randomizing simulation parameters to improve real-world transfer.

Simulation & Sim-to-Real
SLAM Intermediate

Simultaneous Localization and Mapping for robotics.

Computer Vision
Particle Filter Intermediate

Monte Carlo method for state estimation.

Time Series
Retrieval Prompt Intro

Prompt augmented with retrieved documents.

Prompting & Instructions
State Estimation Advanced

Inferring the agent’s internal state from noisy sensor data.

Robotics & Embodied AI
Surrogate Model Advanced

Fast approximation of costly simulations.

AI in Science
Federated Learning Intermediate

Training across many devices/silos without centralizing raw data; aggregates updates, not data.

Foundations & Theory

Welcome to AI Glossary

The free, curated AI dictionary built from real, established terms and designed for a clean reading experience.

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.