Results for "regression loss"

100 results

Symbolic Regression Advanced

Finding mathematical equations from data.

AI in Science
Log Loss Intermediate

Penalizes confident wrong predictions heavily; standard for classification and language modeling.

Optimization
Loss Landscape Intermediate

The shape of the loss function over parameter space.

AI Economics & Strategy
Loss Function Intermediate

A function measuring prediction error (and sometimes calibration), guiding gradient-based optimization.

Foundations & Theory
Objective Function Intermediate

A scalar measure optimized during training, typically expected loss over data, sometimes with regularization terms.

Optimization
Supervised Learning Intermediate

Learning a function from input-output pairs (labeled data), optimizing performance on predicting outputs for unseen inputs.

Machine Learning
Gradient Descent Intermediate

Iterative method that updates parameters in the direction of negative gradient to minimize loss.

Optimization
Cross-Entropy Intermediate

Measures divergence between true and predicted probability distributions.

AI Economics & Strategy
Mean Squared Error Intermediate

Average of squared residuals; common regression objective.

Optimization
Parameters Intermediate

The learned numeric values of a model adjusted during training to minimize a loss function.

Foundations & Theory
Empirical Risk Minimization Intermediate

Minimizing average loss on training data; can overfit when data is limited or biased.

Optimization
Objective Surface Intermediate

Visualization of optimization landscape.

Foundations & Theory
Segmentation Intermediate

Assigning labels per pixel (semantic) or per instance (instance segmentation) to map object boundaries.

Computer Vision
Value at Risk Intermediate

Maximum expected loss under normal conditions.

AI Economics & Strategy
Global Minimum Intermediate

Lowest possible loss.

Foundations & Theory
Calibration Intermediate

The degree to which predicted probabilities match true frequencies (e.g., 0.8 means ~80% correct).

Foundations & Theory
LIME Intermediate

Local surrogate explanation method approximating model behavior near a specific input.

Foundations & Theory
Momentum Intermediate

Uses an exponential moving average of gradients to speed convergence and reduce oscillation.

Optimization
Early Stopping Intermediate

Halting training when validation performance stops improving to reduce overfitting.

Foundations & Theory
Sharp Minimum Intermediate

A narrow minimum often associated with poorer generalization.

AI Economics & Strategy
Flat Minimum Intermediate

A wide basin often correlated with better generalization.

AI Economics & Strategy
Hessian Matrix Intermediate

Matrix of second derivatives describing local curvature of loss.

AI Economics & Strategy
GAN Advanced

Two-network setup where generator fools a discriminator.

Diffusion & Generative Models
Semantic Segmentation Intermediate

Pixel-wise classification of image regions.

Computer Vision
Local Minimum Intermediate

Minimum relative to nearby points.

Foundations & Theory
Overgeneralization Intermediate

Applying learned patterns incorrectly.

Model Failure Modes
Catastrophic Forgetting Intermediate

Loss of old knowledge when learning new tasks.

Model Failure Modes
Imitation Learning Advanced

Learning policies from expert demonstrations.

Reinforcement Learning
Machine Learning Intermediate

A subfield of AI where models learn patterns from data to make predictions or decisions, improving with experience rather than explicit rule-coding.

Machine Learning
Model Intermediate

A parameterized mapping from inputs to outputs; includes architecture + learned parameters.

Foundations & Theory

Welcome to AI Glossary

The free, curated AI dictionary built from real, established terms and designed for a clean reading experience.

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.