Results for "uncertainty measure"

A measure of randomness or uncertainty in a probability distribution.

Measure of consistency across labelers; low agreement indicates ambiguous tasks or poor guidelines.

Selecting the most informative samples to label (e.g., uncertainty sampling) to reduce labeling cost.

Measures a model’s ability to fit random noise; used to bound generalization error.

Reduction in uncertainty achieved by observing a variable; used in decision trees and active learning.

Quantifies shared information between random variables.

Measures how much information an observable random variable carries about unknown parameters.

Measure of spread around the mean.

Optimization under uncertainty.

A scalar measure optimized during training, typically expected loss over data, sometimes with regularization terms.

How well a model performs on new data drawn from the same (or similar) distribution as training.

Training objective where the model predicts the next token given previous tokens (causal modeling).

Ability to replicate results given same code/data; harder in distributed training and nondeterministic ops.

A measure of a model class’s expressive capacity based on its ability to shatter datasets.

Measures divergence between true and predicted probability distributions.

Measures how one probability distribution diverges from another.

Updating beliefs about parameters using observed evidence and prior distributions.

Models evaluating and improving their own outputs.

Formal framework for sequential decision-making under uncertainty.

Framework for identifying, measuring, and mitigating model risks.

Autoencoder using probabilistic latent variables and KL regularization.

Expected causal effect of a treatment.

Shift in feature distribution over time.

Decomposing goals into sub-tasks.

Measure of vector magnitude; used in regularization and optimization.

Measures similarity and projection between vectors.

Sensitivity of a function to input perturbations.

Variable whose values depend on chance.

Average value under a distribution.

Measures joint variability between variables.