Orthogonality

Number of linearly independent rows or columns.

Sensitivity of a function to input perturbations.

Matrix of first-order derivatives for vector-valued functions.

Direction of steepest ascent of a function.

Vector whose direction remains unchanged under linear transformation.

Decomposes a matrix into orthogonal components; used in embeddings and compression.

Measure of vector magnitude; used in regularization and optimization.

Measures similarity and projection between vectors.