State Space

Set of all actions available to the agent.

Strategy mapping states to actions.

Expected cumulative reward from a state or state-action pair.

Expected return of taking action in a state.

Chooses which experts process each token.

Capabilities that appear only beyond certain model sizes.

Empirical laws linking model size, data, compute to performance.

Formal framework for sequential decision-making under uncertainty.