RAG

Retrieval based on embedding similarity rather than keyword overlap, capturing paraphrases and related concepts.

Breaking documents into pieces for retrieval; chunk size/overlap strongly affect RAG quality.

Constraining outputs to retrieved or provided sources, often with citation, to improve factual reliability.

Fine-tuning on (prompt, response) pairs to align a model with instruction-following behaviors.

Generates sequences one token at a time, conditioning on past tokens.

Predicts masked tokens in a sequence, enabling bidirectional context; often used for embeddings rather than generation.

Achieving task performance by providing a small number of examples inside the prompt without weight updates.

Stepwise reasoning patterns that can improve multi-step tasks; often handled implicitly or summarized for safety/priv...