Vision Transformer

Joint vision-language model aligning images and text.

Combining signals from multiple modalities.

Attention between different modalities.

Pixel motion estimation between frames.

Assigning labels per pixel (semantic) or per instance (instance segmentation) to map object boundaries.

Assigning category labels to images.

Pixel-level separation of individual object instances.

Pixel-wise classification of image regions.