PROJECT

LipReading with 3D Face Keypoints and Cross-Attention Adapters

A visual speech-recognition prototype that conditions a frozen causal language model on normalized 3D face landmarks. Gated cross-attention adapters inject the landmark sequence as conditioning tokens for lip-reading.

PROJECTS UPDATES