Multimodal alignment

Deep Pre-Alignment for VLMs
Modular visual-encoder replacement for deeper multimodal pre-alignment.
RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
Open-source AI feedback for trustworthy MLLM alignment.