[NeurIPS 2022] UniCLIP: Unified Framework for Contrastive Language-Image Pre-training
Research paper
LG AI Research introduces UniCLIP, a unified framework that integrates contrastive learning from different domains into a single embedding space, addressing image-text misalignment due to augmentation with an augmentation-aware projection head, and proposing MP-NCE loss and domain-dependent similarity scores.
