cross-modal-retrieval

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).

New generation of CLIP with strong fine grained discrimination capability, ICML2026 and ICML2025

Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

TOMM2020 Dual-Path Convolutional Image-Text Embedding with Instance Loss 🐾 https://arxiv.org/abs/1711.05535

[AAAI2021] The code of “Similarity Reasoning and Filtration for Image-Text Matching”

Code for "Learning the Best Pooling Strategy for Visual Semantic Embedding", CVPR 2021 (Oral)

[NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations

Deep Supervised Cross-modal Retrieval (CVPR 2019, PyTorch Code)

[ICCV 2023] DiffusionRet: Generative Text-Video Retrieval with Diffusion Model

Official Pytorch implementation of "Probabilistic Cross-Modal Embedding" (CVPR 2021)

Polysemous Visual-Semantic Embedding for Cross-Modal Retrieval (CVPR 2019)

[CVPR 2023 Highlight & TPAMI] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning

Official implementation of "Contrastive Audio-Language Learning for Music" (ISMIR 2022)

PyTorch code for BagFormer: Better Cross-Modal Retrieval via bag-wise interaction

Unsupervised Contrastive Cross-modal Hashing (IEEE TPAMI 2023, PyTorch Code)

[CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval

An AI-powered interactive video retrieval system