multi-modal-learning

Here are 33 public repositories matching this topic...

mlfoundations / open_clip

An open source implementation of CLIP.

computer-vision deep-learning pytorch pretrained-models language-model contrastive-loss multi-modal-learning zero-shot-classification

Updated Nov 28, 2022
Python

jokieleung / awesome-visual-question-answering

Star

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

vqa awesome-list multi-modal multi-modal-learning attention-networks

Updated Oct 8, 2022

lucidrains / x-clip

Sponsor

Star

A concise but complete implementation of CLIP with various experimental improvements from recent papers

deep-learning artificial-intelligence zero-shot-learning multi-modal-learning contrastive-learning

Updated Oct 16, 2022
Python

OFA-Sys / Chinese-CLIP

Star

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

nlp computer-vision pytorch chinese pretrained-models clip vision-language multi-modal-learning image-text-retrieval vision-and-language-pre-training

Updated Nov 28, 2022
Python

moabarar / nemar

Star

[CVPR2020] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

deep-learning cnn pytorch multi-modal image-registration affine-transformation stn image-to-image-translation multimodal deformable-transformation multi-modal-learning cvpr2020 registartion multimodal-image-registration

Updated Aug 2, 2020
Python

josedolz / HyperDenseNet_pytorch

Star

Pytorch version of the HyperDenseNet deep neural network for multi-modal image segmentation

deep-learning pytorch segmentation image-segmentation medical-image-processing 3d-convolutional-network 3d-cnn pytorch-cnn medical-image-segmentation hyperdensenet multi-modal-imaging multi-modal-learning

Updated Nov 20, 2019
Python

rentainhe / TRAR-VQA

Star

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation

visualization pytorch transformer attention official multi-modal clevr visual-question-answering vision-and-language dynamic-network multi-modality multi-modal-learning multi-scale-features vqav2 iccv2021 local-and-global

Updated Oct 11, 2021
Python

rinnakk / japanese-clip

Star

Japanese CLIP by rinna Co., Ltd.

japanese vision pretrained-models language-model clip multi-modal-learning cloob

Updated Jul 19, 2022
Python

likyoo / Multimodal-Remote-Sensing-Toolkit

Star

A python tool to perform deep learning experiments on multimodal remote sensing data.

python pytorch remote-sensing multi-modal-learning

Updated Jan 23, 2022
Python

zhjohnchan / awesome-vision-and-language-pretraining

Star

A curated list of vision-and-language pre-training (VLP). :-)

pre-training multi-modal-learning vision-and-language-pre-training

Updated Jul 6, 2022

liyichen-cly / MMEA

Star

MMEA: Entity Alignment for Multi-Modal Knowledge Graphs

knowledge-graph entity-alignment multi-modal-learning

Updated Jun 4, 2022
Python

peymanbateni / multimodal-emotion-analysis-in-conversations

Star

Multi-model analysis of sentiment and emotion in multi-speaker conversations.

deep-learning sentiment-classification emotion-recognition graph-neural-networks multi-modal-learning

Updated Aug 23, 2022
Jupyter Notebook

Yi-Min Chou, Yi-Ming Chan, Jia-Hong Lee, Chih-Yi Chiu, Chu-Song Chen, "Unifying and Merging Well-trained Deep Neural Networks for Inference Stage," International Joint Conference on Artificial Intelligence (IJCAI), 2018

deep-neural-networks tensorflow multi-task-learning efficient-inference cnn-compression unifying-and-merging-cnn multi-modal-learning