Contrastive Image-Text Pretraining for Italian | Gabriele Sarti

Contrastive Image-Text Pretraining for Italian

CLIP is a multimodel model that can learn to represent images and text jointly in the same space. In this project, we aim to propose the first CLIP model trained on Italian data, that in this context can be considered a low resource language. Using a few techniques, we have been able to fine-tune a SOTA Italian CLIP model with only 1.4 million training samples.

For more information, refer to our demo.

Related