This work proposes a novel early fusion embedding approach that combines video and language information at the word level and uses the inverse task of dense ...

We propose a novel method capable of retrieving clips from untrimmed videos based on natural language queries. This cross-modal retrieval task plays a key ...

Text-to-Clip Video Retrieval with Early Fusion and Re-Captioning.bib.

2018/04/13 · 04/13/18 - We propose a novel method capable of retrieving clips from untrimmed videos based on natural language queries.

2018/12/25 · Our key idea is to integrate language and vi- sion more closely before computing a match, using an early fusion scheme, query-specific proposals ...

Video-language transformers for text-to-video retrieval typically consist of a video encoder, a text encoder, and a joint encoder.

We explore retrieval-augmented egocentric video captioning, an alternative way for transferring knowledge from exocentric videos to enhance egocentric video ...

TVR (Text-to-Video Retrieval) involves two main aspects: 1) Searching through video metadata such as titles, descriptions, and tags, and 2) Converting spoken ...

We introduce text-guided distillation learning that enables each video path to acquire meaningful distinct competencies in representing varied semantics.

Text-to-video retrieval systems have recently made sig- nificant progress by utilizing pre-trained models trained on large-scale image-text pairs.