Posts by Collection

Portfolio item number 1

Short description of portfolio item number 1

Portfolio item number 2

Short description of portfolio item number 2

DIVE-Doc: Downscaling foundational Image Visual Encoder into hierarchical architecture for DocVQA

Published in ICCV (VisionDocs Workshop), 2025 | Code Repository | Demo
Oral Spotlight & Best Paper Award
Rayane Bencharef, Abderrahmane Rahiche, Mohamed Cheriet

This paper is about optimizing Visual Encoder (VE) of end-to-end DocVQA architectures. While reducing by 5x the size of the VE from a foundational to a hierarchical architecture, DIVE-Doc achieves a performance gap of 2.10 (ANLS) compared to its teacher Paligemma through a distillation training process. Moreover, this allowed to halves the visual module latency. Evaluation of the VE on downstream tasks (document classification & layout analysis) led to the conclusion that the VE seems to capture global structure of documents while semantic layout understanding seems to be achieved inside the language model decoder.

Talk 1 on Relevant Topic in Your Field

Published: March 01, 2012

This is a description of your talk, which is a markdown file that can be all markdown-ified like any other post. Yay markdown!

Tutorial 1 on Relevant Topic in Your Field

Published: March 01, 2013

More information here

Talk 2 on Relevant Topic in Your Field

Published: February 01, 2014

More information here

Conference Proceeding talk 3 on Relevant Topic in Your Field

Published: March 01, 2014

This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.