Quote
B. Ionescu, H. Müller, D.-C. Stanciu, A.-G. Andrei, A. Radzhabov, Y. Prokopchuk, L.-D. Stefan, M. G. Constantin, M. Dogariu, V. Kovalev, H. Damm, J. Rückert, A. B. Abacha, A. G. S. de Herrera, C. M. Friedrich, L. Bloch, R. Brüngel, A. Idrissi-Yaghir, H. Schäfer, C. S. Schmidt, T. M. G. Pakull, B. Bracke, O. Pelka, B. Erylmaz, H. Becker, W.-W. Yim, N. Codella, R. A. Novoa, J. Malvehy, D. Dimitrov, R. J. Das, Z. Xie, M. S. Hee, P. Nakov, I. Koychev, S. A. Hicks, S. Gautam, M. A. Riegler, V. Thambawita, P. Halvorsen, D. Fabre, C. Macaire, B. Lecouteux, D. Schwab, M. Potthast, M. Heinrich, J. Kiesel, M. Wolter, S. Anand, and B. Stein, "Overview of ImageCLEF 2025: Multimedia Retrieval in Medical, Social Media and Content Recommendation Applications," in Experimental IR Meets Multilinguality, Multimodality, and Interaction: 16th International Conference of the CLEF Association, CLEF 2025, Madrid, Spain, September 9-12, 2025, Proceedings, 2026, pp. 290-314.
Content
This paper presents an overview of the ImageCLEF 2025 lab, which was organized within the Conference and Labs of the Evaluation Forum - CLEF Labs 2025. ImageCLEF is an ongoing evaluation event that started in 2003, promoting the evaluation of technologies for annotation, indexing, and retrieval of multimodal data and aiming to provide access to large collections of data across a veriety of scenarios, domains and contexts. In 2025, the 23rd edition of ImageCLEF consists of four main tasks: (i) the Medical task, comprised of four sub-tasks, approaching a wide array of problems in the medical field, like concept detection, caption prediction, explainability assessment in radiology images, evaluating the veracity of GAN-generated 3D CT scans, providing a segmentation and answers to close-ended questions regarding dermatology images, or visual question answering and synthetic image generation involving gastrointestinal images, (ii) a new Multimodal Reasoning task, involving answering multiple-choice questions in 13 different languages, covering a wide range of subjects and difficulty levels, (iii) the ToPicto task, which focuses on converting either text or speech into a meaningful sequence of pictograms and (iv) the Argument-Image task, which explores the augmentation of arguments using images, by either retrieval or synthetic generation. This edition of the ImageCLEF benchmark attracted 193 teams that registered to the different tasks, of which 56 finished the challenges. This resulted in 493 submitted runs and a total of 45 working note papers. Overall, this year's edition has been very successful, with the biggest number of teams, submissions and working notes papers since 2019.