The ICBINB Monthly Seminar Series seeks to shine a light on the “stuck” phases of research. Speakers will tell us about their most beautiful ideas that didn’t “work”, about when theory didn’t match practice, or perhaps just when the going got tough. These talks will let us peek inside the file drawer of unexpected negative results and peer behind the curtain to see the real story of how real researchers do real research.
For more: [ Ссылка ]
----
Date: 10th November, 2022
Title: Metrics Reloaded
Abstract: Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Specifically, chosen performance metrics do not necessarily reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To break such historically grown poor practices, we followed a multidisciplinary cross-domain approach that enabled us to critically question common practice in different communities and integrate distributed knowledge in one common framework.
This talk will comprise two parts. The first part will cover common and rare pitfalls of metrics in the field of image analysis, which have been compiled by a large multidisciplinary international consortium in a community-powered process. The second part will present Metrics Reloaded, a comprehensive framework guiding researchers towards choosing metrics in a problem-aware manner. A specific focus will be put on recommendations that go beyond the current state of the art.
Biography: Lena Maier-Hein is head of the division Intelligent Medical Systems at the German Cancer Research Center (DKFZ) and serves as managing director of the DKFZ Data Science and Digital Oncology cross-topic program. Her research concentrates on machine learning-based biomedical image analysis with a specific focus on surgical data science, computational biophotonics and validation of machine learning algorithms. During her academic career, Lena Maier-Hein has been distinguished with several science awards including the 2013 Heinz Maier Leibnitz Award of the German Research Foundation (DFG) and the 2017/18 Berlin-Brandenburg Academy Prize. She is further a fellow of the Medical Image Computing and Computer Assisted Intervention (MICCAI) society and of the European Laboratory for Learning and Intelligent Systems (ELLIS). Further international recognitions include a European Research Council (ERC) starting grant (2015-2020) and consolidator grant (2021-2026).
