Keynote Gaël Varoquaux - DCASE2022 Workshop

DCASE2022 Workshop
Workshop on Detection and Classification of Acoustic Scenes and Events

Keynote Carina Prunkl
Inria, National Institute for Research in Digital Science and Technology

Model evaluation, a machine-learning bottleneck

Abstract

While machine-learning papers always come with amazing promises, these do not always carry over to wider settings. One of the reasons for such shortcomings is that our evaluation is often detached from reality. As machine-learners love to go metric chasing, it is crucial that these metrics are chosen to reflect the application settings. In addition, conclusions of evaluation must also be informed the associated uncertainty on each model evaluation. In my talk, I will expose some seldom-discussed considerations on choice of metrics for simple classification problems, and on evaluation uncertainty.

Biography

Gaël Varoquaux is a research director working on data science and health at Inria (French Computer Science National research). His research focuses on statistical-learning tools for data science and scientific inference, with an eye on applications in health and social science. He develops tools to make machine learning easier, with statistical models suited for real-life, uncurated data, and software for data science. For example, since 2008, he has been exploring data-intensive approaches to understand brain function and mental health. He co-funded scikit-learn, one of the reference machine-learning toolboxes, and helped build various central tools for data analysis in Python. Varoquaux has a PhD in quantum physics and is a graduate from Ecole Normale Superieure, Paris.

...............................................................................................................................................................................

The workshop aims to provide a venue for researchers working on computational analysis of sound events and scene analysis to present and discuss their results.

The 7th Workshop on Detection and Classification of Acoustic Scenes and Events, DCASE 2022, will be held in Nancy on November 3-4. The event will be held in presence with oral talks being broadcasted.

As in previous years the workshop is organized in conjunction with the DCASE challenge. We aim to bring together researchers from many different universities and companies with an interest in the topic, and provide the opportunity for scientific exchange of ideas and opinions.

The technical program will include invited speakers on the topic of computational everyday sound analysis and recognition, and oral and poster presentations of accepted papers. Additionally, a special poster session will be dedicated to the DCASE 2022 challenge entries and results.