Roberto Amoroso

ELLIS PhD Student, AI & Computer Vision
International Doctorate in ICT

About me

My name is Roberto Amoroso. I am an ELLIS PhD student enrolled in the International Doctorate in ICT program at the AImageLab research group of the University of Modena and Reggio Emilia 🇮🇹, under the supervision of Prof. Rita Cucchiara and Prof. Lorenzo Baraldi. I am involved in the study and development of novel Computer Vision and Deep Learning techniques.

I am currently a Machine Learning Engineering Intern at NVIDIA in Munich, Germany 🇩🇪, working on Multimodal Video Understanding for Autonomous Vehicles.

I was a PhD Intern at LMU - Ludwig-Maximilians-Universität of Munich, in Germany 🇩🇪, focusing on Video QA with Large Language Models (LLM) and Open-vocabulary Image Segmentation, under the co-supervision of Prof. Volker Tresp.

Prior to joining AImageLab, I was Research Scholar at the Networking Research Group in Saint Louis, USA 🇺🇸, working on Super-resolution techniques applied to Internet traffic matrices.

My primary areas of research are Open-vocabulary Segmentation and Multimodal Video Understanding. In addition, I have also conducted research on the pre-training and optimization of Transformer-based architecture for image classification, self-supervised learning, deepfake detection of synthetic images, and the development of image watermarking systems for artwork protection.

Feel free to reach me out if you have any questions or curiosities! :)

Interests

Computer Vision
Deep Learning
Machine Learning
Open-vocabulary Image Segmentation
Multimodal Video Understanding

Education

ELLIS PhD in AI and Computer Vision, 2024
University of Modena and Reggio Emilia
MS in Artificial Intelligence, 2020
University of Modena and Reggio Emilia
BS in Computer Engineering, 2018
University of Modena and Reggio Emilia

Experience

Machine Learning Engineering Intern

NVIDIA

Jan 2024 – Present Munich, Germany 🇩🇪

Research activity focused on the engineering, development, and deployment of Multimodal Video Understanding techniques for Autonomous Vehicles.

PhD Intern

LMU @ Ludwig-Maximilians-Universität of Munich

Jun 2023 – Nov 2023 Munich, Germany 🇩🇪

Research activity focused on the development of novel Multimodal Video Understanding and Open-vocabulary Image Segmentation techniques, under the co-supervision of Prof. Volker Tresp.

ELLIS PhD Student | International Doctorate in ICT

AImageLab @ University of Modena and Reggio Emilia

Nov 2021 – Present Modena, Italy 🇮🇹

The European Laboratory for Learning and Intelligent Systems (ELLIS) supports cutting-edge machine learning research in Europe. ELLIS PhD students (<5% 2021 acceptance rate) are selected on the basis of outstanding academic achievement. My research activity is focused on multimodal self-attentive Transformer-based models for visual semantic understanding, with applications to generative problems and visual semantic tasks.
1st in the ranking of student candidates for the International Doctorate in ICT.

Research Fellow

AImageLab @ University of Modena and Reggio Emilia

Feb 2021 – Nov 2021 Modena, Italy 🇮🇹

Research activity under the supervision of Prof. Rita Cucchiara and Prof. Lorenzo Baraldi, aimed at the study, analysis, and development of novel Computer Vision and Deep Learning techniques.

Research Engineer

CINI - Consorzio Interuniversitario Nazionale per l’Informatica

Nov 2020 – Jan 2021 Modena, Italy 🇮🇹

Development of a web platform for the management of data concerning the activities of European research centers, as part of the HumanE-AI-NET project, funded by the EU Framework Programme for Research and Innovation Horizon 2020.

Research Scholar

Saint Louis University

Mar 2020 – Sep 2020 St. Louis, USA 🇺🇸

Carried out research aimed at writing my MS thesis
Created an architecture that allows estimating Internet traffic matrices, combining a Computer Vision technique called Super-resolution with a distributed machine learning technique called Federated Learning

Erasmus+

AGH Akademia Górniczo-Hutnicza

Sep 2019 – Feb 2020 Krakow, Poland 🇵🇱

Attended the following courses:

Advanced Python Programming
Computer Vision
Cybersecurity and Cryptography
Programming in Javascript
Mobile App Development

Honors and Awards

[Sep. 2023] Best Project Award @ ELLIS Summer School on Large-Scale AI for the project “Radioactive Watermarks”, in which we investigate the “radioactivity” of watermarked texts, i.e. , whether they contaminate other models when used as fine-tuning data. The project was evaluated by Tal Hassner (Meta AI) and Marc’Aurelio Ranzato (DeepMind)

[Jul. 2022] ICVSS 2022 Reading Group Competition Award sponsored by Amazon Web Services (AWS) at ICVSS 2022 for participation in the reading group led by Prof. Dr. Stefano Soatto (leading science for AI Applications at AWS and Professor at the University of California Los Angeles)