About me
I am pursuing doctoral studies at the Electrical Engineering and Computer Science (EECS) Department at MIT, under the supervision of Prof. Antonio Torralba. My research interests are primarily focused on interpretability and generative AI. Check out my publications!
Before embarking on my PhD journey, I completed undergraduate studies in Mathematics at the University of Vienna and The Autonomous University of Barcelona. Following this, I gained industry exposure as an AI Engineer at Twenty Billion Neurons, which was subsequently acquired by Qualcomm. Furthering my academic pursuits, I completed a Master of Science (MSc) degree in Computer Science from the University of Oxford and had the opportunity to contribute as a research intern at the Torr Vision Group.
In addition to my academic and professional commitments, I actively participate in the academic community by serving as a reviewer for a number of esteemed conferences and journals, including ICCV (2021, 2023), CVPR (2022, 2023, 2024), ICLR (2022), NeurIPS (2021), ACM FAccT (2024), TPAMI, and IJCV.
News
2024
- October Our work “NewMove: Customizing text-to-video models with novel motions” was accepted at ACCV 2024!
- Our work “Concept sliders: Lora adaptors for precise control in diffusion models” was presented at ECCV 2024!
- We presented our paper “AirLetters: An Open Video Dataset of Characters Drawn in the Air” at HANDS Workshop in ECCV 2024!
- The work in collaboration with the Data Provenance Initiative got accepted at Neurips 2024!
- April Our workshop Text, Camera, Action! Frontiers in Controllable Video Generation got accepted at the ICML 2024’ Conference in Vienna!
- February Honoured to be invited as a speaker at the Rising Stars in AI Symposium 2024 in Saudi Arabia!
2023
- December Our work “FIND: A Function Description Benchmark for Evaluating Interpretability Methods” was accepted at NeurIPS 2023!
- December Our work “Unified Concept Editing in Diffusion Models” was accepted at WACV 2023!
- June - August I had the pleasure to intern at Adobe Research under the supervision of Bryan Russell, Richard Zhang, Josef Sivic and Eli Shechtman.
- May: Our paper “Erasing Concepts from Diffusion Models” has been chosen for a spotlight presentation at the Machine Learning Advances Symposium.
2022
- July: Proud to have won the second place of the poster competition at the International Computer Vision Summer School .
- June: Our paper “Disentangling visual and written concepts in CLIP” got awarded an Oral (~4% acceptance rate) at CVPR 22’ in New Orleans.
- June-August I was fortunate to intern at Netflix Research under the supervision of Mahdi M Kalayeh
Publications
Consent in Crisis: The Rapid Decline of the AI Data Commons
Shayne Longpre, Robert Mahari, Ariel Lee, Campbell Lund, Hamidah Oderinwale, William Brannon, Nayan Saxena, Naana Obeng-Marnu, Tobin South, Cole Hunter, Kevin Klyman, Christopher Klamm, Hailey Schoelkopf, Nikhil Singh, Manuel Cherep, Ahmad Anis, An Dinh, Caroline Chitongo, Da Yin, Damien Sileo, Deividas Mataciunas, Diganta Misra, Emad Alghamdi, Enrico Shippole, Jianguo Zhang, Joanna Materzyńska, Kun Qian, Kush Tiwary, Lester Miranda, Manan Dey, Minnie Liang, Mohammed Hamdy, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Shrestha Mohanty, Vipul Gupta, Vivek Sharma, Vu Minh Chien, Xuhui Zhou, Yizhi Li, Caiming Xiong, Luis Villa, Stella Biderman, Hanlin Li, Daphne Ippolito, Sara Hooker, Jad Kabbara, Sandy Pentland
NeurIPS 2024 Track on Datasets and Benchmarks
[paper]
AirLetters: An Open Video Dataset of Characters Drawn in the Air
Rishit Dagli, Guillaume Berger, Joanna Materzyńska, Ingo Bax, Roland Memisevic
ECCVW 2024 HANDS Workshop
[paper]
Re-enacting video shots with fictional characters
Joanna Materzynska, David Bau, Antonio Torralba
ICCVW 2021 CVEU Workshop (Spotlight)
[paper]
The "something something" video database for learning and evaluating visual common sense
Raghav Goyal, Samira Ebrahimi Kahou, Vincent Michalski, Joanna Materzyńska, Susanne Westphal, Heuna Kim, Valentin Haenel, Ingo Fruend, Peter Yianilos, Moritz Mueller-Freitag, Florian Hoppe, Christian Thurau, Ingo Bax, Roland Memisevic
ICCV 2017
[paper] [dataset]
The SYNTHIA dataset: A large collection of synthetic images for semantic segmentation of urban scenes
German Ros, Laura Sellart, Joanna Materzyńska, David Vazquez, Antonio M Lopez
CVPR 2016
[paper]