In this last decade, we have seen a lot of progress in AI and machine learning using a single recipe: given a task, we train a single neural network to map inputs to outputs. In this talk, I will show that this one-neural-network-per-task framework can be extended to improve generalization. First, I will describe modular meta-learning, which achieves language-like generalization by training a set of composable neural modules. By having multiple neural networks per task, and multiple tasks per neural network, we are able to reuse information and achieve bigger data and computational efficiency. In the second part of my talk, I will describe tailoring, a general way of encoding inductive biases in neural networks by optimizing unsupervised objectives inside the prediction function, essentially having one neural network per input. Finally, I will describe my vision for creating a flexible ML framework that will enable training reinforcement learning policies within minutes rather than days, solving complex search and discovery problems, and improving our understanding of generalization in deep learning.
Bio: Ferran Alet is a PhD candidate at MIT CSAIL advised by Leslie Kaelbling, Tomas Lozano-Perez, and Joshua Tenenbaum. His research is on machine learning and leverages techniques from meta-learning, learning to search, program synthesis, and insights from mathematics and the physical sciences. During his PhD, he created the MIT Embodied Intelligence Seminar, mentored 17 students, and won the MIT Outstanding Mentor award 2021. Ferran studied mathematics and physics in Barcelona thanks to CFIS, a program for doing two degrees, where he was the valedictorian of his promotion. In college, he participated in the ACM-ICPC programming contest, being the most decorated in the history of his regional phase (South Western Europe). In grad school, he earned a “La Caixa” fellowship and was responsible for the high-level planner of the MIT-Princeton team for the Amazon Robotics Challenge, which won the stowing task in 2017. You can find more information and papers at www.alet-et.al
This talk will be recorded and live-streamed at https://mediacentrallive.princeton.edu/