Dear all, Our next AI seminar on *"**The Data Pyramid for Building Generalist Agents* *" *by Yuke Zhu is scheduled to be on February 17th (Tomorrow), 1-2 PM PST (Add to Google Calendar <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcalendar.google.com%2Fcalendar%2Fevent%3Faction%3DTEMPLATE%26tmeid%3DM2dldjQ2cG9rb24ydmllNzY5bWY5Y2hiNHJfMjAyMzAyMTdUMjEwMDAwWiBjX25rNXRvdjk5bXZpZ2lnc3RndWEzcm11dGtzQGc%26tmsrc%3Dc_nk5tov99mvigigstgua3rmutks%2540group.calendar.google.com&data=05%7C01%7Cai%40engr.orst.edu%7Cb8d6d92c4d584a302c2e08db106225a7%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638121785939461794%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=pzYUKLb8hUC%2F979TsJhCYfs90uI6hwpQDmeCZKguuCA%3D&reserved=0> ). It will be followed by a 30-minute Q&A session with the graduate students. *Location: Rogers 230* *The Data Pyramid for Building Generalist Agents* Yuke Zhu Assistant Professor UT-Austin *Abstract:* Recent advances in AI and Machine Learning have made great strides in developing robust and adaptive agents in the real world. Nonetheless, unlike the recent remarkable multi-task consolidations in Natural Language Processing and Computer Vision, today’s Embodied AI research has mainly focused on building siloed systems for narrow tasks. We argue that the crux of building generalist agents is harnessing massive, diverse, and multimodal data altogether. This talk will examine various sources of training data available for training embodied agents, from Internet-scale corpora to task demonstrations. We will discuss the complementary values and limitations of these data in a pyramid structure and introduce our recent efforts in building generalist agents with this data pyramid. *Speaker Bio:* Yuke Zhu is an Assistant Professor in the Computer Science department of UT-Austin, where he directs the Robot Perception and Learning Lab. He is also a core faculty at Texas Robotics and a senior research scientist at NVIDIA. His research lies at the intersection of robotics, machine learning, and computer vision. He received his Master's and Ph.D. degrees from Stanford University. His research works have won several awards and nominations, including the Best Conference Paper Award in ICRA 2019, Outstanding Learning Paper at ICRA 2022, Outstanding Paper at NeurIPS 2022, and Best Paper Finalists in IROS 2019, 2021. He is the recipient of the NSF CAREER Award and the Amazon Research Awards. *Please watch this space for future AI Seminars :* https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineering.oregonstate.edu%2FEECS%2Fresearch%2FAI&data=05%7C01%7Cai%40engr.orst.edu%7Cb8d6d92c4d584a302c2e08db106225a7%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638121785939461794%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2BdPLsTWzATZm1m0BzogeonsPpYw6GtEFreTsF9OadMY%3D&reserved=0 Rajesh Mangannavar, Graduate Student Oregon State University ---- AI Seminar Important Reminders: -> For graduate students in the AI program, attendance is strongly encouraged.