Dear Colleagues and Students, I highly recommend this talk, as the speaker (from MIT) is a rising star in NLP who combines LLMs with classical concepts such as grammars and syntactic structures, which is quite different from the purely empirical mainstream. Liang On Feb 29, 2024, at 11:50 AM, Tadepalli, Prasad <prasad.tadepalli@oregonstate.edu> wrote: Dear all, Tomorrow’s AI seminar will be by Yoon Kim, who will be talking about large language models. This seminar will be remote, but please attend in person if possible. Prasad Location: KEC 1001 Zoom link: https://oregonstate.zoom.us/j/96491555190?pwd=azJHSXZ0TFQwTFFJdkZCWFhnTW04UT09<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Foregonstate.zoom.us%2Fj%2F96491555190%3Fpwd%3DazJHSXZ0TFQwTFFJdkZCWFhnTW04UT09&data=05%7C02%7Cai%40engr.oregonstate.edu%7Cc7d7403c4e2840cc2b5a08dc39b29724%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638448686393141217%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=2in6AcbqWCKpwK4Hh6TXnuopdlVB47CY61jo4gqL8PM%3D&reserved=0> Large Language Models and Symbolic Structures Yoon Kim EECS, Massachusetts Institute of Technology Abstract: Over the past decade the field of NLP has shifted from a pipelined approach (wherein intermediate symbolic structures such as parse trees are explicitly predicted and utilized for downstream tasks) to an end-to-end approach wherein pretrained large language models (LLMs) are adapted to various downstream tasks via finetuning or prompting. What role (if any) can symbolic structures play in the era of LLMs? In the first part of the talk, we will see how latent symbolic structures in the form of hierarchical alignments can be used to guide LM-based neural machine translation systems to improve translation of low resource languages and even enable the use of new translation rules during inference. In the second part, we will see how expert-derived grammars can be used to control LLMs via prompting for tasks such as semantic parsing where the output structure must obey strict domain-specific constraints. Speaker Biography: Yoon Kim is an assistant professor at MIT EECS. He received his PhD from Harvard University, advised by Alexander Rush. _______________________________________________ Ai mailing list Ai@engr.oregonstate.edu<mailto:Ai@engr.oregonstate.edu> https://it.engineering.oregonstate.edu/mailman/listinfo/ai<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engineering.oregonstate.edu%2Fmailman%2Flistinfo%2Fai&data=05%7C02%7Cai%40engr.oregonstate.edu%7Cc7d7403c4e2840cc2b5a08dc39b29724%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638448686393141217%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=vA3KbTYGIbQZr9ATpxPuwfayele1lw3ErYh6OptrLd8%3D&reserved=0>