- Ai - Engineering Mailing Lists

AI Seminar: Hannah Kerner
by Tadepalli, Prasad 11 Jan '22

11 Jan '22

Dear all, The rest of the AI Seminars this term are going to be over Zoom only. This week's seminar speaker, Hannah Kerner of University of Maryland, has been nominated by graduate students. The seminar will be followed by a Q&A session with students. Please note that the recordings of most of the past seminars are available from the AI Seminar page: https://eecs.oregonstate.edu/ai-events See you at the seminar tomorrow. Prasad Tadepalli -------------------- AI Seminar: Advancing Global Food Security and Sustainable Development with Machine Learning and Earth Observations<https://eecs.oregonstate.edu/colloquium/ai-seminar-advancing-global-food-se…> Hannah Kerner Assistant Research Professor Department of Geographical Sciences University of Maryland Wednesday, January 12, 2022 - 1:00pm to 2:00pm https://oregonstate.zoom.us/j/93591935144?pwd=YjZaSjBYS0NmNUtjQzBEdzhPeDZ5U… Abstract Satellite Earth observation (EO) data is rapidly gaining interest in the AI community due to the massive datasets involved as well as the opportunities for using AI and EO data to address urgent challenges related to climate change, the environment, agriculture and food security, and humanitarian needs. However there are currently many challenges for developing AI systems that use EO data for practical applications, namely, there are limited public labeled datasets, a lack of harmonization across labels and source data, and existing algorithms do not account for geographic context. In this talk, I'll present some of the approaches we are developing to address these challenges to create AI+EO systems that can be integrated into real-world applications for advancing global food security and other sustainable development goals. Speaker Bio Dr. Hannah Kerner is an Assistant Research Professor in the Department of Geographical Sciences at the University of Maryland. Her research focuses on developing new machine learning methods for geospatial and remote sensing data and applications including agricultural monitoring, food security, Earth science, and planetary science. Dr. Kerner is the Machine Learning Lead and US Co-Lead for NASA Harvest, NASA's agriculture and food security initiative run out of the University of Maryland.

1 0

Alan Fern’s ai seminar zoom only
by Tadepalli, Prasad 05 Jan '22

05 Jan '22

Please note that today’s AI seminar will be on zoom only. AI Seminar: How to Train Your Robot to Stand, Walk, Run, Hop, and Skip Speaker: Alan Fern Wednesday, January 5, 2022 - 1:00pm to 2:00pm PST Zoom link: https://oregonstate.zoom.us/j/93591935144?pwd=YjZaSjBYS0NmNUtjQzBEdzhPeDZ5U… More details at https://eecs.oregonstate.edu/ai-events

1 0

AI Alignment Reading Group
by Pope, Quintin 04 Jan '22

04 Jan '22

Hello everyone, Our next meeting will be this Friday at 2 PM, PST. We're continuing to explore transformer interpretability. Our next paper is "Knowledge Neurons in Pretrained Transformers <https://arxiv.org/abs/2104.08696>" (GitHub implementation <https://github.com/EleutherAI/knowledge-neurons>). This paper is able to identify where pretrained transformers store knowledge and suppress, amplify or modify that knowledge. If you're at all interested in how transformers learn and represent information, you're welcome to attend! Abstract: > Large-scale pretrained language models are surprisingly good at recalling > factual knowledge presented in the training corpus. In this paper, we > explore how implicit knowledge is stored in pretrained Transformers by > introducing the concept of knowledge neurons. Given a relational fact, we > propose a knowledge attribution method to identify the neurons that express > the fact. We present that the activation of such knowledge neurons is > highly correlated to the expression of their corresponding facts. In > addition, even without fine-tuning, we can leverage knowledge neurons to > explicitly edit (such as update, and erase) specific factual knowledge for > pretrained Transformers. > Join Zoom Meeting https://oregonstate.zoom.us/j/95843260079?pwd=TzZTN0xPaFZrazRGTElud0J1cnJLU… Password: 961594 Phone Dial-In Information +1 971 247 1195 US (Portland) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) Meeting ID: 958 4326 0079 All the best, Quintin

1 0

AI Alignment Reading Group
by Pope, Quintin 14 Dec '21

14 Dec '21

Hello everyone, We will meet on Friday at 2 PM PST. We're continuing to explore transformer interpretability. Our next paper is "Knowledge Neurons in Pretrained Transformers <https://arxiv.org/abs/2104.08696>" (GitHub implementation <https://github.com/EleutherAI/knowledge-neurons>). This paper is able to identify where pretrained transformers store knowledge and suppress, amplify or modify that knowledge. If you're at all interested in how transformers learn and represent information, you're welcome to attend! Abstract: > Large-scale pretrained language models are surprisingly good at recalling > factual knowledge presented in the training corpus. In this paper, we > explore how implicit knowledge is stored in pretrained Transformers by > introducing the concept of knowledge neurons. Given a relational fact, we > propose a knowledge attribution method to identify the neurons that express > the fact. We present that the activation of such knowledge neurons is > highly correlated to the expression of their corresponding facts. In > addition, even without fine-tuning, we can leverage knowledge neurons to > explicitly edit (such as update, and erase) specific factual knowledge for > pretrained Transformers. > Join Zoom Meeting https://oregonstate.zoom.us/j/95843260079?pwd=TzZTN0xPaFZrazRGTElud0J1cnJLU… Password: 961594 Phone Dial-In Information +1 971 247 1195 US (Portland) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) Meeting ID: 958 4326 0079 All the best, Quintin

1 0

[CoRIS-List] Course registration (W'22): AI539 ST/ Safe and Reliable Autonomy
by Saisubramanian, Sandhya 06 Dec '21

06 Dec '21

Hi Everyone, I am offering a seminar-style special topics course AI 539: Safe and Reliable Autonomy in Winter 2022. While this course currently has AI/CS restriction on catalog, it is open to all CS/AI/Robotics students interested in safe and reliable operation of autonomous systems. Robotics students interested in this course can email me for overrides. More details about the course are available at https://www.sandhyasai.com/ai-539-st-safe-and-reliable-autonomy. Email me if you have questions about the course. Best, Sandhya Saisubramanian Assistant Professor School of EECS Oregon State University

1 0

Alignment Reading Group
by Pope, Quintin 06 Dec '21

06 Dec '21

Hello everyone, The alignment reading group will again meet on Friday at 2 PM PST. We're continuing our exploration of interpretability, this time focusing specifically on transformers. We'll discuss Transformer Feed-Forward Layers Are Key-Value Memories <https://arxiv.org/abs/2012.14913v2>. If you've ever asked yourself, "Okay, but what do transformers *actually* do?", this is a great paper to read. Newcomers are welcome! Paper abstract: > Feed-forward layers constitute two-thirds of a transformer model's > parameters, yet their role in the network remains under-explored. We show > that feed-forward layers in transformer-based language models operate as > key-value memories, where each key correlates with textual patterns in the > training examples, and each value induces a distribution over the output > vocabulary. Our experiments show that the learned patterns are > human-interpretable, and that lower layers tend to capture shallow > patterns, while upper layers learn more semantic ones. The values > complement the keys' input patterns by inducing output distributions that > concentrate probability mass on tokens likely to appear immediately after > each pattern, particularly in the upper layers. Finally, we demonstrate > that the output of a feed-forward layer is a composition of its memories, > which is subsequently refined throughout the model's layers via residual > connections to produce the final output distribution. > Join Zoom Meeting https://oregonstate.zoom.us/j/95843260079?pwd=TzZTN0xPaFZrazRGTElud0J1cnJLU… Password: 961594 Phone Dial-In Information +1 971 247 1195 US (Portland) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) Meeting ID: 958 4326 0079 All the best, Quintin

1 0

Alignment Reading Group: Interpretability
by Pope, Quintin 01 Dec '21

01 Dec '21

Hello everyone, The alignment reading group will meet this Friday at 2 PM PST. We’ll be discussing "Interpretability in ML: A Broad Overview <https://www.lesswrong.com/posts/57fTWCpsAyjeAimTp/interpretability-in-ml-a-…> " The article introduces many different aspects of interpretability, such as why we might want interpretable models, how to define or think about interpretability, different techniques used for different models, and how to evaluate the quality of interpretability techniques. Please join if you're interested in ML interpretability. Newcomers are welcome! Join Zoom Meeting https://oregonstate.zoom.us/j/95843260079?pwd=TzZTN0xPaFZrazRGTElud0J1cnJLU… Password: 961594 Phone Dial-In Information +1 971 247 1195 US (Portland) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) Meeting ID: 958 4326 0079 All the best, Quintin

1 0

AI seminar: Dec 1 2021
by Mangannavar, Rajesh Devaraddi 01 Dec '21

01 Dec '21

Dear all, Our next AI seminar on *"**AI for Imperfect-Information Games: Poker and Beyond" *by Noam Brown is scheduled to be on December 1st(Tomorrow), 1-2 PM PST. It will be followed by a 30 minute Q&A session by the graduate students. Note that this is a zoom event. Zoom Link: https://oregonstate.zoom.us/j/93591935144?pwd=YjZaSjBYS0NmNUtjQzBEdzhPeDZ5U… *Title: AI for Imperfect-Information Games: Poker and Beyond* Noam Brown Research Scientist Facebook AI Research *Abstract*: The field of artificial intelligence has had a number of high-profile successes in the domain of perfect-information games like chess and Go where all participants know the exact state of the world. But real-world strategic interactions typically involve hidden information, such as in negotiations, cybersecurity, and financial markets. Past AI techniques fall apart in these settings, with poker serving as the classic benchmark and challenge problem. In this talk I will cover the key breakthroughs behind Libratus and Pluribus, the first AI agents to defeat elite human professionals in two-player no-limit poker and multiplayer no-limit poker, respectively. In particular, I will discuss new equilibrium-finding algorithms and depth-limited search techniques for imperfect-information games that are orders of magnitude faster than prior approaches. Finally, I will conclude with recent work generalizing these results to other imperfect-information multi-agent settings beyond poker. *Bio*: Noam Brown is a Research Scientist at Facebook AI Research working on multi-agent artificial intelligence and computational game theory, with a particular focus on sequential imperfect-information games. He co-created Libratus and Pluribus, the first AIs to defeat top humans in two-player no-limit poker and multiplayer no-limit poker, respectively. He has received the Marvin Minsky Medal for Outstanding Achievements in AI, was named one of MIT Tech Review's 35 Innovators Under 35, and his work on Pluribus was named by Science Magazine to be one of the top 10 scientific breakthroughs of 2019. Noam received his PhD from Carnegie Mellon University, for which he received the IFAAMAS Victor Lesser Distinguished Dissertation Award and the CMU School of Computer Science Distinguished Dissertation Award. *Please watch this space for future AI Seminars :* * https://eecs.oregonstate.edu/ai-events <https://eecs.oregonstate.edu/ai-events>* Rajesh Mangannavar, Graduate Student Oregon State University ---- AI Seminar Important Reminders: -> The AI Seminar has a strict "no electronics" and "no recordings" policy. -> For graduate students in the AI program, attendance is strongly encouraged.

1 0

Mentors for Local HS Robotics Team
by Fern, Alan Paul 30 Nov '21

30 Nov '21

Hi Everyone, I recently talked with the coach of the robotics team at our local Crescent Valley High School. This team takes part in the FIRST Robotics Competition and will be in competition development/preparation mode starting in early January. The coach thought that the team could really benefit by having some grad student mentors in robotics and AI. Due to COVID the mentoring this year would need to be virtual, but it would still be very much appreciated. If you are interested in this, please contact me and we can figure things out from there. Given the OSU strength in robotics and AI it would be great if we could help our local high schools be world class in these competitions. Thanks, -Alan

1 0

[CoRIS-List] New Course (W'22): AI539 St / Safe and Reliable Autonomy
by Fern, Alan Paul 28 Nov '21

28 Nov '21

Hi Everyone, I wanted to make sure that everyone was aware that one of our newest AI faculty, Professor Sandhya Saisubramanian will be offering a new course this Winter 2022. It was added to the catalog late, so you may have missed it when considering courses. The course is AI 539 ST/Safe and Reliable Autonomy which is a very important topic these days. See below for more details. Regards, -Alan -------------- AI 539 ST/Safe and Reliable Autonomy Course description: This course will highlight the challenges and recent trends in intelligent decision-making to improve the safety and reliability of autonomous systems, and identify important open research questions. This is a seminar-style course in which each student will summarize the papers in the reading list, lead the discussions on analyzing the strengths and weaknesses of each paper, and apply the learned concepts in a final project. The reading list will contain a mix of papers that cover both theory and applications of safe and reliable autonomy, published at leading AI/ robotics conferences and journals. Application areas include robotics, autonomous cars, and healthcare, among others. The topics covered will broadly include techniques for safe sim-to-real transfer; using human assistance to improve system reliability, including human feedback and imitation learning; explainability to improve reliability; and safe exploration. More details about the course are available at https://www.sandhyasai.com/ai-539-st-safe-and-reliable-autonomy<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.sandh…>.

1 0