- Ai - Engineering Mailing Lists

AI-related seminar - Business Analytics - May 3rd, Austin Hall 270 12:30-1:50pm
by Fern, Xiaoli 16 Apr '24

16 Apr '24

See below for a Business analytics seminar that might be of interest to AI folks. -Xiaoli An Alternative Approach to Transparent Decision-Making with Deep Machine Learning Algorithms in Mental Health Autism spectrum disorder (ASD) is a developmental disorder that affects 1 in 36 children in the US (1). The economic cost is estimated to be $66 billion per year in the US, from medical care and lost parental productivity (2). Early diagnosis is crucial since it allows for early treatment and the best long-term outcome. However, identifying children at an early age is challenging due to the limited ale mental health expertise, long wait lists, and misdiagnosis. Automated diagnosing and early referrals through machine learning (ML) can be of significant help. However, there are significant challenges to be overcome. Even with this growing patient population, this is a low-resource domain. The datasets are small, expensive, and difficult to create. The data itself is extremely diverse and training ML models for high performance is difficult. Transparency of models and support tools is highly valued. Finally, transfer learning is essential when applying models to data from different clinicians, clinics, hospitals, and populations. We are creating deep ML algorithms that rely on free text data in electronic health records (EHR) to support non-expert clinicians in identifying children at high risk for ASD. I will show early and recent results of our algorithms (using LSTM, GRU, and BERT models), highlight obstacles and how we are attempting to overcome them: synthetic and parental data to increase data size, transfer learning between datasets, relying on redundancy to increase performance, and avoiding binary black box labeling to provide transparency. [A person in a black suit Description automatically generated] Gondy Leroy, Ph.D., is Professor of MIS, Associate Dean for Research at the University of Arizona's Eller College of Management, and Research Director for the Center for Management Innovations in Healthcare. Her research focuses on natural language processing (NLP) and machine learning (ML) as they are part of artificial intelligence (AI). She has won grants from NIH (NLM, NIMH), AHRQ, NSF, Microsoft Research, and several foundations. She earned a combined BS and MS (1996) in cognitive, and experimental psychology from the Catholic University of Leuven (1996) in Belgium and a MS (1999) and PhD (2003) in management information systems from the University of Arizona. She serves on the editorial board of the Journal of Healthcare Informatics Research, Journal of Database Management, International Journal of Social and Organizational Dynamics in IT, Health Systems, Journal of Business Analytics, and co-chairs several special issues, sessions, tracks, workshops, and conferences focusing on design science and healthcare IT. She serves frequently on NIH grant review panels. She is the author of the book "Designing User Studies in Informatics (Springer, 2011). Finally, she actively contributes to increasing diversity and inclusion in computing through mentoring students early in their academic careers starting in high school and through graduate school.

1 0

AI Seminar : Apr 19
by Mangannavar, Rajesh Devaraddi 16 Apr '24

16 Apr '24

Dear all, Our next AI seminar is scheduled to be on April 19th (Friday), 2-3 PM. The post seminar Q&A session will be held in KEC 2057. Please sign up here<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.goog…> by Wednesday evening to attend the Q&A session. Note that seminar location is BEXL 320. Location: BEXL 320 Zoom link: https://oregonstate.zoom.us/j/91611213801?pwd=Wm9JSkN1eW84RUpiS2JEd0E5TEVkd…<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Foregonsta…> Equivariance in Learning for Perception Kostas Daniilidis Ruth Yalom Stone Professor of Computer and Information Science University of Pennsylvania Abstract: Equivariant representations are crucial in various scientific and engineering domains because they encode the inherent symmetries present in physical and biological systems, thereby providing a more natural and efficient way to model them. In the context of machine learning and perception, equivariant representations ensure that the output of a model changes in a predictable way in response to transformations of its input, such as 2D or 3D rotation or scaling. In this talk, we will show a systematic way of how to achieve equivariance by design and how such an approach can yield efficiency in training data and model capacity. We will present examples on spherical networks, equivariant representation for point clouds, and a novel definition of convolution and attention on lightfields. Speaker Bio: Kostas Daniilidis is the Ruth Yalom Stone Professor of Computer and Information Science at the University of Pennsylvania where he has been faculty since 1998. He is an IEEE Fellow. He was the director of the GRASP laboratory from 2008 to 2013, Associate Dean for Graduate Education from 2012-2016, and Faculty Director of Online Learning from 2013- 2017. He obtained his undergraduate degree in Electrical Engineering from the National Technical University of Athens, 1986, and his PhD in Computer Science from the University of Karlsruhe, 1992, under the supervision of Hans-Hellmut Nagel. He received the Best Conference Paper Award at ICRA 2017. He co-chaired ECCV 2010 and 3DPVT 2006. His most cited works have been on event-based vision, equivariant learning, 3D human pose, and hand-eye calibration. Please watch this space for future AI Seminars : https://engineering.oregonstate.edu/EECS/research/AI<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineeri…> Rajesh Mangannavar, Graduate Student Oregon State University ---- AI Seminar Important Reminders: -> For graduate students in the AI program, attendance is strongly encouraged

1 0

AI Seminar: Kostas Daniilidis
by Tadepalli, Prasad 12 Apr '24

12 Apr '24

Hi all, There is no AI Seminar today. Please attend the Global Futures Forum<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fleadershi…> on AI by live stream if you can. Next week, April 19, we will have AI seminar<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineeri…> by Kostas Daniilidis. If you would like to meet with him in a small group after the seminar, please sign up here<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.goog…>. Thanks, Prasad

1 0

IEEE SPS Distinguished Lecture (1-2PM April 11, Gesualdo Scutari at Purdue)
by Fu, Xiao 05 Apr '24

05 Apr '24

Hello all, I hope to remind you about this event. Note that the location is updated to Johnson 102. More details are here: https://research.engr.oregonstate.edu/soda/upcoming-events<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fresearch.…> Cheers, Xiao Time: 1pm-2pm, April 11 Venue: Johnson 102 Title: Statistical Inference over Networks: Decentralized Optimization Meets High-dimensional Statistics Abstract: Abstract: There is growing interest in solving large-scale statistical learning problems over decentralized networks, where data are distributed across the nodes of the network and no centralized coordination is present (we termed these systems as “mesh” networks). Inference from massive datasets poses a fundamental challenge at the nexus of the computational and statistical sciences: ensuring the quality of statistical inference when computational resources, like time and communication, are constrained. While statistical-computation tradeoffs have been largely explored in the centralized setting, our understanding over mesh networks is limited: (i) distributed schemes, designed and performing well in the classical low-dimensional regime, can break down in the high-dimensional case; and (ii) existing convergence studies may fail to predict algorithmic behaviors, with some findings directly contradicted by empirical tests. This is mainly due to the fact that the majority of distributed algorithms have been designed and studied only from the optimization perspective, lacking the statistical dimension. This talk will discuss some vignettes from high-dimensional statistical inference suggesting new analyses (and designs) aiming at bringing statistical thinking in distributed optimization. Speaker: Bio: Gesualdo Scutari is a Professor with the School of Industrial Engineering and Electrical and Computer Engineering (by courtesy) at Purdue University, West Lafayette, IN, USA, and he is a Purdue Faculty Scholar. His research interests include continuous (distributed) optimization, equilibrium programming, and their applications to signal processing and statistical learning. Among others, he was a recipient of the 2013 NSF CAREER Award, the 2015 IEEE Signal Processing Society Young Author Best Paper Award, and the 2020 IEEE Signal Processing Society Best Paper Award. He serves as an IEEE Signal Processing Distinguish Lecturer (2023-2024). He served on the editorial broad of several IEEE journals and he is currently an Associate Editor of SIAM Journal on Optimization. He is a fellow of IEEE. ======================= Xiao Fu, Ph.D. Associate Professor School of Electrical Engineering and Computer Science Oregon State University Corvallis OR 97331 3003 Kelley Engineering Center Homepage: https://web.engr.oregonstate.edu/~fuxia/

2 1

AI Seminar: Jean Tarbouriech, April 5.
by Tadepalli, Prasad 03 Apr '24

03 Apr '24

Hi everyone, Please note that the AI Seminar will be in BEXL 320, 2-3 PM from this Friday onwards. The web page has Owen 102, but we are going to change it. This week's speaker is Jean Tarbouriech of Google Mind in London. He will be speaking remotely on "Probabilistic Inference in Reinforcement Learning Done Right." Please refer to the AI Seminar page<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineeri…> for more details including a zoom link if you cannot attend in person. For this term I have decided to move the post-seminar Q&A to a different room (KEC 2057) to guarantee the room for us and also make the discussion more focused. Everybody is welcome. I have the schedule of speakers for this term here<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.goog…>. Please sign up at least two days in advance (by tonight for this week's meeting) to attend this session. Look forward to seeing you on Friday. Prasad

2 2

Special AI Seminar: April 1, 2-3, Owen 102
by Tadepalli, Prasad 31 Mar '24

31 Mar '24

Hi all, We will have a special AI Seminar<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineeri…> on Monday, April 1 at 2 pm on LLMs in Owen 102 by Bonnie Dorr. Please attend if you can. It will be counted towards AI507 credit. The Friday seminars will continue 2-3 starting April 5. Please register if you would like to get credits. Thank you, Prasad Tadepalli

1 1

Distinguished Lecture by Gesualdo Scutari (Purdue) 1pm, April 11
by Fu, Xiao 20 Mar '24

20 Mar '24

Dear all, Please mark your calendar for the distinguished lecture in the second week of the Spring Term! Cheers, Xiao Time: 1pm-2pm, April 11 Venue: KEC 1001 Title: Statistical Inference over Networks: Decentralized Optimization Meets High-dimensional Statistics Abstract: Abstract: There is growing interest in solving large-scale statistical learning problems over decentralized networks, where data are distributed across the nodes of the network and no centralized coordination is present (we termed these systems as “mesh” networks). Inference from massive datasets poses a fundamental challenge at the nexus of the computational and statistical sciences: ensuring the quality of statistical inference when computational resources, like time and communication, are constrained. While statistical-computation tradeoffs have been largely explored in the centralized setting, our understanding over mesh networks is limited: (i) distributed schemes, designed and performing well in the classical low-dimensional regime, can break down in the high-dimensional case; and (ii) existing convergence studies may fail to predict algorithmic behaviors, with some findings directly contradicted by empirical tests. This is mainly due to the fact that the majority of distributed algorithms have been designed and studied only from the optimization perspective, lacking the statistical dimension. This talk will discuss some vignettes from high-dimensional statistical inference suggesting new analyses (and designs) aiming at bringing statistical thinking in distributed optimization. Speaker: Bio: Gesualdo Scutari is a Professor with the School of Industrial Engineering and Electrical and Computer Engineering (by courtesy) at Purdue University, West Lafayette, IN, USA, and he is a Purdue Faculty Scholar. His research interests include continuous (distributed) optimization, equilibrium programming, and their applications to signal processing and statistical learning. Among others, he was a recipient of the 2013 NSF CAREER Award, the 2015 IEEE Signal Processing Society Young Author Best Paper Award, and the 2020 IEEE Signal Processing Society Best Paper Award. He serves as an IEEE Signal Processing Distinguish Lecturer (2023-2024). He served on the editorial broad of several IEEE journals and he is currently an Associate Editor of SIAM Journal on Optimization. He is a fellow of IEEE.

1 0

AI Seminar : Mar 15
by Mangannavar, Rajesh Devaraddi 13 Mar '24

13 Mar '24

Dear all, Our next AI seminar is scheduled to be on March 15th , 2-3 PM. It will be followed by a 30-minute Q&A session with the graduate students. Location: KEC 1001 Zoom link: https://oregonstate.zoom.us/j/96491555190?pwd=azJHSXZ0TFQwTFFJdkZCWFhnTW04U…<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Foregonsta…> Hybrid RL: Using Offline Data for Efficient Online Reinforcement Learning Wen Sun Assistant Professor Computer Science Department Cornell University Abstract: Reinforcement Learning is a framework for learning to make sequential decisions from feedback. While most of today’s powerful AI systems (e.g., AlphaGo and ChatGPT) are trained via RL, RL is still considered to be inefficient in learning, i.e., it learns very slowly. In this talk, we consider hybrid RL, a new framework that integrates offline data into online RL with the goal of vastly improving the learning efficiency of RL. In the first part of the talk, we will present a simple approach to integrating offline data into a Q-learning-style framework. This simple approach achieves strong theoretical guarantees showing that with offline data, RL can be as easy as supervised learning. Empirically, when equipped with average-quality offline data, this approach can learn 10x faster than pure online RL baselines in a notorious hard video game that requires deep strategic exploration. In the second part of the talk, we show another way of integrating offline data into online RL via reset, a condition that allows a learning system to reset to any state it visited before and holds in important RL applications such as training language models. We propose an algorithm framework called dataset reset policy optimization (DrPO), which simply resets the RL agent to states in the offline data when collecting online data. We show that when integrating DrPO into an RL from Human Feedback (RLHF) framework where the reward model is learned from offline human preference data, it guarantees to discover the best policy covered by the offline human preference data. Empirically, when fine-tuning a 3 billion size language model on a standard RLHF benchmark — the Reddit TL;DR summarization task, DrPO learns to generate summaries that are better than that from humans, and a pure online RL baseline Proximal Policy Optimization (PPO) and a pure offline RL baseline Direct Preference Optimization (DPO), when evaluated by GPT4. Speaker Bio: Wen Sun is an Assistant Professor in the Computer Science Department at Cornell. Before that, he was a postdoctoral researcher at Microsoft Research NYC and he completed his Ph.D in 2019 from the Robotics Institute at Carnegie Mellon University. He is generally interested in machine learning, especially Reinforcement Learning. Much of his current research is about designing algorithms for efficient sequential decision-making and how to leverage human interaction for better and more efficient Reinforcement Learning. Please watch this space for future AI Seminars : https://engineering.oregonstate.edu/EECS/research/AI<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineeri…> Rajesh Mangannavar, Graduate Student Oregon State University ---- AI Seminar Important Reminders: -> For graduate students in the AI program, attendance is strongly encouraged

1 0

AI Seminar : Mar 08
by Mangannavar, Rajesh Devaraddi 06 Mar '24

06 Mar '24

Dear all, Our next AI seminar is scheduled to be on March 8th , 2-3 PM. It will be followed by a 30-minute Q&A session with the graduate students. Location: KEC 1001 Zoom link: https://oregonstate.zoom.us/j/96491555190?pwd=azJHSXZ0TFQwTFFJdkZCWFhnTW04U…<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Foregonsta…> >From Large to Small Datasets: Size Generalization for Clustering Algorithm Selection Ellen Vitercik Assistant Professor Management Science & Engineering & Computer Science Stanford University Abstract: In clustering algorithm selection, we are given a massive dataset and must efficiently select which clustering algorithm to use. We study this problem in a semi-supervised setting, with an unknown ground-truth clustering that we can only access through expensive oracle queries. Ideally, the clustering algorithm's output will be structurally close to the ground truth. We approach this problem by introducing a notion of size generalization for clustering algorithm accuracy. We identify conditions under which we can (1) subsample the massive clustering instance, (2) evaluate a set of candidate algorithms on the smaller instance, and (3) guarantee that the algorithm with the best accuracy on the small instance will have the best accuracy on the original big instance. We verify these findings both theoretically and empirically. Speaker Bio: Ellen Vitercik is an Assistant Professor at Stanford University with a joint appointment between the Management Science & Engineering department and the Computer Science department. Her research revolves around machine learning theory, discrete optimization, and the interface between economics and computation. Before joining Stanford, she spent a year as a Miller Fellow at UC Berkeley after receiving a PhD in Computer Science from Carnegie Mellon University. Her thesis won the SIGecom Doctoral Dissertation Award and the CMU School of Computer Science Distinguished Dissertation Award. Please watch this space for future AI Seminars : https://engineering.oregonstate.edu/EECS/research/AI<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fengineeri…> Rajesh Mangannavar, Graduate Student Oregon State University ---- AI Seminar Important Reminders: -> For graduate students in the AI program, attendance is strongly encouraged

1 0

AI Seminar: March 1
by Tadepalli, Prasad 01 Mar '24

01 Mar '24

Dear all, Tomorrow's AI seminar will be by Yoon Kim, who will be talking about large language models. This seminar will be remote, but please attend in person if possible. Prasad Location: KEC 1001 Zoom link: https://oregonstate.zoom.us/j/96491555190?pwd=azJHSXZ0TFQwTFFJdkZCWFhnTW04U…<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Foregonsta…> Large Language Models and Symbolic Structures Yoon Kim EECS, Massachusetts Institute of Technology Abstract: Over the past decade the field of NLP has shifted from a pipelined approach (wherein intermediate symbolic structures such as parse trees are explicitly predicted and utilized for downstream tasks) to an end-to-end approach wherein pretrained large language models (LLMs) are adapted to various downstream tasks via finetuning or prompting. What role (if any) can symbolic structures play in the era of LLMs? In the first part of the talk, we will see how latent symbolic structures in the form of hierarchical alignments can be used to guide LM-based neural machine translation systems to improve translation of low resource languages and even enable the use of new translation rules during inference. In the second part, we will see how expert-derived grammars can be used to control LLMs via prompting for tasks such as semantic parsing where the output structure must obey strict domain-specific constraints. Speaker Biography: Yoon Kim is an assistant professor at MIT EECS. He received his PhD from Harvard University, advised by Alexander Rush.

3 3