Dear all,
We are going to have 2 AI seminars in the coming week.
The first talk will be on *"Rigorous Experimentation For Reinforcement
Learning" *by Scott Jordan and is scheduled to be on October 10th (Today),
1-2 PM PST. It will be followed by a 30-minute Q&A session with the
graduate students.
This is an *in-person* event and will be held at *KEAR 305*
*Rigorous Experimentation For Reinforcement Learning*
Scott Jordan
Postdoc
University of Alberta
*Abstract:*
Scientific fields make advancements by leveraging the knowledge created by
others to push the boundary of understanding. The primary tool in many
fields for generating knowledge is empirical experimentation. Although
common, generating accurate knowledge from empirical experiments is often
challenging due to inherent randomness in execution and confounding
variables that can obscure the correct interpretation of the results. As
such, researchers must hold themselves and others to a high degree of rigor
when designing experiments. Unfortunately, most reinforcement learning (RL)
experiments lack this rigor, making the knowledge generated from
experiments dubious. This dissertation proposes methods to address central
issues in RL experimentation.
Evaluating the performance of an RL algorithm is the most common type of
experiment in RL literature. Most performance evaluations are often
incapable of answering a specific research question and produce misleading
results. Thus, the first issue we address is how to create a performance
evaluation procedure that holds up to scientific standards.
Despite the prevalence of performance evaluation, these types of
experiments produce limited knowledge, e.g., they can only show how well an
algorithm worked and not why, and they require significant amounts of time
and computational resources. As an alternative, this dissertation proposes
that scientific testing, the process of conducting carefully controlled
experiments designed to further the knowledge and understanding of how an
algorithm works, should be the primary form of experimentation.
Lastly, this dissertation provides a case study using policy gradient
methods, showing how scientific testing can replace performance evaluation
as the primary form of experimentation. As a result, this dissertation can
motivate others in the field to adopt more rigorous experimental practices.
*Speaker Bio:*
Scott Jordan got his Batchelor's degree from Oregon State in 2015 while
working with Tom Dietterich. He recently got his Ph.D. from the University
of Massachusetts and is now a Postdoc at the University of Alberta working
with Martha White. His research focuses on reinforcement learning with the
goal of understanding the properties necessary for scalable and effective
sequential decision-making, with works published in ICML, NeurIPS, and
other ML venues. His dissertation addresses issues with poor
experimentation practices common in reinforcement learning research.
This will be followed by a talk on Friday, October 14th, 2022.
The second talk will be on *"Causal Inference and Data Fusion" *by Elias
Bareinboim and is scheduled to be on October 14th (Friday), 1-2 PM PST. It
will be followed by a 30-minute Q&A session by the graduate students.
This is an *in-person* event and will be held at *KEC 1001*
*Causal Inference and Data Fusion*
Elias Bareinboim
Associate Professor, Department of Computer Science
Director, Causal Artificial Intelligence Laboratory
Columbia University
*Abstract:*
Causal inference is usually dichotomized into two categories, experimental
(Fisher, Cox, Cochran) and observational (Neyman, Rubin, Robins, Dawid,
Pearl) which, by and large, are studied separately. Understanding reality
is more demanding. Experimental and observational studies are but two
extremes of a rich spectrum of research designs that generate the bulk of
the data available in practical, large-scale situations. In typical medical
explorations, for example, data from multiple observations and experiments
are collected, coming from distinct experimental setups, different sampling
conditions, and heterogeneous populations.
In this talk, I will introduce the data-fusion problem, which is concerned
with piecing together multiple datasets collected under heterogeneous
conditions (to be defined) so as to obtain valid answers to queries of
interest. The availability of multiple heterogeneous datasets presents new
opportunities to causal analysts since the knowledge that can be acquired
from combined data would not be possible from any individual source alone.
However, the biases that emerge in heterogeneous environments require new
analytical tools. Some of these biases, including confounding, sampling
selection, and cross-population biases, have been addressed in isolation,
largely in restricted parametric models. I will present my work on a
general, non-parametric framework for handling these biases and,
ultimately, a theoretical solution to the problem of fusion in causal
inference tasks.
Suggested readings:
1. E. Bareinboim and J. Pearl. Causal inference and the Data-Fusion Problem.
<http://https//www.pnas.org/content/113/27/7345> Proceedings of the
National Academy of Sciences, 113(27): 7345-7352, 2016.
2. E. Bareinboim, J. Correa, D. Ibeling, T. Icard. On Pearl’s Hierarchy and
the Foundations of Causal Inference <https://causalai.net/r60.pdf>. In
“Probabilistic and Causal Inference: The Works of Judea Pearl”, In
Probabilistic and Causal Inference: The Works of Judea Pearl (ACM, Special
Turing Series), pp. 507-556, 2022.
3. K. Xia, K. Lee, Y. Bengio, E. Bareinboim. The Causal-Neural Connection:
Expressiveness, Learnability, and Inference <https://causalai.net/r80.pdf>.
In Proceedings of the 35th Annual Conference on Neural Information
Processing Systems (NeurIPS), 2021.
*Speaker Bio:*
Elias Bareinboim is an associate professor in the Department of Computer
Science and the director of the Causal Artificial Intelligence (CausalAI)
Laboratory at Columbia University. His research focuses on causal and
counterfactual inference and their applications to data-driven fields in
the health and social sciences as well as artificial intelligence and
machine learning. His work was the first to propose a general solution to
the problem of ``data-fusion,'' providing practical methods for combining
datasets generated under different experimental conditions and plagued with
various biases. More recently, Bareinboim has been exploring the
intersection of causal inference with decision-making (including
reinforcement learning) and explainability (including fairness analysis).
Bareinboim received his Ph.D. from the University of California, Los
Angeles, where he was advised by Judea Pearl. Bareinboim was named one of
``AI's 10 to Watch'' by IEEE, and is a recipient of the NSF CAREER Award,
the ONR Young Investigator Award, the Dan David Prize Scholarship, the 2014
AAAI Outstanding Paper Award, and the 2019 UAI Best Paper Award.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
We are going to have 2 AI seminars in the coming week.
The first one will be on *"**AI and O.R. for Environmental Sustainability*
*" *by Bistra Dilkina and is scheduled to be on October 7th (Tomorrow), 1-2
PM PST. It will be followed by a 30-minute Q&A session with the graduate
students.
This is an *in-person* event and will be held at *KEC 1001 (The previous
mail said this would be at a different location. Please disregard that).*
*AI and O.R. for Environmental Sustainability*
Bistra Dilkina
Associate Professor of Computer Science
Co-Director, USC Center of AI in Society
University of Southern California
*Abstract:*
With the increasing anthropogenic pressures of urbanization, agriculture,
deforestation, other socio-economic drivers as well as climate change,
biodiversity and habitat conservation is a key sustainable development
goal. Techniques from AI and O.R. and their hybridization have an important
role to play in providing both predictive and prescriptive tools to inform
critical decision-making, which can help us do more with less in this
important application domain. A prime example of the field of Computational
Sustainability, this presentation will give several successful examples of
the two-way street of research providing useful domain solutions to
real-world problems, while advancing core methodology in AI and O.R. Key
examples include using deep learning and satellite data for land cover
mapping, predicting species distributions under climate change and
optimizing spatial conservation planning, as well as developing data-driven
techniques to curb illicit wildlife poaching and trafficking.
*Speaker Bio:*
Dr. Bistra Dilkina is an associate professor of computer science at the
University of Southern California, co-director of the USC Center of AI in
Society, and the inaugural Dr. Allen and Charlotte Ginsburg Early Career
Chair at the USC Viterbi School of Engineering. Her research and teaching
center around the integration of machine learning and discrete
optimization, with a strong focus on AI applications in computational
sustainability and social good. She received her Ph.D. from Cornell
University in 2012 and was a post-doctoral associate at the Institute for
Computational Sustainability. Her research has contributed significant
advances to machine-learning-guided combinatorial solving including
mathematical programming and planning, as well as decision-focused learning
where combinatorial reasoning is integrated in machine learning pipelines.
Her applied research in Computational Sustainability spans using AI for
wildlife conservation planning, using AI to understand the impacts of
climate change in terms of energy, water, habitat and human migration, and
using AI to optimize fortification of lifeline infrastructures for disaster
resilience. She has over 90 publications and has co-organized or served as
a chair to numerous workshops, tutorials, and special tracks at major
conferences.
This will be followed by a talk on Monday, October 10th, 2022.
The second talk will be on *"Rigorous Experimentation For Reinforcement
Learning" *by Scott Jordan and is scheduled to be on October 10th, 1-2 PM
PST. It will be followed by a 30-minute Q&A session with the graduate
students.
This is an *in-person* event and will be held at *KEAR 305*
*Rigorous Experimentation For Reinforcement Learning*
Scott Jordan
Postdoc
University of Alberta
*Abstract:*
Scientific fields make advancements by leveraging the knowledge created by
others to push the boundary of understanding. The primary tool in many
fields for generating knowledge is empirical experimentation. Although
common, generating accurate knowledge from empirical experiments is often
challenging due to inherent randomness in execution and confounding
variables that can obscure the correct interpretation of the results. As
such, researchers must hold themselves and others to a high degree of rigor
when designing experiments. Unfortunately, most reinforcement learning (RL)
experiments lack this rigor, making the knowledge generated from
experiments dubious. This dissertation proposes methods to address central
issues in RL experimentation.
Evaluating the performance of an RL algorithm is the most common type of
experiment in RL literature. Most performance evaluations are often
incapable of answering a specific research question and produce misleading
results. Thus, the first issue we address is how to create a performance
evaluation procedure that holds up to scientific standards.
Despite the prevalence of performance evaluation, these types of
experiments produce limited knowledge, e.g., they can only show how well an
algorithm worked and not why, and they require significant amounts of time
and computational resources. As an alternative, this dissertation proposes
that scientific testing, the process of conducting carefully controlled
experiments designed to further the knowledge and understanding of how an
algorithm works, should be the primary form of experimentation.
Lastly, this dissertation provides a case study using policy gradient
methods, showing how scientific testing can replace performance evaluation
as the primary form of experimentation. As a result, this dissertation can
motivate others in the field to adopt more rigorous experimental practices.
*Speaker Bio:*
Scott Jordan got his Batchelor's degree from Oregon State in 2015 while
working with Tom Dietterich. He recently got his Ph.D. from the University
of Massachusetts and is now a Postdoc at the University of Alberta working
with Martha White. His research focuses on reinforcement learning with the
goal of understanding the properties necessary for scalable and effective
sequential decision-making, with works published in ICML, NeurIPS, and
other ML venues. His dissertation addresses issues with poor
experimentation practices common in reinforcement learning research.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
We are going to have 2 AI seminars in the coming week.
The first one will be on *"**AI and O.R. for Environmental Sustainability*
*" *by Bistra Dilkina is scheduled to be on October 7th (Tomorrow), 1-2 PM
PST. It will be followed by a 30-minute Q&A session with the graduate
students.
This is an *in-person* event and will be held at *KEAR 1001*
*AI and O.R. for Environmental Sustainability*
Bistra Dilkina
Associate Professor of Computer Science
Co-Director, USC Center of AI in Society
University of Southern California
*Abstract:*
With the increasing anthropogenic pressures of urbanization, agriculture,
deforestation, other socio-economic drivers as well as climate change,
biodiversity and habitat conservation is a key sustainable development
goal. Techniques from AI and O.R. and their hybridization have an important
role to play in providing both predictive and prescriptive tools to inform
critical decision-making, which can help us do more with less in this
important application domain. A prime example of the field of Computational
Sustainability, this presentation will give several successful examples of
the two-way street of research providing useful domain solutions to
real-world problems, while advancing core methodology in AI and O.R. Key
examples include using deep learning and satellite data for land cover
mapping, predicting species distributions under climate change and
optimizing spatial conservation planning, as well as developing data-driven
techniques to curb illicit wildlife poaching and trafficking.
*Speaker Bio:*
Dr. Bistra Dilkina is an associate professor of computer science at the
University of Southern California, co-director of the USC Center of AI in
Society, and the inaugural Dr. Allen and Charlotte Ginsburg Early Career
Chair at the USC Viterbi School of Engineering. Her research and teaching
center around the integration of machine learning and discrete
optimization, with a strong focus on AI applications in computational
sustainability and social good. She received her Ph.D. from Cornell
University in 2012 and was a post-doctoral associate at the Institute for
Computational Sustainability. Her research has contributed significant
advances to machine-learning-guided combinatorial solving including
mathematical programming and planning, as well as decision-focused learning
where combinatorial reasoning is integrated in machine learning pipelines.
Her applied research in Computational Sustainability spans using AI for
wildlife conservation planning, using AI to understand the impacts of
climate change in terms of energy, water, habitat and human migration, and
using AI to optimize fortification of lifeline infrastructures for disaster
resilience. She has over 90 publications and has co-organized or served as
a chair to numerous workshops, tutorials, and special tracks at major
conferences.
This will be followed by a talk on Monday, October 10th, 2022.
The second talk will be on *"Rigorous Experimentation For Reinforcement
Learning" *by Scott Jordan is scheduled to be on October 10th, 1-2 PM PST. It
will be followed by a 30-minute Q&A session with the graduate students.
This is an *in-person* event and will be held at *KEC 305*
*Rigorous Experimentation For Reinforcement Learning*
Scott Jordan
Postdoc
University of Alberta
*Abstract:*
Scientific fields make advancements by leveraging the knowledge created by
others to push the boundary of understanding. The primary tool in many
fields for generating knowledge is empirical experimentation. Although
common, generating accurate knowledge from empirical experiments is often
challenging due to inherent randomness in execution and confounding
variables that can obscure the correct interpretation of the results. As
such, researchers must hold themselves and others to a high degree of rigor
when designing experiments. Unfortunately, most reinforcement learning (RL)
experiments lack this rigor, making the knowledge generated from
experiments dubious. This dissertation proposes methods to address central
issues in RL experimentation.
Evaluating the performance of an RL algorithm is the most common type of
experiment in RL literature. Most performance evaluations are often
incapable of answering a specific research question and produce misleading
results. Thus, the first issue we address is how to create a performance
evaluation procedure that holds up to scientific standards.
Despite the prevalence of performance evaluation, these types of
experiments produce limited knowledge, e.g., they can only show how well an
algorithm worked and not why, and they require significant amounts of time
and computational resources. As an alternative, this dissertation proposes
that scientific testing, the process of conducting carefully controlled
experiments designed to further the knowledge and understanding of how an
algorithm works, should be the primary form of experimentation.
Lastly, this dissertation provides a case study using policy gradient
methods, showing how scientific testing can replace performance evaluation
as the primary form of experimentation. As a result, this dissertation can
motivate others in the field to adopt more rigorous experimental practices.
*Speaker Bio:*
Scott Jordan got his Batchelor's degree from Oregon State in 2015 while
working with Tom Dietterich. He recently got his Ph.D. from the University
of Massachusetts and is now a Postdoc at the University of Alberta working
with Martha White. His research focuses on reinforcement learning with the
goal of understanding the properties necessary for scalable and effective
sequential decision-making, with works published in ICML, NeurIPS, and
other ML venues. His dissertation addresses issues with poor
experimentation practices common in reinforcement learning research.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
Our next AI seminar on *"**AI and O.R. for Environmental Sustainability**" *by
Bistra Dilkina is scheduled to be on October 7th (Friday), 1-2 PM PST. It
will be followed by a 30-minute Q&A session by the graduate students.
This is an *in-person* event and will be held at *KEC 1001*
*AI and O.R. for Environmental Sustainability*
Bistra Dilkina
Associate Professor of Computer Science
Co-Director, USC Center of AI in Society
University of Southern California
*Abstract:*
With the increasing anthropogenic pressures of urbanization, agriculture,
deforestation, other socio-economic drivers as well as climate change,
biodiversity and habitat conservation is a key sustainable development
goal. Techniques from AI and O.R. and their hybridization have an important
role to play in providing both predictive and prescriptive tools to inform
critical decision-making, which can help us do more with less in this
important application domain. A prime example of the field of Computational
Sustainability, this presentation will give several successful examples of
the two-way street of research providing useful domain solutions to
real-world problems, while advancing core methodology in AI and O.R. Key
examples include using deep learning and satellite data for land cover
mapping, predicting species distributions under climate change and
optimizing spatial conservation planning, as well as developing data-driven
techniques to curb illicit wildlife poaching and trafficking.
*Speaker Bio:*
Dr. Bistra Dilkina is an associate professor of computer science at the
University of Southern California, co-director of the USC Center of AI in
Society, and the inaugural Dr. Allen and Charlotte Ginsburg Early Career
Chair at the USC Viterbi School of Engineering. Her research and teaching
center around the integration of machine learning and discrete
optimization, with a strong focus on AI applications in computational
sustainability and social good. She received her Ph.D. from Cornell
University in 2012 and was a post-doctoral associate at the Institute for
Computational Sustainability. Her research has contributed significant
advances to machine-learning-guided combinatorial solving including
mathematical programming and planning, as well as decision-focused learning
where combinatorial reasoning is integrated in machine learning pipelines.
Her applied research in Computational Sustainability spans using AI for
wildlife conservation planning, using AI to understand the impacts of
climate change in terms of energy, water, habitat and human migration, and
using AI to optimize fortification of lifeline infrastructures for disaster
resilience. She has over 90 publications and has co-organized or served as
a chair to numerous workshops, tutorials, and special tracks at major
conferences.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
Our next AI seminar on *"Understanding Multiview and Self-Supervised
Representation Learning: A Nonlinear Mixture Identification Perspective" *by
Xiao Fu is scheduled to be on September 30th (Tomorrow), 1-2 PM PST. It
will be followed by a 30-minute Q&A session by the graduate students.
This is an *in-person* event and will be held at *KEC 1001*
*Understanding Multiview and Self-Supervised Representation Learning: A
Nonlinear Mixture Identification Perspective*
Xiao Fu
Assistant Professor
School of Electrical Engineering and Computer Science
Oregon State University
*Abstract:*
Central to representation learning is to succinctly represent
high-dimensional data using the “essential information’’ while discarding
the “redundant information”. Properly formulating and approaching this
objective is critical to fending against overfitting, and can also benefit
many important tasks such as domain adaptation and transfer learning. This
talk aims to deepen understanding of representation learning and using the
gained insights to come up with a new learning method. In particular,
attention will be paid to two representation learning paradigms using
multiple views of data, as both naturally acquired (e.g., image and audio)
and artificially produced (e.g., via adding different noise to data
samples) multiview data have empirically proven useful in producing
essential information-reflecting vector representations. Natural views are
often handled by multiview analysis tools, e.g., (deep) canonical
correlation analysis [(D)CCA], while the artificial ones are frequently
used in self-supervised learning (SSL) paradigms, e.g., BYOL and Barlow
Twins. However, the effectiveness of these methods is mostly validated
empirically, and more insights and theoretical underpinnings remain to be
discovered. In this talk, an intuitive generative model of multiview data
is adopted, where the views are different nonlinear mixtures of shared and
private components. Since the shared components are
view/distortion-invariant, such components may serve for representing the
essential information of data in a non-redundant way. Under this model, a
key module used in a suite of DCCA and SSL paradigms, namely, latent
correlation maximization, is shown to guarantee the extraction of the
shared components across views (up to certain ambiguities). It is further
shown that the private information in each view can be provably
disentangled from the shared using proper regularization design---which can
facilitate tasks such cross-view translation and data generation. A finite
sample analysis, which has been rare in nonlinear mixture identifiability
study, is also presented. The theoretical results and newly designed
regularization are tested on a series of tasks.
*Speaker Bio:*
Xiao Fu received the Ph.D. degree in Electronic Engineering from The
Chinese University of Hong Kong (CUHK), Shatin, N.T., Hong Kong, in 2014.
He was a Postdoctoral Associate with the Department of Electrical and
Computer Engineering, University of Minnesota, Minneapolis, MN, USA, from
2014 to 2017. Since 2017, he has been an Assistant Professor with the
School of Electrical Engineering and Computer Science, Oregon State
University, Corvallis, OR, USA. His research interests include the broad
area of signal processing and machine learning.
Dr. Fu received a Best Student Paper Award at ICASSP 2014, and was a
recipient of the Outstanding Postdoctoral Scholar Award at University of
Minnesota in 2016. His coauthored papers received Best Student Paper Awards
from IEEE CAMSAP 2015 and IEEE MLSP 2019, respectively. He received the
National Science Foundation CAREER Award in 2022. He serves as a member of
the Sensor Array and Multichannel Technical Committee (SAM-TC) of the IEEE
Signal Processing Society (SPS). He is also a member of the Signal
Processing for Multisensor Systems Technical Area Committee (SPMuS-TAC) of
EURASIP. He is the Treasurer of the IEEE SPS Oregon Chapter. He serves as
an Editor of Signal Processing and an Associate Editor of IEEE Transactions
on Signal Processing. He was a tutorial speaker at ICASSP 2017 and SIAM
Conference on Applied Linear Algebra 2021.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
Our next AI seminar on *"Understanding Multiview and Self-Supervised
Representation Learning: A Nonlinear Mixture Identification Perspective" *by
Xiao Fu is scheduled to be on September 30th (Friday), 1-2 PM PST. It will
be followed by a 30-minute Q&A session by the graduate students.
This is an *in-person* event and will be held at *KEC 1001*
*Understanding Multiview and Self-Supervised Representation Learning: A
Nonlinear Mixture Identification Perspective*
Xiao Fu
Assistant Professor
School of Electrical Engineering and Computer Science
Oregon State University
*Abstract:*
Central to representation learning is to succinctly represent
high-dimensional data using the “essential information’’ while discarding
the “redundant information”. Properly formulating and approaching this
objective is critical to fending against overfitting, and can also benefit
many important tasks such as domain adaptation and transfer learning. This
talk aims to deepen understanding of representation learning and using the
gained insights to come up with a new learning method. In particular,
attention will be paid to two representation learning paradigms using
multiple views of data, as both naturally acquired (e.g., image and audio)
and artificially produced (e.g., via adding different noise to data
samples) multiview data have empirically proven useful in producing
essential information-reflecting vector representations. Natural views are
often handled by multiview analysis tools, e.g., (deep) canonical
correlation analysis [(D)CCA], while the artificial ones are frequently
used in self-supervised learning (SSL) paradigms, e.g., BYOL and Barlow
Twins. However, the effectiveness of these methods is mostly validated
empirically, and more insights and theoretical underpinnings remain to be
discovered. In this talk, an intuitive generative model of multiview data
is adopted, where the views are different nonlinear mixtures of shared and
private components. Since the shared components are
view/distortion-invariant, such components may serve for representing the
essential information of data in a non-redundant way. Under this model, a
key module used in a suite of DCCA and SSL paradigms, namely, latent
correlation maximization, is shown to guarantee the extraction of the
shared components across views (up to certain ambiguities). It is further
shown that the private information in each view can be provably
disentangled from the shared using proper regularization design---which can
facilitate tasks such cross-view translation and data generation. A finite
sample analysis, which has been rare in nonlinear mixture identifiability
study, is also presented. The theoretical results and newly designed
regularization are tested on a series of tasks.
*Speaker Bio:*
Xiao Fu received the Ph.D. degree in Electronic Engineering from The
Chinese University of Hong Kong (CUHK), Shatin, N.T., Hong Kong, in 2014.
He was a Postdoctoral Associate with the Department of Electrical and
Computer Engineering, University of Minnesota, Minneapolis, MN, USA, from
2014 to 2017. Since 2017, he has been an Assistant Professor with the
School of Electrical Engineering and Computer Science, Oregon State
University, Corvallis, OR, USA. His research interests include the broad
area of signal processing and machine learning.
Dr. Fu received a Best Student Paper Award at ICASSP 2014, and was a
recipient of the Outstanding Postdoctoral Scholar Award at University of
Minnesota in 2016. His coauthored papers received Best Student Paper Awards
from IEEE CAMSAP 2015 and IEEE MLSP 2019, respectively. He received the
National Science Foundation CAREER Award in 2022. He serves as a member of
the Sensor Array and Multichannel Technical Committee (SAM-TC) of the IEEE
Signal Processing Society (SPS). He is also a member of the Signal
Processing for Multisensor Systems Technical Area Committee (SPMuS-TAC) of
EURASIP. He is the Treasurer of the IEEE SPS Oregon Chapter. He serves as
an Editor of Signal Processing and an Associate Editor of IEEE Transactions
on Signal Processing. He was a tutorial speaker at ICASSP 2017 and SIAM
Conference on Applied Linear Algebra 2021.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
Our next AI seminar on *"AI Seminar: Universal Representations for AI" *by
Sridhar Mahadevan is scheduled to be on September 23rd (Tomorrow), 1-2 PM
PST. It will be followed by a 30-minute Q&A session by the graduate
students.
This is an *in-person* event and will be held at *KEC 1001*
*AI Seminar: Universal Representations for AI*
Sridhar Mahadevan
Director, Adobe Research
Research Professor, University of Massachusetts, Amherst
*Abstract:*
Humans are uniquely endowed in biology with a singular cognitive ability to
pass on millennia of accumulated knowledge to our descendants, not solely
through our genetic endowment, but also through the manufacture of abstract
representations: art, culture, language and writing, music, science, and
technology. This ability to transfer non-genetic information has been
greatly amplified with the invention of decentralized information
repositories, such as the traditional web or the emerging cryptographically
more secure blockchain economy. In this talk, I will describe a long-term
research program on analyzing four central capabilities that underlie our
ability to manufacture representations:
Objectification: our ability to denote arbitrary entities as ``objects”,
from elementary particles to our society, the U.S. economy, or an entire
galaxy or a (meta)universe.
Social Interaction: our ability to confer agenthood on both inanimate and
animate objects, treating objects not as passive containers of data, but
actors defined by social interactions.
Metaphors: our ability to use analogies to map unfamiliar situations –
understanding an alien civilization with an unknown language -- to ones we
are familiar with from our experience.
Diagrammatic representations: our ability to draw figures, record a tune as
a formal musical score, or write equations reveal how diagrams are a
universal cognitive calculus for us.
We use the abstract mathematics of category theory to characterize
universal properties that define these four core capabilities. Objects in a
category are modeled as actors, whose properties emerge from their social
interaction with other objects, modeled as morphisms. Functors and natural
transformations play the role of metaphors in human language. Adjunctions
across categories plays the role of analogies. Diagrams are special
functors that map from indexing categories to domain categories and define
universal constructions for reasoning about interactions. We illustrate our
framework by manufacturing novel representations for modeling causality and
conditional independence, creativity and imagination, learning, language,
and decision-making.
*Speaker Bio:*
Sridhar Mahadevan has been thinking about AI every waking day for the past
40 years, since he wrote his first machine learning program in 1982 at the
Indian Institute of Technology, Kanpur. He was elected Fellow of AAAI for
significant contributions in several areas of machine learning. He has
published widely across many subfields of AI, including a book on robot
learning in 1993 (Springer), and a book on representation discovery in 2007
(Morgan-Claypool). He is currently working on his third book on Universal
AI. He is a Director at Adobe Research, and a Research Professor at the
University of Massachusetts, Amherst.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Dear all,
Our next AI seminar on *"AI Seminar: Universal Representations for AI" *by
Sridhar Mahadevan is scheduled to be on September 23rd (Friday), 1-2 PM
PST. It will be followed by a 30-minute Q&A session by the graduate
students.
This is an *in-person* event and will be held at *KEC 1001*
*AI Seminar: Universal Representations for AI*
Sridhar Mahadevan
Director, Adobe Research
Research Professor, University of Massachusetts, Amherst
*Abstract:*
Humans are uniquely endowed in biology with a singular cognitive ability to
pass on millennia of accumulated knowledge to our descendants, not solely
through our genetic endowment, but also through the manufacture of abstract
representations: art, culture, language and writing, music, science, and
technology. This ability to transfer non-genetic information has been
greatly amplified with the invention of decentralized information
repositories, such as the traditional web or the emerging cryptographically
more secure blockchain economy. In this talk, I will describe a long-term
research program on analyzing four central capabilities that underlie our
ability to manufacture representations:
Objectification: our ability to denote arbitrary entities as ``objects”,
from elementary particles to our society, the U.S. economy, or an entire
galaxy or a (meta)universe.
Social Interaction: our ability to confer agenthood on both inanimate and
animate objects, treating objects not as passive containers of data, but
actors defined by social interactions.
Metaphors: our ability to use analogies to map unfamiliar situations –
understanding an alien civilization with an unknown language -- to ones we
are familiar with from our experience.
Diagrammatic representations: our ability to draw figures, record a tune as
a formal musical score, or write equations reveal how diagrams are a
universal cognitive calculus for us.
We use the abstract mathematics of category theory to characterize
universal properties that define these four core capabilities. Objects in a
category are modeled as actors, whose properties emerge from their social
interaction with other objects, modeled as morphisms. Functors and natural
transformations play the role of metaphors in human language. Adjunctions
across categories plays the role of analogies. Diagrams are special
functors that map from indexing categories to domain categories and define
universal constructions for reasoning about interactions. We illustrate our
framework by manufacturing novel representations for modeling causality and
conditional independence, creativity and imagination, learning, language,
and decision-making.
*Speaker Bio:*
Sridhar Mahadevan has been thinking about AI every waking day for the past
40 years, since he wrote his first machine learning program in 1982 at the
Indian Institute of Technology, Kanpur. He was elected Fellow of AAAI for
significant contributions in several areas of machine learning. He has
published widely across many subfields of AI, including a book on robot
learning in 1993 (Springer), and a book on representation discovery in 2007
(Morgan-Claypool). He is currently working on his third book on Universal
AI. He is a Director at Adobe Research, and a Research Professor at the
University of Massachusetts, Amherst.
*Please watch this space for future AI Seminars :*
* https://eecs.oregonstate.edu/ai-events
<https://eecs.oregonstate.edu/ai-events>*
Rajesh Mangannavar,
Graduate Student
Oregon State University
----
AI Seminar Important Reminders:
-> For graduate students in the AI program, attendance is strongly
encouraged.
Hi all, just in case you hope to attend the summer SP seminar.
=======================
Xiao Fu, Assistant Professor
School of Electrical Engineering and Computer Science
Oregon State University
Corvallis OR 97331
3003 Kelley Engineering Center
Homepage: https://web.engr.oregonstate.edu/~fuxia/
Begin forwarded message:
From: "Shrestha, Sagar" <shressag(a)oregonstate.edu<mailto:shressag@oregonstate.edu>>
Subject: [Sp-group] SP Seminar Summer 2022 beginning on 14th June !
Date: June 3, 2022 at 4:02:12 PM PDT
To: sp-group(a)lists.oregonstate.edu<mailto:sp-group@lists.oregonstate.edu>
Hello all,
We are happy to announce that the Signal Processing seminar 2022 will start from June 14th, 2022. The seminar will be held in-person, weekly in the month of June and biweekly in July and August.
We will have our first talk of the seminar by Dr. Xiao Fu. The talk is scheduled at 4pm to 5pm on June 14th, Tuesday. The talk will be held in-person in KEC 1005. Please see below for the details of the talk.
Speaker:
Dr. Xiao Fu
Title:
Understanding Multiview and Self-Supervised Representation Learning: A Nonlinear Mixture Identification Perspective
Abstract:
Central to representation learning is to succinctly represent high-dimensional data using the “essential information’’ while discarding the “redundant information”. Properly formulating and approaching this objective is critical to fending against overfitting, and can also benefit many important tasks such as domain adaptation and transfer learning. This talk aims to deepen understanding of representation learning and using the gained insights to come up with a new learning method. In particular, attention will be paid to two representation learning paradigms using multiple views of data, as both naturally acquired (e.g., image and audio) and artificially produced (e.g., via adding different noise to data samples) multiview data have empirically proven useful in producing essential information-reflecting vector representations. Natural views are often handled by multiview analysis tools, e.g., (deep) canonical correlation analysis [(D)CCA], while the artificial ones are frequently used in self-supervised learning (SSL) paradigms, e.g., BYOL and Barlow Twins. However, the effectiveness of these methods is mostly validated empirically, and more insights and theoretical underpinnings remain to be discovered. In this talk, an intuitive generative model of multiview data is adopted, where the views are different nonlinear mixtures of shared and private components. Since the shared components are view/distortion-invariant, such components may serve for representing the essential information of data in a non-redundant way. Under this model, a key module used in a suite of DCCA and SSL paradigms, namely, latent correlation maximization, is shown to guarantee the extraction of the shared components across views (up to certain ambiguities). It is further shown that the private information in each view can be provably disentangled from the shared using proper regularization design---which can facilitate tasks such cross-view translation and data generation. A finite sample analysis, which has been rare in nonlinear mixture identifiability study, is also presented. The theoretical results and newly designed regularization are tested on a series of tasks.
Biography:
Xiao Fu received the Ph.D. degree in Electronic Engineering from The Chinese University of Hong Kong (CUHK), Shatin, N.T., Hong Kong, in 2014. He was a Postdoctoral Associate with the Department of Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN, USA, from 2014 to 2017. Since 2017, he has been an Assistant Professor with the School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, OR, USA. His research interests include the broad area of signal processing and machine learning.Dr. Fu received a Best Student Paper Award at ICASSP 2014, and was a recipient of the Outstanding Postdoctoral Scholar Award at University of Minnesota in 2016. His coauthored papers received Best Student Paper Awards from IEEE CAMSAP 2015 and IEEE MLSP 2019, respectively. He received the National Science Foundation CAREER Award in 2022. He serves as a member of the Sensor Array and Multichannel Technical Committee (SAM-TC) of the IEEE Signal Processing Society (SPS). He is also a member of the Signal Processing for Multisensor Systems Technical Area Committee (SPMuS-TAC) of EURASIP. He is the Treasurer of the IEEE SPS Oregon Chapter. He serves as an Editor of Signal Processing and an Associate Editor of IEEE Transactions on Signal Processing. He was a tutorial speaker at ICASSP 2017 and SIAM Conference on Applied Linear Algebra 2021.
Time: 4:00 PM to 5:00 PM
Date: June 14, Tuesday, 2022
Location: KEC 1005
Have a nice end of the term !
Best,
Sagar Shrestha
_______________________________________________
sp-group mailing list
sp-group(a)lists.oregonstate.edu<mailto:sp-group@lists.oregonstate.edu>
https://lists.oregonstate.edu/mailman/listinfo/sp-group
Hello everyone,
I’ve decided to put the alignment reading group on hold from now until summer break is over. I look forward to meeting you all fall term!
All the best,
Quintin Pope
Sent from my iPhone
