講題：Sensing in the Era of AI – Challenges & Opportunities from Foundation Models and LLMs

Time: 12/11 (Wed) 3:30-5:00 PM

Location: ED B27

Speaker: Mani Srivastava

                                        Distinguished Professor

               Electrical and Computer Engineering

                                        Computer Science

                                        University of California, Los Angeles, USA

【講題大綱】

The previously discrete technologies of Cyber-Physical/IoT Systems (CPS-IoT) and AI/ML have recently entered a tight, virtuous embrace. CPS-IoT technologies allow sensing and interventions in our physical, social, and urban spaces with unimaginable ubiquity. AI/ML methods allow sophisticated inferences and decisions to be made algorithmically using neural and neurosymbolic architectures, even from unstructured and high-dimensional spatiotemporal data, with uncanny performance. Together, they perform sophisticated perception-cognition-communication-action loops in diverse applications.  After briefly discussing the current state of AI/ML methods for sensing in CPS-IoT systems, I will focus on the new opportunities and challenges for CPS-IoT emerging from Foundation Models, including Large Language/Multimodal Models, that have caused tremendous and broad excitement in AI. Based on our experience designing CPS-IoT systems for various applications and preliminary research findings, the talk will provide insights into (i) the role that LLMs -- with their world knowledge, ability to process sequences, and reasoning capabilities – can play in sophisticated sensor data analytics in CPS-IoT systems, (ii) the current capabilities and unresolved challenges of emerging foundation models focused on sensory data streams in the CPS-IoT domain.

【講者簡介】

Mani Srivastava is a Distinguished Professor, Mukund Padmanabhan Term Chair, and Vice Chair of Computer Engineering at UCLA’s ECE Department with a joint appointment in the CS Department. He enjoys working on learning-enabled, resource-constrained, and trustworthy CPS-IoT systems interacting with humans and the physical world.  His research examines problems across the entire spectrum of applications, architectures, algorithms, and technologies in the context of systems and applications for mobile health, intelligent built environments, national security, and sustainability. He is a Fellow of the ACM and the IEEE. Srivastava also holds an appointment with Amazon AWS as an Amazon Scholar, but the contents of his talk are based on his research at UCLA and are unrelated to Amazon.