CPS: Medium: Learning for Control of Synthetic and Cyborg Insects in Uncertain Dynamic Environments
Lead PI:
Pieter Abbeel
Abstract
The objective of this research is to enable operation of synthetic and cyborg insects in complicated environments, such as outdoors or in a collapsed building. As the mobile platforms and environment have significant uncertainty, learning and adaptation capabilities are critical. The approach consists of three main thrusts to enable the desired learning and adaptation: (i) Development of algorithms to efficiently learn optimal control policies and dynamics models through sharing the learning and adaptation between various instantiations of platforms and environments. (ii) Creation of control learning algorithms which can be run on low-cost, low-power mobile platforms. (iii) Development of algorithms for online improvement of policy performance in a minimal number of real-world trials. The proposed research will advance learning and adaptation capabilities of practical cyberphysical systems. The proposed approach will be generally applicable and lead to a new class of learning and adapting systems that are able to leverage shared properties between multiple tasks to significantly speed up learning and adaptation. Success in this research project will bring society closer to solving the grand challenge of teams of mobile, disposable, search and rescue robots which can robustly locomote through uncertain and novel environments, finding survivors in disaster situations, while removing risk from rescuers. This project will provide interdisciplinary training through research and classwork for undergraduate and graduate students in creating systems which intimately couple the cyber and physical aspects in robotic and living mobile platforms. Through the SUPERB summer program, under-represented students in engineering will experience research in learning and robotics.
Pieter Abbeel
<p>Pieter Abbeel received a BS/MS in Electrical Engineering from KU Leuven (Belgium) and received his Ph.D. degree in Computer Science from Stanford University in 2008. He joined the faculty at UC Berkeley in Fall 2008, with an appointment in the Department of Electrical Engineering and Computer Sciences. He has won various awards, including best paper awards at ICML and ICRA, the Sloan Fellowship, the Air Force Office of Scientific Research Young Investigator Program (AFOSR-YIP) award, the Okawa Foundation award, the 2011's TR35, the IEEE Robotics and Automation Society (RAS) Early Career Award, and the Dick Volz Best U.S. Ph.D. Thesis in Robotics and Automation Award. He has developed apprenticeship learning algorithms which have enabled advanced helicopter aerobatics, including maneuvers such as tic-tocs, chaos and auto-rotation, which only exceptional human pilots can perform. His group has also enabled the first end-to-end completion of reliably picking up a crumpled laundry article and folding it. His work has been featured in many popular press outlets, including BBC, New York Times, MIT Technology Review, Discovery Channel, SmartPlanet and Wired. His current research focuses on robotics and machine learning with a particular focus on challenges in personal robotics, surgical robotics and connectomics.</p>
Performance Period: 09/01/2009 - 08/31/2013
Institution: University of California-Berkeley
Sponsor: National Science Foundation
Award Number: 0931463
CPS: Medium: High Confidence Active Safety Control in Automotive Cyber-Physical Systems
Lead PI:
Francesco Borrelli
Co-Pi:
Abstract
The objective of this research is to study the formal design and verification of advanced vehicle dynamics control systems. The approach is to consider the vehicle-driver-road system as a cyber-physical system (CPS) by focusing on three critical components: (i) the tire-road interaction; (ii) the driver-vehicle interaction; and (iii) the controller design and validation. Methods for quantifying and estimating the uncertainty of the road friction coefficient by using self-powered wireless sensors embedded in the tire are developed for considering tire-road interaction. Tools for real-time identification of nominal driver behavior and uncertainty bounds by using in-vehicle cameras and body wireless sensors are developed for considering driver-vehicle interaction. A predictive hybrid supervisory control scheme will guarantee that the vehicle performs safely for all possible uncertainty levels. In particular, for controller design and validation, the CPS autonomy level is continuously adapted as a function of human and environment conditions and their uncertainty bounds quantified by considering tire-road and driver-vehicle interaction. High confidence is critical in all human operated and supervised cyber-physical systems. These include environmental monitoring, telesurgery, power networks, and any transportation CPS. When human and environment uncertainty bounds can be predicted, safety can be robustly guaranteed by a proper controller design and validation. This avoids lengthy and expensive trial and error design procedures and drastically increases their confidence level. Graduate, undergraduate and underrepresented engineering students benefit from this project through classroom instruction, involvement in the research and substantial interaction with industrial partners from the fields of tires, vehicle active safety, and wireless sensors.
Francesco Borrelli
Performance Period: 09/01/2009 - 08/31/2012
Institution: University of California-Berkeley
Sponsor: National Science Foundation
Award Number: 0931437
CPS: Medium: Collaborative Research: Physical Modeling and Software Synthesis for Self-Reconfigurable Sensors in River Environments
Lead PI:
Alexandre Bayen
Abstract
The objective of this research is the transformation from static sensing into mobile, actuated sensing in dynamic environments, with a focus on sensing in tidally forced rivers. The approach is to develop inverse modeling techniques to sense the environment, coordination algorithms to distribute sensors spatially, and software that uses the sensed environmental data to enable these coordination algorithms to adapt to new sensed conditions. This work relies on the concurrent sensing of the environment and actuation of those sensors based on sensed data. Sensing the environment is approached as a two-layer optimization problem. Since mobile sensors in dynamic environments may move even when not actuated, sensor coordination and actuation algorithms must maintain connectivity for the sensors while ensuring those sensors are appropriately located. The algorithms and software developed consider the time scales of the sensed environment, as well as the motion capabilities of the mobile sensors. This closes the loop from sensing of the environment to actuation of the devices that perform that sensing. This work is addresses a challenging problem: the management of clean water resources. Tidally forced rivers are critical elements in the water supply for millions of Californians. By involving students from underrepresented groups, this research provides a valuable opportunity for students to develop an interest in engineering and to learn first hand about the role of science and engineering in addressing environmental issues.
Alexandre Bayen
Performance Period: 09/01/2009 - 08/31/2012
Institution: University of California-Berkeley
Sponsor: National Science Foundation
Award Number: 0931348
CPS: Medium: Quantitative Analysis and Design of Control Networks
Lead PI:
George Pappas
Co-Pi:
Abstract
The objective of this research is to develop the scientific foundation for the quantitative analysis and design of control networks. Control networks are wireless substrates for industrial automation control, such as the WirelessHART and Honeywell's OneWireless, and have fundamental differences over their sensor network counterparts as they also include actuation and the physical dynamics. The approach of the project focuses on understanding cross-cutting interfaces between computing systems, control systems, sensor networks, and wireless communications using time-triggered architectures. The intellectual merit of this research is based on using time-triggered communication and computation as a unifying abstraction for understanding control networks. Time-triggered architectures enable the natural integration of communication, computation, and physical aspects of control networks as switched control systems. The time-triggered abstraction will serve for addressing the following interrelated themes: Optimal Schedules via Quantitative Automata, Quantitative Analysis and Design of Control Networks: Wireless Protocols for Optimal Control: Quantitative Trust Management for Control Networks. Various components of this research will be integrated into the PIs' RAVEN control network which is compatible with both WirelessHART and OneWireless specifications. This provides a direct path for this proposal to have immediate industrial impact. In order to increase the broader impact of this project, this project will launch the creation of a Masters' program in Embedded Systems, one of the first in the nation. The principle that guides the curriculum development of this novel program is a unified systems view of computing, communication, and control systems.
George Pappas
Performance Period: 09/01/2009 - 08/31/2014
Institution: University of Pennsylvania
Sponsor: National Science Foundation
Award Number: 0931239
CPS: Small: Dynamically Managing the Real-time Fabric of a Wireless Sensor-Actuator Network
Lead PI:
Michael Lemmon
Co-Pi:
Abstract
The objective of this research is to develop algorithms for wireless sensor-actuator networks (WSAN) that allow control applications and network servers to work together in maximizing control application performance subject to hard real-time service constraints. The approach is a model-based approach in which the WSAN is unfolded into a real-time fabric that captures the interaction between the network's cyber-processes and the application's physical-processes. The project's approach faces a number of challenges when they are applied to wireless control systems. This project addresses these challenges by 1) using network calculus concepts to pose a network utility maximization (NUM) problem that maximizes overall application performance subject to network capacity constraints, 2) using event-triggered message passing schemes to reduce communication overhead, 3) using nonlinear analysis methods to more precisely characterize the problem's utility functions, and 4) using anytime control concepts to assure robustness over wide variations in network connectivity. The project's impact will be broadened through interactions with industrial partner, EmNet LLC. The company will use this project's algorithms on its CSOnet system. CSOnet is a WSAN controlling combined-sewer overflows (CSO), an environmental problem faced by nearly 800 cities in the United States. The project's impact will also be broadened through educational outreach activities that develop a graduate level course on formal methods in cyber-physical systems. The project's impact will be broadened further through collaborations with colleagues working on networked control systems under the European Union's WIDE project.
Michael Lemmon
Michael Lemmon is a professor of electrical engineering at the University of Notre Dame. He received his PhD and MS in EE from Carnegie-Mellon University in 1987 and 1990, respectively. He got his BSEE from Stanford University in 1979. He was an aerospace engineering from 1979-1986. He joined the faculty of electrical engineering at Notre Dame in 1990. His early research was on neural network, hybrid and cyber-physical systems, wireless sensor-actuator networks, and networked control systems. He is currently studying deep learning for robust adaptive control.
Performance Period: 09/01/2009 - 08/31/2014
Institution: University of Notre Dame
Sponsor: National Science Foundation
Award Number: 0931195
CPS: Medium: Collaborative Research: Abstraction of Cyber-Physical Interplays and Its Application to CPS Design
Lead PI:
C.Mani Krishna
Co-Pi:
Abstract
The objective of this research is to develop abstractions by which the controlled process and computation state in a cyber-physical system can both be expressed in a form that is useful for decision-making across real-time task scheduling and control actuation domains. The approach is to quantify the control degradation in terms of response time, thereby tying computer responsiveness to the controlled process performance and use such cost functions to effectively manage computational resources. Similarly, control strategies can be adjusted so as to be responsive to computational state. Unmanned aircraft will be used as vehicles to demonstrate our approach. The intellectual merit of this research is that it takes disparate fields, control and computation, and builds formal abstractions in both the computation-to-control and control-to-computation directions. These abstractions are grounded in terms of physical reality (e.g., time, fuel, energy) and encapsulate in a form comprehensible and meaningful to each domain, the relevant attributes of the other domain. This research is important because cyber-physical systems are playing an increasing role in all walks of life. It will allow design approaches to be systematic and efficient rather than ad hoc. It is based on a large body of our prior work that has begun to successfully bridge the representational and algorithmic gap that separates the control and computer science & engineering communities. Dissemination of results will be by means of courses in our universities, instructional materials, research and tutorial publications and industry collaboration (e.g., General Motors R&D). The plan is to hire minority/female students.
C.Mani Krishna
Performance Period: 10/01/2009 - 09/30/2014
Institution: University of Massachusetts Amherst
Sponsor: National Science Foundation
Award Number: 0931035
CPS: Medium: Collaborative Research: Physical modeling and software
Lead PI:
Sonia Martinez
Abstract
The objective of this research is the transformation from static sensing into mobile, actuated sensing in dynamic environments, with a focus on sensing in tidally forced rivers. The approach is to develop inverse modeling techniques to sense the environment, coordination algorithms to distribute sensors spatially, and software that uses the sensed environmental data to enable these coordination algorithms to adapt to new sensed conditions. This work relies on the concurrent sensing of the environment and actuation of those sensors based on sensed data. Sensing the environment is approached as a two-layer optimization problem. Since mobile sensors in dynamic environments may move even when not actuated, sensor coordination and actuation algorithms must maintain connectivity for the sensors while ensuring those sensors are appropriately located. The algorithms and software developed consider the time scales of the sensed environment, as well as the motion capabilities of the mobile sensors. This closes the loop from sensing of the environment to actuation of the devices that perform that sensing. This work is addresses a challenging problem: the management of clean water resources. Tidally forced rivers are critical elements in the water supply for millions of Californians. By involving students from underrepresented groups, this research provides a valuable opportunity for students to develop an interest in engineering and to learn first hand about the role of science and engineering in addressing environmental issues.
Sonia Martinez
Performance Period: 09/01/2009 - 08/31/2013
Institution: University of California-San Diego
Sponsor: National Science Foundation
Award Number: 0930946
CPS: Small: Control of Surgical Robots: Network Layer to Tissue Contact
Lead PI:
Blake Hannaford
Co-Pi:
Abstract
This proposed CPS project aims to enable intelligent telesurgery in which a surgeon, or a distributed team of surgeons, can work on tiny regions in the body with minimal access. The University of Washington will expand an existing open surgical robot testbed, and create a robust infrastructure for cyber-physical systems with which to extend traditional real-time control and teleoperation concepts by adding three new interfaces to the system: networking, intelligent robotics, and novel non-linear controllers. Intellectual Merit: This project aims to break new ground beyond teleoperation by adding advanced robotic functions. Equally robust and flexible networking, high-level interfaces, and novel controllers will be added to the existing sytsem. The resulting system will be an open architecture and a substrate upon which many cyber-physical system ideas and algorithms will be tested under realistic conditions. The platforms proven physical robustness will permit rigorous evaluation of results and the open interfaces will encourage collaboration and sharing of results. Broader Impacts: We expect the results to enable new research in multiple ways. First, the collaborators such as Johns Hopkins, U.C. Santa Cruz, and several foreign institutions will be able to remotely connect to new high level interfaces provided by this project. Second, for the first time a robust and completely open surgical telerobot will be available for research so that CPS researchers do not need to be limited to isolated toy problems but instead be able to prototype advanced surgical robotics techniques and evaluate them in realistic contexts including animal procedures.
Blake Hannaford
Performance Period: 09/01/2009 - 12/31/2012
Institution: University of Washington
Sponsor: National Science Foundation
Award Number: 0930930
CPS: Medium: Collaborative Research: Physical Modeling and Software Synthesis for Self-Reconfigurable Sensors in River Environments
Lead PI:
Jonathan Sprinkle
Abstract
The objective of this research is the transformation from static sensing into mobile, actuated sensing in dynamic environments, with a focus on sensing in tidally forced rivers. The approach is to develop inverse modeling techniques to sense the environment, coordination algorithms to distribute sensors spatially, and software that uses the sensed environmental data to enable these coordination algorithms to adapt to new sensed conditions. This work relies on the concurrent sensing of the environment and actuation of those sensors based on sensed data. Sensing the environment is approached as a two-layer optimization problem. Since mobile sensors in dynamic environments may move even when not actuated, sensor coordination and actuation algorithms must maintain connectivity for the sensors while ensuring those sensors are appropriately located. The algorithms and software developed consider the time scales of the sensed environment, as well as the motion capabilities of the mobile sensors. This closes the loop from sensing of the environment to actuation of the devices that perform that sensing. This work is addresses a challenging problem: the management of clean water resources. Tidally forced rivers are critical elements in the water supply for millions of Californians. By involving students from underrepresented groups, this research provides a valuable opportunity for students to develop an interest in engineering and to learn first hand about the role of science and engineering in addressing environmental issues.
Jonathan Sprinkle
<p>Dr. Jonathan Sprinkle is a Professor of Computer Science at Vanderbilt University. From 2007-2021 he was with the faculty of Electrical and Computer Engineering of the University of Arizona, where he was a Distinguished Scholar and a Distinguished Associate Professor. He served as a Program Director at the National Science Foundation from 2017-2019 in the Computer and Information Science and Engineering Directorate, working with programs such as Cyber-Physical Systems, Smart &amp; Connected Communities, and Research Experiences for Undergraduates.</p>
Performance Period: 09/01/2009 - 08/31/2013
Institution: University of Arizona
Sponsor: National Science Foundation
Award Number: 0930919
GOALI/CPS:Medium:A Framework for Enabling Energy-Aware Smart Facilities
Lead PI:
Mario Berges
Co-Pi:
Abstract
The goal of the proposed research is to identify ways to inexpensively provide specific information about energy consumption in buildings and facilitate conservation. Signal processing, machine learning, and data fusion techniques will be developed to extract actionable information from whole-building power meters and other available sensors. The main objectives are: (a) to create a framework for obtaining disaggregated, appliance-specific feedback about electricity consumption in a building by extracting high-value information from low-cost data sources; and (b) to investigate and develop data mining and machine learning algorithms for making use of appliance-specific electricity data, in order to provide users with recommendations on how to optimize their energy consumption and understand the effects of their energy-related decisions. A series of residential buildings in Pittsburgh, PA will serve as a test-bed for evaluating and validating our proposed approach. Blueroof Technologies, a non-profit corporation located in McKeesport, PA that researches, develops and provides affordable senior-citizen housing with integrated sensor networks and building automation systems, will provide access to their Research Cottages for this project. Similarly, Robert Bosch LLC, a leading global provider of consumer goods and building technology, will provide additional technical research assistance and expertise. The main scientific merit of the project is the development of a framework for evaluating energy-use-disaggregation methods according to their value for promoting energy conservation. The resulting data sets will be large enough to produce significant conclusions about the feasibility and effectiveness of the technology, and allow for the development of new models about the trends and patterns of appliance usage in buildings. Broader impacts of this research include providing a foundation for future cyber-physical systems by inexpensively obtaining real-time appliance-level data. Such data can be used to help reduce the energy consumption of buildings by revealing the relationship between users' behavior and electricity consumption in buildings. The proposed industry-university collaborative research effort with Bosch will ensure that the technology and scientific contributions are steered toward innovative solutions that are practical for adoption in the market. Furthermore, the project will have significant diversity contributions by attracting minority students through collaboration with the University of Maryland Eastern Shore, a land-grant, historically black college with a diverse student body. Finally, a series of planned industry seminars, workshops and the publication of journal articles will allow further dissemination of the work.
Mario Berges
Performance Period: 10/01/2009 - 09/30/2014
Institution: Carnegie Mellon University
Sponsor: National Science Foundation
Award Number: 0930868
Subscribe to