CPS: Synergy: Collaborative Research: Adaptive Intelligence for Cyber-Physical Automotive Active Safety - System Design and Evaluation
Lead PI:
Laurent Itti
Abstract
The automotive industry finds itself at a cross-roads. Current advances in MEMS sensor technology, the emergence of embedded control software, the rapid progress in computer technology, digital image processing, machine learning and control algorithms, along with an ever increasing investment in vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) technologies, are about to revolutionize the way we use vehicles and commute in everyday life. Automotive active safety systems, in particular, have been used with enormous success in the past 50 years and have helped keep traffic accidents in check. Still, more than 30,000 deaths and 2,000,000 injuries occur each year in the US alone, and many more worldwide. The impact of traffic accidents on the economy is estimated to be as high as $300B/yr in the US alone. Further improvement in terms of driving safety (and comfort) necessitates that the next generation of active safety systems are more proactive (as opposed to reactive) and can comprehend and interpret driver intent. Future active safety systems will have to account for the diversity of drivers' skills, the behavior of drivers in traffic, and the overall traffic conditions. This research aims at improving the current capabilities of automotive active safety control systems (ASCS) by taking into account the interactions between the driver, the vehicle, the ASCS and the environment. Beyond solving a fundamental problem in automotive industry, this research will have ramifications in other cyber-physical domains, where humans manually control vehicles or equipment including: flying, operation of heavy machinery, mining, tele-robotics, and robotic medicine. Making autonomous/automated systems that feel and behave "naturally" to human operators is not always easy. As these systems and machines participate more in everyday interactions with humans, the need to make them operate in a predictable manner is more urgent than ever. To achieve the goals of the proposed research, this project will use the estimation of the driver's cognitive state to adapt the ASCS accordingly, in order to achieve a seamless operation with the driver. Specifically, new methodologies will be developed to infer long-term and short-term behavior of drivers via the use of Bayesian networks and neuromorphic algorithms to estimate the driver's skills and current state of attention from eye movement data, together with dynamic motion cues obtained from steering and pedal inputs. This information will be injected into the ASCS operation in order to enhance its performance by taking advantage of recent results from the theory of adaptive and real-time, model-predictive optimal control. The correct level of autonomy and workload distribution between the driver and ASCS will ensure that no conflicts arise between the driver and the control system, and the safety and passenger comfort are not compromised. A comprehensive plan will be used to test and validate the developed theory by collecting measurements from several human subjects while operating a virtual reality-driving simulator.
Performance Period: 09/15/2015 - 08/31/2018
Institution: University of Southern California
Sponsor: National Science Foundation
Award Number: 1545089
CPS: Breakthrough: Collaborative Research: The Interweaving of Humans and Physical Systems: A Perspective From Power Systems
Lead PI:
Ramesh Johari
Abstract
As information technology has transformed physical systems such as the power grid, the interface between these systems and their human users has become both richer and much more complex. For example, from the perspective of an electricity consumer, a whole host of devices and technologies are transforming how they interact with the grid: demand response programs; electric vehicles; "smart" thermostats and appliances; etc. These novel technologies are also forcing us to rethink how the grid interacts with its users, because critical objectives such as stability and robustness require effective integration among the many diverse users in the grid. This project studies the complex interweaving of humans and physical systems. Traditionally, a separation principle has been used to isolate humans from physical systems. This principle requires users to have preferences that are well-defined, stable, and quickly discoverable. These assumptions are increasingly violated in practice: users' preferences are often not well-defined; unstable over time; and take time to discover. Our project articulates a new framework for interactions between physical systems and their users, where users' preferences must be repeatedly learned over time while the system continually operates with respect to imperfect preference information. We focus on the area of power systems. Our project has three main thrusts. First, user models are rethought to reflect the fact this new dynamic view of user preferences, where even the users are learning over time. The second thrust focuses on developing a new system model that learns about users, since we cannot understand users in a "single-shot"; rather, repeated interaction with the user is required. We then focus on the integration of these two new models. How do we control and operate a physical system, in the presence of the interacting "learning loops", while mediating between many competing users? We apply ideas from mean field games and optimal power flow to capture, analyze, and transform the interaction between the system and the ongoing preference discovery process. Our methods will yield guidance for market design in power systems where user preferences are constantly evolving. If successful, our project will usher in a fundamental change in interfacing physical systems and users. For example, in the power grid, our project directly impacts how utilities design demand response programs; how smart devices learn from users; and how the smart grid operates. In support of this goal, the PIs intend to develop avenues for knowledge transfer through interactions with industry. The PIs will also change their education programs to reflect a greater entanglement between physical systems and users.
Performance Period: 10/01/2015 - 09/30/2019
Institution: Stanford University
Sponsor: National Science Foundation
Award Number: 1544548
CPS: Breakthrough: Collaborative Research: WARP: Wide Area assisted Resilient Protection
Lead PI:
Array Array
Co-PI:
Abstract
The electric power grid experiences disturbances all the time that are routinely controlled, managed, or eliminated by system protection measures- designed by careful engineering studies and fine-tuned by condensing years of operational experience. Despite this, the grid sometimes experiences disruptive events that can quickly, and somewhat unstoppably catapult the system towards a blackout. Arresting such blackouts has remained elusive - mainly because relays (protection devices) operate on local data, and are prone to hidden faults that are impossible to detect until they manifest, resulting in misoperations that have sometime been precipitators or contributors to blackouts. Inspired by the Presidential policy directive on resilience -- meaning the ability to anticipate, prepare, withstand, and recover from disruptive events, this project proposes "WARP: Wide Area assisted Resilient Protection", a paradigm that adds a layer of finer (supervisory) intelligence to supplement conventional protection wisdom - which we call resilient protection. Exploiting high fidelity measurements and computation to calculate and analyze energy function components of power systems to identify disturbances, WARP would allow relays to be supervised - correct operations would be corroborated, and misoperations will be remedied by judiciously reversing the relay operation in a rational time-frame. The project also envisions predicting instability using advanced estimation techniques, thus being proactive. This will provide power grid the ability to auto-correct and bounce back from misoperations, curtailing the size, scale and progression of blackouts and improving the robustness and resilience of the electric grid -- our nation's most critical infrastructure. In WARP, disruptive events are deciphered by using synchrophasor data, energy functions, and dynamic state information via particle filtering. The information is fused to provide a global data set and intelligence signal that supervises relays, and also to predict system stability. Resilience is achieved when the supervisory signal rectifies the misoperation of relays, or endorses their action when valid. This endows relays with post-event-auto-correct abilities 
- a feature that never been explored/understood in the protection-stability nexus. Architectures to study the effect of latency and bad data are proposed. WARP introduces new notions: global detectability and distinguishability for power system events, stability prediction based on
the sensitivity of the energy function components and uses a novel factorization method: (CUR) preserving data interpretability to reduce data dimensionality. All the proposed
tools will be wrapped into a simulation framework to assess scalability and accuracy-runtime tradeoffs, and quantify the degree of resilience achieved. The effectiveness of the proposed scheme during extreme events will be measured by reenacting two well-documented blackout sequences. In addition, simulations on benchmarked systems will be performed to assess scalability and accuracy-runtime tradeoffs, and quantify the degree of resilience achieved.
Performance Period: 09/15/2015 - 08/31/2019
Institution: North Dakota State University - Fargo
Sponsor: National Science Foundation
Award Number: 1544621
CPS: GOALI: Synergy: Maneuver and Data Optimization for High Confidence Testing of Future Automotive Cyberphysical Systems
Lead PI:
Ilya V. Kolmanovsky
Co-PI:
Abstract
This project addresses urgent challenges in high confidence validation and verification of automotive vehicles due to on-going and anticipated introduction of advanced, connected and autonomous vehicles into mass production. Since such vehicles operate across both physical and cyber domains, faults can occur in traditional physical components, in cyber components (i.e., algorithms, processors, networks, etc.), or in both. Thus, advanced vehicles need to be tested for both physical and cyber-related fault conditions. The goal of this project is to develop theory, methods, and novel tools for generating and optimizing test trajectories and data inputs that can uncover both physical and cyber faults of future automotive vehicles. The level of vehicle reliability and safety achieved for current vehicles is remarkable considering their mass production, low cost, and wide range of operating conditions. If successful, the research advances made in this project will enable achieving similar levels of reliability and safety for future vehicles relying on advanced driver assistance technologies, connectivity and autonomy. The project will advance the field of cyber-physical systems, in general, and their lifecycle management, in particular. The validation and verification theory and methodology for cyberphysical systems will be expanded for uncovering anomalies and faults, especially using comprehensive case-based and optimization-based techniques for test scenario generation. The theoretical advances and case studies will contribute to the state-of-the-art in optimal control theory, game theory, information theory, data collection and processing, autonomous and connected vehicles, and automotive control. Sampling-based vehicle data acquisition and vehicle-aware data management strategies will be developed which can be applied more broadly, e.g., to cloud-based vehicle prognostics / conditional maintenance and mobile health-monitoring devices. Finally, approaches for efficient on-board data collection and aggregation will be implemented in a Cyber-physical system (CPS) Black Box prototype. The development of a vehicle-aware data management system (VDMS) will be pursued, leading to optimized use of data mining and compression inside the CPS Black Box to aggressively reduce the communication and computational costs. Synergistically with theoretical and methodological advances, automotive case studies will be undertaken with both realistic simulations and real experiments in collaboration with an industrial partner (AVL).
Performance Period: 10/01/2015 - 09/30/2019
Institution: University of Michigan Ann Arbor
Sponsor: National Science Foundation
Award Number: 1544844
CPS: Synergy: Towards Foundational Verification of Cyber-Physical Systems
Lead PI:
Sorin Lerner
Co-PI:
Abstract
Errors in cyber-physical systems can lead to disastrous consequences. Classic examples date back to the Therac-25 radiation incidents in 1987 and the Ariane 5 rocket crash in 1996. More recently, Toyota's unintended acceleration bug was caused by software errors, and certain cars were found vulnerable to attacks that can take over key parts of the control software, allowing attackers to even disable the brakes remotely. Pacemakers have also been found vulnerable to attacks that can cause deadly consequences for the patient. To reduce the chances of such errors happening, this project investigates the application of a technique called Foundational Verification to cyber-physical systems. In Foundational Verification, the system being developed is proved correct, in full formal detail, using a proof assistant. The main intellectual merit of the proposal is the attainment of previously unattainable levels of safety for cyber-physical systems because proofs in Foundational Verification are carried out in complete detail. To ensure that the techniques in this project are practical, they are evaluated within the context of a real flying quadcopter. The project's broader significance and importance is the improved correctness, safety and security of cyber-physical systems. In particular, this project lays the foundation for ushering in a new level of formal correctness for cyber-physical systems. Although the initial work focuses on quadcopters, the concepts, ideas, and research contributions have the potential for transformative impact on other kinds of systems, including power-grid software, cars, avionics and medical devices (from pacemakers and insulin pumps to defibrillators and radiation machines).
Performance Period: 10/01/2015 - 09/30/2019
Institution: University of California-San Diego
Sponsor: National Science Foundation
Award Number: 1544757
Synergy: Collaborative: CPS-Security: End-to-End Security for the Internet of Things
Lead PI:
Philip Levis
Co-PI:
Abstract
Computation is everywhere. Greeting cards have processors that play songs. Fireworks have processors for precisely timing their detonation. Computers are in engines, monitoring combustion and performance. They are in our homes, hospitals, offices, ovens, planes, trains, and automobiles. These computers, when networked, will form the Internet of Things (IoT). The resulting applications and services have the potential to be even more transformative than the World Wide Web. The security implications are enormous. Internet threats today steal credit cards. Internet threats tomorrow will disable home security systems, flood fields, and disrupt hospitals. The root problem is that these applications consist of software on tiny low-power devices and cloud servers, have difficult networking, and collect sensitive data that deserves strong cryptography, but usually written by developers who have expertise in none of these areas. The goal of the research is to make it possible for two developers to build a complete, secure, Internet of Things applications in three months. The research focuses on four important principles. The first is "distributed model view controller." A developer writes an application as a distributed pipeline of model-view-controller systems. A model specifies what data the application generates and stores, while a new abstraction called a transform specifies how data moves from one model to another. The second is "embedded-gateway-cloud." A common architecture dominates Internet of Things applications. Embedded devices communicate with a gateway over low-power wireless. The gateway processes data and communicates with cloud systems in the broader Internet. Focusing distributed model view controller on this dominant architecture constrains the problem sufficiently to make problems, such as system security, tractable. The third is "end-to-end security." Data emerges encrypted from embedded devices and can only be decrypted by end user applications. Servers can compute on encrypted data, and many parties can collaboratively compute results without learning the input. Analysis of the data processing pipeline allows the system and runtime to assert and verify security properties of the whole application. The final principle is "software-defined hardware." Because designing new embedded device hardware is time consuming, developers rely on general, overkill solutions and ignore the resulting security implications. The data processing pipeline can be compiled into a prototype hardware design and supporting software as well as test cases, diagnostics, and a debugging methodology for a developer to bring up the new device. These principles are grounded in Ravel, a software framework that the team collaborates on, jointly contributes to, and integrates into their courses and curricula on cyberphysical systems.
Performance Period: 09/01/2015 - 08/31/2018
Institution: Stanford University
Sponsor: National Science Foundation
Award Number: 1505728
EAGER: Cybermanufacturing: Enabling Production as a Service (PaaS)
Lead PI:
Zhuoqing Mao
Abstract
Production as a service (PaaS) defines a new paradigm in manufacturing that will allow designers of new products to query existing manufacturing facilities and receive information about fabrication capabilities and production availability. The access to information such as part cost, part quality, and production time will help new products to be prototyped and scaled-up quickly, while also allowing existing manufacturing facilities to benefit from underutilized equipment and labor. The PaaS framework will include both a front-end query interface for the users and a back-end analysis component. The interface will be designed to connect users with small-, mid-, and large-sized manufacturing facilities, while the scheduling and routing algorithms will provide the flexibility and security protocols needed to guarantee operational and production safety across the range of facilities. Manufacturers that utilize the PaaS framework will reap the potential of meeting customer needs in terms of cost, quality, on-time delivery, while being reactive to changing market forces. With 12 percent of the GDP represented by the manufacturing industry, the manufacturing operational improvements that will result from this EArly-concept Grant for Exploratory Research (EAGER) project have the potential to make a significant impact in the national bottom line. The aim of the PaaS platform is to enable distributed manufacturing plant locations to efficiently coordinate both within one plant location as well as across plant locations to realize a flexible service interface for supporting production management. The intellectual merit of this research lies in the extensions that will be created to the existing science and technology in service-oriented architectures to enable distributed production, while preserving proprietary information of the manufacturing systems. The key software abstraction that enables this innovation comes from the extension to the well-known APIs to capture the sophisticated query logic and diverse production requirements to meet user needs. Routing and scheduling decisions will be optimized by leveraging a global view of the current state of all of the components in the manufacturing facilities. To demonstrate scalability and ensure privacy guarantees across multiple facilities, hierarchical abstraction will be used to hide low-level details and proprietary information. The PaaS framework will transform the way manufacturing companies interact with the emerging high-value market; providing the architecture to drive innovation and enable small-, mid-, and large-scale manufacturing companies across the U.S. to compete for new product business on an even playing field.
Performance Period: 10/01/2015 - 09/30/2017
Institution: University of Michigan Ann Arbor
Sponsor: National Science Foundation
Award Number: 1546036
CPS: Synergy: Collaborative Research: Cyber-Physical Sensing, Modeling, and Control for Large-Scale Wastewater Reuse and Algal Biomass Production
Lead PI:
Piya Pal
Abstract
This project develops advanced cyber-physical sensing, modeling, control, and optimization methods to significantly improve the efficiency of algal biomass production using membrane bioreactor technologies for waste water processing and algal biofuel. Currently, many wastewater treatment plants are discharging treated wastewater containing significant amounts of nutrients, such as nitrogen, ammonium, and phosphate ions, directly into the water system, posing significant threats to the environment. Large-scale algae production represents one of the most promising and attractive solutions for simultaneous wastewater treatment and biofuel production. The critical bottleneck is low algae productivity and high biofuel production cost. The previous work of this research team has successfully developed an algae membrane bioreactor (A-MBR) technology for high-density algae production which doubles the productivity in an indoor bench-scale environment. The goal of this project is to explore advanced cyber-physical sensing, modeling, control, and optimization methods and co-design of the A-MBR system to bring the new algae production technology into the field. The specific goal is to increase the algal biomass productivity in current practice by three times in the field environment while minimizing land, capital, and operating costs. Specifically, the project will (1) adapt the A-MBR design to address unique new challenges for algae cultivation in field environments, (2) develop a multi-modality sensor network for real-time in-situ monitoring of key environmental variables for algae growth, (3) develop data-driven knowledge-based kinetic models for algae growth and automated methods for model calibration and verification using the real-time sensor network data, and (4) deploy the proposed CPS system and technologies in the field for performance evaluations and demonstrate its potentials. This project will demonstrate a new pathway toward green and sustainable algae cultivation and biofuel production using wastewater, addressing two important challenging issues faced by our nation and the world: wastewater treatment and renewable energy. It will provide unique and exciting opportunities for mentoring graduate students with interdisciplinary training opportunities, involving K-12 students, women and minority students. With web-based access and control, this project will convert the bench-scale and pilot scale algae cultivation systems into an exciting interactive online learning platform to educate undergraduate and high-school students about cyber-physical system design, process control, and renewable biofuel production.
Performance Period: 09/15/2015 - 08/31/2017
Institution: University of Maryland College Park
Sponsor: National Science Foundation
Award Number: 1544798
CPS: TTP Option: Synergy: Collaborative Research: Dynamic Methods of Traffic Control that Impact Quality of Life in Smart Cities
Lead PI:
Nikolaos Papanikolopoulos
Abstract
In the recent past the term "Smart Cities" was introduced to mainly characterize the integration into our daily lives of the latest advancements in technology and information. Although there is no standardized definition of Smart Cities, what is certain is that it touches upon many different domains that affect a city's physical and social capital. Smart cities are intertwined with traffic control systems that use advanced infrastructures to mitigate congestion and improve safety. Traffic control management strategies have been largely focused on improving vehicular traffic flows on highways and freeways but arterials have not been used properly and pedestrians are mostly ignored. This work proposes to introduce a novel hierarchical adaptive controls paradigm to urban network traffic control that will adapt to changing movement and interaction behaviors from multiple entities (vehicles, public transport modes, bicyclists, and pedestrians). Such a paradigm will leverage several key ideas of cyber-physical systems to rapidly and automatically pin-point and respond to urban arterial congestion thereby improving travel time and reliability for all modes. Safety will also be improved since advanced warnings actuated by the proposed cyber-physical system will alert drivers to congested areas thereby allowing them to avoid these areas, or to adapt their driving habits. Such findings have a tangible effect on the well-being, productivity, and health of the traveling public. The primary goal is to create a Cyber-Control Network (CCN) that will integrate seamlessly across heterogeneous sensory data in order to create effective control schemes and actuation sequences. Accordingly, this project introduces a Cyber-Physical architecture that will then integrate: (i) a sub-network of heterogeneous sensors, (ii) a decision control substrate, and (iii) a sub-actuation network that carries out the decisions of the control substrate (traffic control signals, changeable message signs). This is a major departure from more prevalent centralized Supervisory Control And Data Acquisition (SCADA), in that the CCN will use a hierarchical architecture that will dynamically instantiate the sub-networks together to respond rapidly to changing cyber-physical interactions. Such an approach allows the cyber-physical system to adapt in real-time to salient traffic events occurring at different scales of time and space. The work will consequently introduce a ControlWare module to realize such dynamic sub-network reconfiguration and provide decision signal outputs to the actuation network. A secondary, complementary goal is to develop a heterogeneous sensor network to reliably and accurately monitor and identify salient arterial traffic events. Other impacts of the project include the integration of the activities with practitioners (e.g., traffic engineers), annual workshops/tutorials, and outreach to K-12 institutions.
Performance Period: 09/15/2015 - 02/29/2020
Institution: University of Maryland College Park
Sponsor: National Science Foundation
Award Number: 1544887
CPS: Synergy: Collaborative Research: Cyber-physical digital microfluidics based on active matrix electrowetting technology: software-programmable high-density pixel arrays
Lead PI:
Philip Rack
Abstract
Laboratory-on-a-chip (LoC) technology is poised to improve global health through development of low-cost, automated point-of-care testing devices. In countries with few healthcare resources, clinics often have drugs to treat an illness, but lack diagnostic tools to identify patients who need them. To enable low-cost diagnostics with minimal laboratory support, this project will investigate domain-specific LoC programming language and compiler design in conjunction with device fabrication technologies (process flows, sensor integration, etc.). The project will culminate by building a working LoC that controls fluid motion through electronic signals supplied by a host PC; a forensic toxicology immunoassay will be programmed in software and executed on the device. This experiment will demonstrate benefits of programmable LoC technology including miniaturization (reduced reagent consumption), automation (reduced costs and uncertainties associated with human interaction), and general-purpose software-programmability (the device can execute a wide variety of biochemical reactions, all specified in software). Information necessary to reproduce the device, along with all software artifacts developed through this research effort, will be publicly disseminated. This will promote widespread usage of software-programmable LoC technology among researchers in the biological sciences, along with public and industrial sectors including healthcare and public health, biotechnology, water supply management, environmental toxicity monitoring, and many others. This project designs and implements a software-programmable cyber-physical laboratory-on-a-chip (LoC) that can execute a wide variety of biological protocols. By integrating sensors during fabrication, the LoC obtains the capability to send feedback in real-time to the PC controller, which can then make intelligent decisions regarding which biological operations to execute next. To bring this innovative and transformative platform to fruition, the project tackles several formidable research challenges: (1) cyber-physical LoC programming models and compiler design; (2) LoC fabrication, including process flows and cyber-physical sensor integration; and (3) LoC applications that rely on cyber-physical sensory feedback and real-time decision-making. By constructing a working prototype LoC, and programming a representative feedback-driven forensic toxicology immunoassay, the project demonstrates that the proposed system can automatically execute biochemical reactions that require a closed feedback loop. Expected broader impacts of the proposed work include reduced cost and increased reliability of clinical diagnostics, engagement with U.S. companies that use LoC technology, training of graduate and undergraduate students, increased engagement and retention efforts targeting women and underrepresented minorities, student-facilitated peer-instruction at UC Riverside, a summer residential program for underrepresented minority high-school students at the University of Tennessee, collaborations with researchers at the Oak Ridge National Laboratory, and creation, presentation, and dissemination of tutorial materials to promote the adoption and use of software-programmable LoCs among the wider scientific community.
Performance Period: 09/15/2015 - 08/31/2019
Institution: University of Tennessee - Knoxville
Sponsor: National Science Foundation
Award Number: 1544686
Subscribe to