Continuous real-time tracking of the eye and field-of-view of an individual is profoundly important to understanding how humans perceive and interact with the physical world. This work advances both the technology and engineering of cyber-physical systems by designing an innovative paradigm involving next-generation computational eyeglasses that interact with a user's mobile phone to provide the capability for real-time visual context sensing and inference. This research integrates novel research into low-power embedded systems, image representation, image processing and machine learning, and mobile sensing and inference, to advance the state-of-art in continuous sensing for CPS applications. The activity addresses several fundamental research challenges including: 1) design of novel, highly integrated, computational eyeglasses for tracking eye movements, the visual field of a user, and head movement patterns, all in real-time; 2) a unified compressive signal processing framework that optimizes sensing and estimation, while enabling re-targeting of the device to perform a broad range of tasks depending on the needs of an application; 3) design of a novel real-time visual context sensing system that extracts high-level contexts of interest from compressed data representations; and 4) a layer of intelligence that combines contexts extracted from the computational eyeglass together with contexts obtained from the mobile phone to improve energy-efficiency and sensing accuracy. This technology can revolutionize a range of disciplines including transportation, healthcare, behavioral science and market research. Continuous monitoring of the eye and field-of-view of an individual can enable detection of hazardous behaviors such as drowsiness while driving, mental health issues such as schizophrenia, addictive behavior and substance abuse, neurological disease progression, head injuries, and others. The research provides the foundations for such applications through the design of a prototype platform together with real-time sensor processing algorithms, and making these systems available through open source venues for broader use. Outreach for this project includes demonstrations of the device at science fairs for high-school students, and integration of the platform into undergraduate and graduate courses.

The project aims at making cities "smarter" by engineering processes such as traffic control, efficient parking services, and new urban activities such as recharging electric vehicles. To that end, the research will study the components needed to establish a Cyber-Physical Infrastructure for urban environments and address fundamental problems that involve data collection, resource allocation, real-time decision making, safety, and security. Accordingly, the research is organized along two main directions: (i) Sensing and data acquisition using a new mobile sensor network paradigm designed for urban environments; and (ii) Decision Support for the "Smart City" relying on formal verification and certification methods coupled with innovative dynamic optimization techniques used for decision making and resource allocation. The work will bring together and build upon methodological advances in optimization under uncertainty, computer simulation, discrete event and hybrid systems, control and games, system security, and formal verification and safety. Target applications include: a "Smart Parking" system where parking spaces are optimally assigned and reserved, and vehicular traffic regulation. The research has the potential of revolutionizing the way cities are viewed: from a passive living and working environment to a highly dynamic one with new ways to deal with transportation, energy, and safety. Teaming up with stakeholders in the Boston Back Bay neighborhood, the City of Boston, and private industry, the research team expects to establish new collaborative models between universities and urban groups for cutting-edge research embedded in the deployment of an exciting technological, economic, and sociological development.

This NSF Cyber-Physical Systems (CPS) Frontiers project "Foundations Of Resilient CybEr-physical Systems (FORCES)" focuses on the resilient design of large-scale networked CPS systems that directly interface with humans. FORCES aims to pr ovide comprehensive tools that allow the CPS designers and operators to combine resilient control (RC) algorithms with economic incentive (EI) schemes. Scientific Contributions The project is developing RC tools to withstand a wide-range of attacks and faults; learning and control algorithms which integrate human actions with spatio-temporal and hybrid dynamics of networked CPS systems; and model-based design to assure semantically consistent representations across all branches of the project. Operations of networked CPS systems naturally depend on the systemic social institutions and the individual deployment choices of the humans who use and operate them. The presence of incomplete and asymmetric information among these actors leads to a gap between the individually and socially optimal equilibrium resiliency levels. The project is developing EI schemes to reduce this gap. The core contributions of the FORCES team, which includes experts in control systems, game theory, and mechanism design, are the foundations for the co-design of RC and EI schemes and technological tools for implementing them. Expected Impacts Resilient CPS infrastructure is a critical National Asset. FORCES is contributing to the development of new Science of CPS by being the first project that integrates networked control with game theoretic tools and the economic incentives of human decision makers for resilient CPS design and operation. The FORCES integrated co-design philosophy is being validated on two CPS domains: electric power distribution and consumption, and transportation networks. These design prototypes are being tested in real world scenarios. The team's research efforts are being complemented by educational offerings on resilient CPS targeted to a large and diverse audience.

This NSF Cyber-Physical Systems (CPS) Frontiers project "Foundations Of Resilient CybEr-physical Systems (FORCES)" focuses on the resilient design of large-scale networked CPS systems that directly interface with humans. FORCES aims to pr ovide comprehensive tools that allow the CPS designers and operators to combine resilient control (RC) algorithms with economic incentive (EI) schemes. Scientific Contributions The project is developing RC tools to withstand a wide-range of attacks and faults; learning and control algorithms which integrate human actions with spatio-temporal and hybrid dynamics of networked CPS systems; and model-based design to assure semantically consistent representations across all branches of the project. Operations of networked CPS systems naturally depend on the systemic social institutions and the individual deployment choices of the humans who use and operate them. The presence of incomplete and asymmetric information among these actors leads to a gap between the individually and socially optimal equilibrium resiliency levels. The project is developing EI schemes to reduce this gap. The core contributions of the FORCES team, which includes experts in control systems, game theory, and mechanism design, are the foundations for the co-design of RC and EI schemes and technological tools for implementing them. Expected Impacts Resilient CPS infrastructure is a critical National Asset. FORCES is contributing to the development of new Science of CPS by being the first project that integrates networked control with game theoretic tools and the economic incentives of human decision makers for resilient CPS design and operation. The FORCES integrated co-design philosophy is being validated on two CPS domains: electric power distribution and consumption, and transportation networks. These design prototypes are being tested in real world scenarios. The team's research efforts are being complemented by educational offerings on resilient CPS targeted to a large and diverse audience.

The goal of this research is to develop fundamental theory, efficient algorithms, and realistic experiments for the analysis and design of safety-critical cyber-physical transportation systems with human operators. The research focuses on preventing crashes between automobiles at road intersections, since these account for about 40% of overall vehicle crashes. Specifically, the main objective of this work is to design provably safe driver-assist systems that understand driver's intentions and provide warnings/overrides to prevent collisions. In order to pursue this goal, hybrid automata models for the driver-vehicles-intersection system, incorporating driver behavior and performance as an integral part, are derived from human-factors experiments. A partial order of these hybrid automata models is constructed, according to confidence levels on the model parameters. The driver-assist design problem is then formulated as a set of partially ordered hybrid differential games with imperfect information, in which games are ordered according to parameter confidence levels. The resulting designs are validated experimentally in a driving simulator and in large-scale computer simulations. This research leverages the potential of embedded control and communication technologies to prevent crashes at traffic intersections, by enabling networks of smart vehicles to cooperate with each other, with the surrounding infrastructure, and with their drivers to make transportation safer, more enjoyable, and more efficient. The work is based on a collaboration among researchers in formal methods, autonomous control, and human factors who are studying realistic and provably correct warning/override algorithms that can be readily transitioned to production vehicles.

The objective of this research is to establish a foundational framework for smart grids that enables significant penetration of renewable DERs and facilitates flexible deployments of plug-and-play applications, similar to the way users connect to the Internet. The approach is to view the overall grid management as an adaptive optimizer to iteratively solve a system-wide optimization problem, where networked sensing, control and verification carry out distributed computation tasks to achieve reliability at all levels, particularly component-level, system-level, and application level. Intellectual merit. Under the common theme of reliability guarantees, distributed monitoring and inference algorithms will be developed to perform fault diagnosis and operate resiliently against all hazards. To attain high reliability, a trustworthy middleware will be used to shield the grid system design from the complexities of the underlying software world while providing services to grid applications through message passing and transactions. Further, selective load/generation control using Automatic Generation Control, based on multi-scale state estimation for energy supply and demand, will be carried out to guarantee that the load and generation in the system remain balanced. Broader impact. The envisioned architecture of the smart grid is an outstanding example of the CPS technology. Built on this critical application study, this collaborative effort will pursue a CPS architecture that enables embedding intelligent computation, communication and control mechanisms into physical systems with active and reconfigurable components. Close collaborations between this team and major EMS and SCADA vendors will pave the path for technology transfer via proof-of-concept demonstrations.

The national transmission networks that deliver high voltage electric power underpin our society and are central to the ongoing transformation of the American energy infrastructure. Transmission networks are very large and complicated engineering systems, and "keeping the lights on" as the transformation of the American energy infrastructure proceeds is a fundamental engineering challenge involving both the physical aspects of the equipment and the cyber aspects of the controls, communications, and computers that run the system. The project develops new principles of cyber-physical engineering by focusing on instabilities of electric power networks that can cause blackouts. It proposes novel approaches to analyze these instabilities and to design cyber-physical control methods to monitor, detect, and mitigate them. The controls must perform robustly in the presence of variability and uncertainty in electric generation, loads, communications, and equipment status, and during abnormal states caused by natural faults or malicious attacks. The research produces cyber-physical engineering methodologies that specifically help to mitigate power system blackouts and more generally show the way forward in designing robust cyber-physical systems in environments characterized by rich dynamics and uncertainty. Education and outreach efforts involve students at high school, undergraduate, and graduate levels, as well as dissemination of results to the public and the engineering and applied science communities in industry, government and universities.

This project, investigating active building facades that proactively contribute to energy conservation by changing their opacity and air permeability as a function of environmental and user parameters, promises to contribute strongly to both the cyber and physical sciences. Often energy is wasted when parts of a building are heated or cooled, but are not actually used, or when they are actively cooled if simply opening a window would suffice. The proposed "Self-Organizing Amorphous Facades" (SOAF) consist of a large number of identical cells that can each change their opacity and air permeability, sense light, temperature, and occupancy, and communicate with each other in a distributed collective. For complex cyber physical systems, this promises to provide a novel design methodology that is potentially applicable to a large class of systems and, therefore, will result in foundational knowledge of use to the community at large. This high-risk, high-reward project integrates ideas from computer science and engineering, with a little human physiology and environmental science thrown in, to develop new theoretical foundations for the design, validation, and improvement of coordination strategies for multi-agent robotic systems. The project's intellectual merit lies in novel algorithms that allow one to take advantage of distributed computation to drastically reduce the dimensionality of the data coming from the system, and novel algorithms that turn low-dimensional control data to the system into high-dimensional control signals. In particular, this research focuses on distributed algorithms that can identify regions that share similar spatio-temporal data, distributed algorithms that recognize patterns and gestures in spatio-temporal data sets, and distributed algorithms that automatically derive distributed policies for global control signals on temperature and light. Broader Impacts: The direct impact of this project will be huge potential reduction in the energy footprint of modern buildings by active lighting and ventilation control. A related impact is the introduction of novel ways of using space using truly reconfigurable walls. Due to its interdisciplinary nature spanning computer science and civil engineering together with its positive environment implications, this project is likely to be attractive to students with a broad range of backgrounds and interests. It will lead to educational modules that let students explore energy, heat transfer and solar gains in a building using sensors, wireless technologies, and algorithms, and introduce students to the challenges of complex cyber-physical systems. The PI proposes outreach to women and minorities and suggests a novel mechanism of comic distribution via HowToons.com that will make technical results and environmental impact of CPS accessible to a wide audience.

This project, holding a two-day workshop which will bring together experts from a wide range of disciplines to articulate the challenges involved in Vertical Farming, will invigorate the research community. Vertical Farming is an indoor, urban farming concept that solves many energy problems associated with outdoor farming. Recent implementations have shown very high yields in the production vegetables, including green peppers and tomatoes, spinach and lettuce. In many cases, water usage has been significantly reduced compared to traditional outdoor farming, and the conditions in which the crops are grown naturally shields them from unseasonal climate, and, from pests and diseases. In addition, Vertical Farming has the potential to generate fresher and healthier produce at reasonable cost. The proposed research has direct impact on the way the majority of the world's population lives. Agriculture impacts each and every one of us. Transformational technology is needed to meet the needs of simply feeding people in the coming decades. We need food to be safe such that it doesn't harm people because of the methods of cultivation used. Finally, agriculture has the potential to negatively impact the environment if not managed carefully and intentionally. This workshop will impact the way that crops are grown in the future, producing safe food, with a low environmental footprint.

This project, investigating formal languages as a general methodology for task transfer between distinct cyber-physical systems such as humans and robots, aims to expand the science of cyber physical systems by developing Motion Grammars that will enable task transfer between distinct systems. Formal languages are tools for encoding, describing and transferring structured knowledge. In natural language, the latter process is called communication. Similarly, we will develop a formal language through which arbitrary cyber-physical systems communicate tasks via structured actions. This investigation of Motion Grammars will contribute to the science of human cognition and the engineering of cyber-physical algorithms. By observing human activities during manipulation we will develop a novel class of hybrid control algorithms based on linguistic representations of task execution. These algorithms will broaden the capabilities of man-made systems and provide the infrastructure for motion transfer between humans, robots and broader systems in a generic context. Furthermore, the representation in a rigorous grammatical context will enable formal verification and validation in future work. Broader Impacts: The proposed research has direct applications to new solutions for manufacturing, medical treatments such as surgery, logistics and food processing. In turn, each of these areas has a significant impact on the efficiency and convenience of our daily lives. The PIs serve as coordinators of graduate/undergraduate programs and mentors to community schools. In order to guarantee that women and minorities have a significant role in the research, the PIs will annually invite K-12 students from Atlanta schools with primarily African American populations to the laboratories. One-day robot classes will be conducted that engage students in the excitement of hands-on science by interactively using lab equipment to transfer their manipulation skills to a robot arm.