Data-driven intelligence is an essential foundation for physical systems in transportation safety and efficiency, area surveillance and security, as well as environmental sustainability. This project develops new computer system infrastructure and algorithms for self-sustainable data-driven systems in the field. Research outcomes of the project include (a) a low-maintenance, environmentally-friendly hardware platform with solar energy harvesting and super capacitor-based energy storage, (b) virtualization software infrastructure for low-power nodes to enable inter-operability among distributed field nodes and from/to the data center, and (c) new image and data processing approaches for resource-adaptive fidelity adjustment and function partitioning. The synergy between the self-sustainable hardware, system software support, wireless communications management, and application data processing manifests through global coordination for quality-of-service, energy efficiency, and data privacy. In broader impacts, this project enables data-driven intelligence in the field for important physical system domains. Integration of the technologies involved is accomplished through real-world system deployment and experimentation, including an intelligent campus traffic and parking management system and collaborative work with industry collaborators. The results of this project will further enhance the technological competitiveness for US industries in key areas such as intelligent transportation. The education component includes cross-disciplinary curriculum enhancements and the development of a new instructional platform for realistic experiments with cyber-physical systems. Within the scope of this project, the PIs perform mentoring and outreach activities to recruit/retain women and minorities in science and engineering.

Continuous real-time tracking of the eye and field-of-view of an individual is profoundly important to understanding how humans perceive and interact with the physical world. This work advances both the technology and engineering of cyber-physical systems by designing an innovative paradigm involving next-generation computational eyeglasses that interact with a user's mobile phone to provide the capability for real-time visual context sensing and inference. This research integrates novel research into low-power embedded systems, image representation, image processing and machine learning, and mobile sensing and inference, to advance the state-of-art in continuous sensing for CPS applications. The activity addresses several fundamental research challenges including: 1) design of novel, highly integrated, computational eyeglasses for tracking eye movements, the visual field of a user, and head movement patterns, all in real-time; 2) a unified compressive signal processing framework that optimizes sensing and estimation, while enabling re-targeting of the device to perform a broad range of tasks depending on the needs of an application; 3) design of a novel real-time visual context sensing system that extracts high-level contexts of interest from compressed data representations; and 4) a layer of intelligence that combines contexts extracted from the computational eyeglass together with contexts obtained from the mobile phone to improve energy-efficiency and sensing accuracy. This technology can revolutionize a range of disciplines including transportation, healthcare, behavioral science and market research. Continuous monitoring of the eye and field-of-view of an individual can enable detection of hazardous behaviors such as drowsiness while driving, mental health issues such as schizophrenia, addictive behavior and substance abuse, neurological disease progression, head injuries, and others. The research provides the foundations for such applications through the design of a prototype platform together with real-time sensor processing algorithms, and making these systems available through open source venues for broader use. Outreach for this project includes demonstrations of the device at science fairs for high-school students, and integration of the platform into undergraduate and graduate courses.

Effective engineering of complex devices often depends critically on the ability to encapsulate responsibility for tasks into modular agents and ensure those agents communicate with one another in well-defined and easily observable ways. When such conditions are followed, it becomes possible to detect where problems lie so they can be corrected. It also becomes possible to optimize the agents and their communications to improve performance. Cyber-physical systems (like robots, self-piloting aircraft, etc.) modify themselves to improve performance break those conditions in that some agent modules negotiate their own communications and decide their own actions, sometimes taking advantage of the physics of the world in ways we did not anticipate. This renders difficult application of standard engineering tools to accomplish critical fault diagnosis and design optimization. This project will produce analysis methods address the specific needs of cyber-physical systems that, by their natures, break the rules of convention. We will apply these new methods to the design and analysis of self-improving controllers for flapping-wing micro air vehicles. This work will provide advances in both model-checking related formal design methodologies and in module-based self-adaptive control in computationally resource constrained cyber-physical systems. The formal methods advances will significantly expand our ability to properly design and verify systems that tightly couple computation, sensors, and actuators. The specific test application addressed is significant to a number of nationally important security and defense efforts and will directly impact identified national priorities.