Continuous real-time tracking of the eye and field-of-view of an individual is profoundly important to understanding how humans perceive and interact with the physical world. This work advances both the technology and engineering of cyber-physical systems by designing an innovative paradigm involving next-generation computational eyeglasses that interact with a user's mobile phone to provide the capability for real-time visual context sensing and inference. This research integrates novel research into low-power embedded systems, image representation, image processing and machine learning, and mobile sensing and inference, to advance the state-of-art in continuous sensing for CPS applications. The activity addresses several fundamental research challenges including: 1) design of novel, highly integrated, computational eyeglasses for tracking eye movements, the visual field of a user, and head movement patterns, all in real-time; 2) a unified compressive signal processing framework that optimizes sensing and estimation, while enabling re-targeting of the device to perform a broad range of tasks depending on the needs of an application; 3) design of a novel real-time visual context sensing system that extracts high-level contexts of interest from compressed data representations; and 4) a layer of intelligence that combines contexts extracted from the computational eyeglass together with contexts obtained from the mobile phone to improve energy-efficiency and sensing accuracy. This technology can revolutionize a range of disciplines including transportation, healthcare, behavioral science and market research. Continuous monitoring of the eye and field-of-view of an individual can enable detection of hazardous behaviors such as drowsiness while driving, mental health issues such as schizophrenia, addictive behavior and substance abuse, neurological disease progression, head injuries, and others. The research provides the foundations for such applications through the design of a prototype platform together with real-time sensor processing algorithms, and making these systems available through open source venues for broader use. Outreach for this project includes demonstrations of the device at science fairs for high-school students, and integration of the platform into undergraduate and graduate courses.

Large-scale critical infrastructure systems, including energy and transportation networks, comprise millions of individual elements (human, software and hardware) whose actions may be inconsequential in isolation but profoundly important in aggregate. The focus of this project is on the coordination of these elements via ubiquitous sensing, communications, computation, and control, with an emphasis on the electric grid. The project integrates ideas from economics and behavioral science into frameworks grounded in control theory and power systems. Our central construct is that of a ?resource cluster,? a collection of distributed resources (ex: solar PV, storage, deferrable loads) that can be coordinated to efficiently and reliably offer services (ex: power delivery) in the face of uncertainty (ex: PV output, consumer behavior). Three topic areas form the core of the project: (a) the theoretical foundations for the ?cluster manager? concept and complementary tools to characterize the capabilities of a resource cluster; (b) centralized resource coordination strategies that span multiple time scales via innovations in stochastic optimal control theory; and (c) decentralized coordination strategies based on cluster manager incentives and built upon foundations of non-cooperative dynamic game theory. These innovations will improve the operation of infrastructure systems via a cyber-physical-social approach to the problem of resource allocation in complex infrastructures. By transforming the role of humans from passive resource recipients to active participants in the electric power system, the project will facilitate energy security for the nation, and climate change mitigation. The project will also engage K-12 students through lab-visits and lectures; address the undergraduate demand for power systems training through curricular innovations at the intersection of cyber-systems engineering and physical power systems; and equip graduate students with the multi-disciplinary training in power systems, communications, control, optimization and economics to become leaders in innovation.