One of the challenges for the future cyber-physical systems is the exploration of large design spaces. Evolutionary algorithms (EAs), which embody a simplified computational model of the mutation and selection mechanisms of natural evolution, are known to be effective for design optimization. However, the traditional formulations are limited to choosing values for a predetermined set of parameters within a given fixed architecture. This project explores techniques, based on the idea of hidden genes, which enable EAs to select a variable number of components, thereby expanding the explored design space to include selection of a system's architecture. Hidden genetic optimization algorithms have a broad range of potential applications in cyber-physical systems, including automated construction systems, transportation systems, micro-grid systems, and space systems. The project integrates education with research by involving students ranging from high school through graduate school in activities commensurate with their skills, and promotes dissemination of the research results through open source distribution of algorithm implementation code and participation in the worldwide Global Trajectory Optimization Competition. Instead of using a single layer of coding to represent the variables of the system in current EAs, this project investigates adding a second layer of coding to enable hiding some of the variables, as needed, during the search for the optimal system's architecture. This genetic hiding concept is found in nature and provides a natural way of handling system architectures covering a range of different sizes in the design space. In addition, the standard mutation and selection operations in EAs will be replaced by new operations that are intended to extract the full potential of the hidden gene model. Specific applications include space mission design, microgrid optimization, and traffic network signal coordinated planning.

1446582 (Shroff) and 1446478 (Hou). Buildings in the U.S. contribute to 39% of energy use, consume approximately 70% of the electricity, and account for 39% of CO2 emissions. Hence, developing green building architectures is an extremely critical component in energy sustainability. The investigators will develop a unified analytical approach for green building design that comprehensively manages energy sustainability by taking into account the complex interactions between these systems of systems, providing a high degree of security, agility and robust to extreme events. The project will serve to advance the general science in CPS, help bridge the gap between the cyber and civil infrastructure communities, educate students across different disciplines, include topics in curriculum development, and actively recruit underrepresented minority and undergraduate students. The main thesis of this research is that ad hoc green energy designs are often myopic, not taking into account key interdependencies between subsystems and users, and thus often lead to undesirable solutions. In fact, studies have shown that 28%-35% of LEED-certified buildings consumed more energy than their conventional counterparts, all of which calls for the development of a comprehensive analytical foundation for designing green buildings. In particular, the investigators will focus on three interrelated thrust areas: (i) Integrated energy management for a single-building, where the goal is to jointly consider the complex interactions among building subsystems. The investigators will develop novel control schemes that opportunistically exploit the energy demand elasticity of the building subsystems and adapt to occupancy patterns, human comfort zones, and ambient environments. (ii) Managing multi-building interactions to develop (near) optimal distributed control and coordination schemes that provide performance guarantees. (iii) Designing for anomalous conditions such as extreme weather and malicious attacks, where power grid connections and/or cyber-networks are disrupted. The research will provide directions at developing an analytical foundation and cross-cutting principles that will shed insight on the design and control of not only building systems, but also general CPS systems. An important goal is to help bridge the gap between the networking, controls, and civil infrastructure communities by giving talks and publishing works in all of these forums. The investigators will disseminate the research findings to industry as well as offer education and outreach programs to the K-12 students in STEM disciplines. The investigators will also actively continue their already strong existing efforts in recruiting women and underrepresented minorities, as well as providing rich research experience to undergraduate REU students. This project will provide fertile training for students spanning civil infrastructure research, networking, controls, optimization, and algorithmic development. The investigators will also actively include the outcomes of the research in existing and new courses at both the Ohio State University and Virginia Tech.

Large battery systems with 100s/1000s cells are being used to power various physical platforms. For example, automobiles are transitioning from conventional powertrains to (plug-in) hybrid and electric vehicles (EVs). To achieve the desired efficiency of EVs, significant improvements are needed in the architecture and algorithms of battery management. This project will develop a new comprehensive battery management architecture, called Smart Battery Management System (SBMS). The research is expected to bridge the wide gap existing between cyber-physical system (CPS) research and electrification industry communities, provide environment-friendly solutions, increase the awareness of CPS, and develop skilled human resources. This project will incorporate and enhance a battery management system (BMS) by including battery state-of-charge (SoC) and state-of-health (SoH) algorithms as well as power management strategies on both pack and cell levels. Specifically, it consists of five main research tasks: (i) design a dynamically reconfigurable energy storage system to tolerate harsh internal and external stresses; (ii) develop cell-level thermal management algorithms; (iii) develop efficient, dependable charge and discharge scheduling algorithms in hybrid energy storage systems; (iv) develop a comprehensive, diagnostic/prognostic (P/D) algorithm with system parameters adjusted for making optimal decisions; and (v) build a testbed and evaluate the proposed architecture and algorithms on the testbed. This research will advance the state-of-the-art in the management of large-scale energy storage systems, extending their life and operation-time significantly, which is key to a wide range of battery-powered physical platforms. That is, SBMS will enable batteries to withstand excessive stresses and power physical platforms for a much longer time, all at low costs. SBMS will also serve as a basic framework for various aspects of CPS research, integrating (cyber) dynamic control and P/D mechanisms, and (physical) energy storage system dynamics.

This project will design next-generation defense mechanisms to protect critical infrastructures, such as power grids, large industrial plants, and water distribution systems. These critical infrastructures are complex primarily due to the integration of cyber and physical components, the presence of high-order behaviors and functions, and an intricate and large interconnection pattern. Malicious attackers can exploit the complexity of the infrastructure, and compromise a system's functionality through cyber attacks (that is hacking into the computation and communication systems) and/or physical attacks (tampering with the actuators, sensors and the control system). This work will develop mathematical models of critical infrastructures and attacks, develop intelligent control-theoretic security mechanisms, and validate the findings on an industry-accredited simulation platform. This project will directly impact national security and economic competitiveness, and the results will be available and useful to utility companies. To accompany the scientific advances, the investigators will also engage in educational efforts to bring this research to the classroom at UCR, and will disseminate their results via scientific publications. The work will also create several opportunities for undergraduate and graduate students to engage in research at UCR, one of the nation's most ethnically diverse research-intensive institutions. This study encompasses theoretical, computational, and experimental research at UCR aimed at characterizing vulnerabilities of complex cyber-physical systems, with a focus on electric power networks, and control-theoretic defense mechanisms to ensure protection and graceful performance degradation against accidental faults and malicious attacks. This project proposes a transformative approach to cyber-physical security, which builds on a unified control-theoretic framework to model cyber-physical systems, attacks, and defense strategies. This project will undertake three main research initiatives ranging from fundamental scientific and engineering research to analysis using industry-accepted simulation tools: (1) modeling and analysis of cyber-physical attacks, and their impact on system stability and performance; (2) design of monitors to reveal and distinguish between accidental and malignant contingencies; and (3) synthesis of adaptive defense strategies for stochastic and highly dynamic cyber-physical systems. Results will first be characterized from a pure control-theoretic perspective with focus on stochastic, switching, and dynamic cyber-physical systems, so as to highlight fundamental research challenges, and then specialized for the case of smart grid, so as to clarify the implementation of monitors, attacks, and defense strategies. The findings and strategies will be validated for the case of power networks by using the RTDS simulation system, which is an industry-accredited tool for real-time tests of dynamic behavior, faults, attacks, monitoring systems, and defensive strategies.

U.S. economic growth, energy security, and environmental stewardship depend on a sustainable energy policy that promotes conservation,efficiency, and electrification across all major sectors. Buildings are the largest sector and therefore an attractive target of these efforts: current Federal sustainability goals mandate that 50% of U.S.commercial buildings become net-zero energy by 2050. A range of options exists to achieve this goal, but financial concerns require a data-driven, empirically-validated approach. However, critical gaps exist in the energy and water measurement technology, and indoorclimate control science, needed to benchmark competing options, prioritize efficiency investments, and ensure occupant comfort. To address these challenges, this project proposes a new kind of "peel-and-stick" sensor that can be affixed to everyday objects to infer their contributions to whole-building resource consumption. To use the sensors, occupants or building managers simply tag end loads like a ceiling light, shower head, or range top. The sensors monitor the ambient conditions around a load and, using statistical methods,correlate those conditions with readings from existing electricity, gas, or water meters, providing individual estimates without intrusive metering. The sensors are built from integrated circuit technology laminated into smart labels, so they are small, inexpensive, and easy-to-deploy. The sensors are powered by the same ambient signals they sense, eliminating the need for periodic battery replacement or wall power. Collectively, these properties address cost and coverage challenges, and enable scalable deployment and widespread adoption. The intellectual merit of this proposal stems from the insight that the transfer and use of energy (and other resources) usually emits energy, often in a different domain, and that this emitted energy is often enough to intermittently power simple, energy-harvesting sensors whose duty cycle is proportional to the energy being transferred or used. Hence, the mere activation rate of the sensors signalsthe underlying energy use. The power-proportional relationship between usage activity and side channel harvesting, when coupled with state-of-the art, millimeter-scale, nano-power chips and whole-house or panel-level meters, enables small and inexpensive sensor tags that are pervasively distributed with unbounded lifetimes. But, networking and tasking them, and making sense of their data, requires a fundamental rethinking of low-power communications, control, and data fusion to abstract the intermittent, unreliable, and noisy sensor infrastructure into actionable information. This project's broader impact stems from an integrated program of education, research, and outreach that (i) creates a smart objects focused curriculum whose classroom projects are motivated by research needs, (ii) provides research experiences for undergraduates and underrepresented minorities, (iii) mentors students on all aspects of successful research from articulating hypotheses to peer-reviewing papers,(iv) disseminates teaching materials on embedded systems and research pedagogy, (v) produces students who bridge disciplines,operating at the intersection of measurement science, information technology, and sustainability policy, and (vi) translates scientific discovery and technical knowledge into beneficial commercial products through industry outreach and internships, and (vii) engages with the National Labs to ensure that the research addresses pressing problems.

The goal of this project is to establish a theoretical and empirical foundation for secured and efficient energy resource management in the smart grid - a typical energy-based cyber-physical system and the future critical energy infrastructure for the nation. However, as a large distributed and complex system, the smart grid inherently operates under the presence of various uncertainties, which can be raised from natural disasters, malicious attacks, distributed renewable energy resources, plug-in electrical vehicles, habits of energy usage, and weather. These uncertainties make the development of a secured and efficient energy resource management system challenging. To address this challenging problem, a novel modeling framework and techniques to deal with these uncertainties will be developed. Threats and their impact on both system operations and end users will be studied and effective defensive schemes will be developed. The outcomes of this project will have broader impacts on the higher education system and national economy and will provide a scientific foundation for designing a secured and efficient energy-based critical infrastructure. The contributions of this project include: a theoretical framework, techniques, and toolkits for smart grid research and education. Specifically, a modeling framework for secured and efficient energy resource management will be developed to quantify uncertainties from both the cyber and physical power grids. Techniques based on statistical modeling, data mining, forecasting, and others will be developed to manage energy resources efficiently. Based on the developed framework, the space of attacks against system operations and end users from key function modules, attack venue, abilities of adversaries, and system knowledge will be studied systematically. Based on the deep understanding of attacks, novel schemes to prevent, detect, and attribute attacks will be developed. An integrated cyber and physical power grid simulation tool and testbed will be developed to evaluate the proposed modeling framework and techniques using realistic scenarios. This project will integrate research, education, and outreach. The outcomes of the project will be integrated into curriculum development and provide research and educational opportunities for both graduate and undergraduate students, including underrepresented minorities and CyberCorps: Scholarship for Service students.

This project focuses on the problem of information acquisition, state estimation and control in the context of cyber physical systems. In our underlying model, a (set of) decision maker(s), by controlling a sequence of actions with uncertain outcomes, dynamically refines the belief about stochastically time-varying parameters of interest. These parameters are then used to control the physical system efficiently and robustly. Here the cyber system collects, processes, and acquires information about the underlying physical system of interest, which is used for its control. The proposed work will develop a new theoretical framework for stochastic learning, decision-making, and control in stochastically-varying cyber physical systems. In order to obtain analytical insights into the structure of efficient design, we first consider the case where the actions of the cyber system only affect the estimate of the underlying physical system. This class of problems arises in the context of (distributed) sensing/tracking of a physical system in isolation from cyber system control of the physical system's state. Joint state estimation and control for cyber-physical systems will then be considered. Here the most natural first step is to obtain sufficient conditions and/or special classes of systems where a separated approach to the information acquisition and efficient control is (near) optimal. To demonstrate its utility in practice, our theoretical framework will be applied in the specific context of energy efficient control of data centers and robust control of the smart grid under limited sensing. The intellectual merit of this work will be to develop a theoretical framework for the design of cyber-physical systems including information acquisition, state estimation, and control. In addition, separation theorems for the optimality of separate state estimation and control will be explored. In terms of broader impacts, significant performance improvement of control systems closed over communication networks will impact a wide range of applications for societal benefit, including smart buildings, intelligent transportation systems, energy-efficient data centers, and the future smart-grid. The PIs plan to disseminate the research results widely through conferences and journals, as well as by organizing specialized workshops and conference sessions related to cyber physical systems. The proposed project will train Ph.D. students as well as enrich the curriculum taught by the PIs in communications, stochastic control, and networks. The PIs have a strong track record in diversity and outreach activities, which for this project will include exposure and involvement of high school and undergraduate students, including under-represented minorities and women.

This project investigates new reinforcement learning algorithms to enable long-term real-time autonomous learning by cyber-physical systems (CPS). The complexity of CPS makes hand-programming safe and efficient controllers for them difficult. For CPS to meet their potential, they need methods that enable them to learn and adapt to novel situations that they were not programmed for. Reinforcement learning (RL) is a paradigm for learning sequential decision making processes with potential for solving this problem. However, existing RL algorithms do not meet all of the requirements of learning in CPS. Efficacy of the new algorithms for CPS is evaluated in the context of smart buildings and autonomous vehicles. Cyber-physical systems (CPS) have the potential to revolutionize society by enabling smart buildings, transportation, medical technology, and electric grids. Success of this project could lead to a new generation of CPS that are capable of adapting to their situation and improving their performance autonomously over time. In addition to the traditional methods of dissemination, this project will develop and release open-source code implementing the new reinforcement learning algorithms. Education and outreach activities associated with the project include a Freshman Research Initiative course, participation in a UT Austin annual open house that draws in many underrepresented minorities to interest the public in computer science and science in general, and the department's annual summer school for high school girls called First Bytes.

This project focuses on the problem of information acquisition, state estimation and control in the context of cyber physical systems. In our underlying model, a (set of) decision maker(s), by controlling a sequence of actions with uncertain outcomes, dynamically refines the belief about stochastically time-varying parameters of interest. These parameters are then used to control the physical system efficiently and robustly. Here the cyber system collects, processes, and acquires information about the underlying physical system of interest, which is used for its control. The proposed work will develop a new theoretical framework for stochastic learning, decision-making, and control in stochastically-varying cyber physical systems. In order to obtain analytical insights into the structure of efficient design, we first consider the case where the actions of the cyber system only affect the estimate of the underlying physical system. This class of problems arises in the context of (distributed) sensing/tracking of a physical system in isolation from cyber system control of the physical system's state. Joint state estimation and control for cyber-physical systems will then be considered. Here the most natural first step is to obtain sufficient conditions and/or special classes of systems where a separated approach to the information acquisition and efficient control is (near) optimal. To demonstrate its utility in practice, our theoretical framework will be applied in the specific context of energy efficient control of data centers and robust control of the smart grid under limited sensing. The intellectual merit of this work will be to develop a theoretical framework for the design of cyber-physical systems including information acquisition, state estimation, and control. In addition, separation theorems for the optimality of separate state estimation and control will be explored. In terms of broader impacts, significant performance improvement of control systems closed over communication networks will impact a wide range of applications for societal benefit, including smart buildings, intelligent transportation systems, energy-efficient data centers, and the future smart-grid. The PIs plan to disseminate the research results widely through conferences and journals, as well as by organizing specialized workshops and conference sessions related to cyber physical systems. The proposed project will train Ph.D. students as well as enrich the curriculum taught by the PIs in communications, stochastic control, and networks. The PIs have a strong track record in diversity and outreach activities, which for this project will include exposure and involvement of high school and undergraduate students, including under-represented minorities and women.

The electric power grid is a complex cyber-physical system, whose reliable and secure operation is of paramount importance to national security and economic vitality. There is a growing and evolving threat of cyber-based attacks, both in numbers and sophistication, on the nation's critical infrastructure. Therefore, cyber security "encompassing attack prevention, detection, mitigation, and resilience" is critical in today's power grid and the emerging smart grid. The goal of this project is to develop a unified system-theoretic framework and analytical tools for cyber-physical security of power systems, capturing the dynamics of the physical system as well as that of the cyber system. Research tasks include: 1) Development of a methodology for impact analysis that includes systematic identification of worst-case stealthy attacks on the power system's wide-area control and evaluating the resulting consequences in terms of stability violations and performance loss. 2) Development of robust cyber-physical countermeasures, employing a combination of methods from system theory, cyber security, and model-based/data-driven tools, in the form of domain-specific anomaly detection/tolerance algorithms and attack-resilient control algorithms. 3) Evaluating the effectiveness of the proposed impact modeling and mitigation algorithms through a combination of simulation and testbed-based evaluations, using realistic system topologies and attack scenarios. The project makes significant contributions to enhance the security and resiliency of the power grid and lays a scientific foundation for cyber-physical security of critical infrastructure. Also, the project develops novel curriculum modules, mentors graduate and undergraduate students including under-represented minorities, leverages industrial collaborations, and exposes high school students to cyber security concepts.