Despite many advances in vehicle automation, much remains to be done: the best autonomous vehicle today still lags behind human drivers, and connected vehicle (V2V) and infrastructure (V2I) standards are only just emerging. In order for such cyber-physical systems to fully realize their potential, they must be capable of exploiting one of the richest and most complex abilities of humans, which we take for granted: seeing and understanding the visual world. If automated vehicles had this ability, they could drive more intelligently, and share information about road and environment conditions, events, and anomalies to improve situational awareness and safety for other automated vehicles as well as human drivers. That is the goal of this project, to achieve a synergy between computer vision, machine learning and cyber-physical systems that leads to a safer, cheaper and smarter transportation sector, and which has potential applications to other sectors including agriculture, food quality control and environment monitoring. To achieve this goal, this project brings together expertise in computer vision, sensing, embedded computing, machine learning, big data analytics and sensor networks to develop an integrated edge-cloud architecture for (1) "anytime scene understanding" to unify diverse scene understanding methods in computer vision, and (2) "cooperative scene understanding" that leverages vehicle-to-vehicle and vehicle-to-infrastructure protocols to coordinate with multiple systems, while (3) emphasizing how security and privacy should be managed at scale without impacting overall quality-of-service. This architecture can be used for autonomous driving and driver-assist systems, and can be embedded within infrastructure (digital signs, traffic lights) to avoid traffic congestion, reduce risk of pile-ups and improve situational awareness. Validation and transition of the research to practice are through integration within City of Pittsburgh public works department vehicles, Carnegie Mellon University NAVLAB autonomous vehicles, and across the smart road infrastructure corridor under development in Pittsburgh. The project also includes activities to foster development of a new cyber-physical systems workforce, though involvement of students in the research, co-taught multi-disciplinary courses, and co-organized workshops.

Recent developments in nanotechnology and synthetic biology have enabled a new direction in biological engineering: synthesis of collective behaviors and spatio-temporal patterns in multi-cellular bacterial and mammalian systems. This will have a dramatic impact in such areas as amorphous computing, nano-fabrication, and, in particular, tissue engineering, where patterns can be used to differentiate stem cells into tissues and organs. While recent technologies such as tissue- and organoid on-a-chip have the potential to produce a paradigm shift in tissue engineering and drug development, the synthesis of user-specified, emergent behaviors in cell populations is a key step to unlock this potential and remains a challenging, unsolved problem. This project brings together synthetic biology and micron-scale mobile robotics to define the basis of a next-generation cyber-physical system (CPS) called biological CPS (bioCPS). Synthetic gene circuits for decision making and local communication among the cells are automatically synthesized using a Bio-Design Automation (BDA) workflow. A Robot Assistant for Communication, Sensing, and Control in Cellular Networks (RA), which is designed and built as part of this project, is used to generate desired patterns in networks of engineered cells. In RA, the engineered cells interact with a set of micro-robots that implement control, sensing, and long-range communication strategies needed to achieve the desired global behavior. The micro-robots include both living and non-living matter (engineered cells attached to inorganic substrates that can be controlled using externally applied fields). This technology is applied to test the formation of various patterns in living cells. The project has a rich education and outreach plan, which includes nationwide activities for CPS education of high-school students, lab tours and competitions for high-school and undergraduate students, workshops, seminars, and courses for graduate students, as well as specific initiatives for under-represented groups. Central to the project is the development of theory and computational tools that will significantly advance that state of the art in CPS at large. A novel, formal methods approach is proposed for synthesis of emergent, global behaviors in large collections of locally interacting agents. In particular, a new logic whose formulas can be efficiently learned from quad-tree representations of partitioned images is developed. The quantitative semantics of the logic maps the synthesis of local control and communication protocols to an optimization problem. The project contributes to the nascent area of temporal logic inference by developing a machine learning method to learn temporal logic classifiers from large amounts of data. Novel abstraction and verification techniques for stochastic dynamical systems are defined and used to verify the correctness of the gene circuits in the BDA workflow.

Recent developments in nanotechnology and synthetic biology have enabled a new direction in biological engineering: synthesis of collective behaviors and spatio-temporal patterns in multi-cellular bacterial and mammalian systems. This will have a dramatic impact in such areas as amorphous computing, nano-fabrication, and, in particular, tissue engineering, where patterns can be used to differentiate stem cells into tissues and organs. While recent technologies such as tissue- and organoid on-a-chip have the potential to produce a paradigm shift in tissue engineering and drug development, the synthesis of user-specified, emergent behaviors in cell populations is a key step to unlock this potential and remains a challenging, unsolved problem. This project brings together synthetic biology and micron-scale mobile robotics to define the basis of a next-generation cyber-physical system (CPS) called biological CPS (bioCPS). Synthetic gene circuits for decision making and local communication among the cells are automatically synthesized using a Bio-Design Automation (BDA) workflow. A Robot Assistant for Communication, Sensing, and Control in Cellular Networks (RA), which is designed and built as part of this project, is used to generate desired patterns in networks of engineered cells. In RA, the engineered cells interact with a set of micro-robots that implement control, sensing, and long-range communication strategies needed to achieve the desired global behavior. The micro-robots include both living and non-living matter (engineered cells attached to inorganic substrates that can be controlled using externally applied fields). This technology is applied to test the formation of various patterns in living cells. The project has a rich education and outreach plan, which includes nationwide activities for CPS education of high-school students, lab tours and competitions for high-school and undergraduate students, workshops, seminars, and courses for graduate students, as well as specific initiatives for under-represented groups. Central to the project is the development of theory and computational tools that will significantly advance that state of the art in CPS at large. A novel, formal methods approach is proposed for synthesis of emergent, global behaviors in large collections of locally interacting agents. In particular, a new logic whose formulas can be efficiently learned from quad-tree representations of partitioned images is developed. The quantitative semantics of the logic maps the synthesis of local control and communication protocols to an optimization problem. The project contributes to the nascent area of temporal logic inference by developing a machine learning method to learn temporal logic classifiers from large amounts of data. Novel abstraction and verification techniques for stochastic dynamical systems are defined and used to verify the correctness of the gene circuits in the BDA workflow.

This project represents a cross-disciplinary collaborative research effort on developing rigorous, closed-loop approaches for designing, simulating, and verifying medical devices. The work will open fundamental new approaches for radically accelerating the pace of medical device innovation, especially in the sphere of cardiac-device design. Specific attention will be devoted to developing advanced formal methods-based approaches for analyzing controller designs for safety and effectiveness; and devising methods for expediting regulatory and other third-party reviews of device designs. The project team includes members with research backgrounds in computer science, electrical engineering, biophysics, and cardiology; the PIs will use a coordinated approach that balances theoretical, experimental and practical concerns to yield results that are intended to transform the practice of device design while also facilitating the translation of new cardiac therapies into practice. The proposed effort will lead to significant advances in the state of the art for system verification and cardiac therapies based on the use of formal methods and closed-loop control and verification. The animating vision for the work is to enable the development of a true in silico design methodology for medical devices that can be used to speed the development of new devices and to provide greater assurance that their behaviors match designers' intentions, and to pass regulatory muster more quickly so that they can be used on patients needing their care. The scientific work being proposed will serve this vision by providing mathematically robust techniques for analyzing and verifying the behavior of medical devices, for modeling and simulating heart dynamics, and for conducting closed-loop verification of proposed therapeutic approaches. The acceleration in medical device innovation achievable as a result of the proposed research will also have long-term and sustained societal benefits, as better diagnostic and therapeutic technologies enter into the practice of medicine more quickly. It will also yield a collection of tools and techniques that will be applicable in the design of other types of devices. Finally, it will contribute to the development of human resources and the further inclusion of under-represented groups via its extensive education and outreach programs, including intensive workshop experiences for undergraduates.

1446582 (Shroff) and 1446478 (Hou). Buildings in the U.S. contribute to 39% of energy use, consume approximately 70% of the electricity, and account for 39% of CO2 emissions. Hence, developing green building architectures is an extremely critical component in energy sustainability. The investigators will develop a unified analytical approach for green building design that comprehensively manages energy sustainability by taking into account the complex interactions between these systems of systems, providing a high degree of security, agility and robust to extreme events. The project will serve to advance the general science in CPS, help bridge the gap between the cyber and civil infrastructure communities, educate students across different disciplines, include topics in curriculum development, and actively recruit underrepresented minority and undergraduate students. The main thesis of this research is that ad hoc green energy designs are often myopic, not taking into account key interdependencies between subsystems and users, and thus often lead to undesirable solutions. In fact, studies have shown that 28%-35% of LEED-certified buildings consumed more energy than their conventional counterparts, all of which calls for the development of a comprehensive analytical foundation for designing green buildings. In particular, the investigators will focus on three interrelated thrust areas: (i) Integrated energy management for a single-building, where the goal is to jointly consider the complex interactions among building subsystems. The investigators will develop novel control schemes that opportunistically exploit the energy demand elasticity of the building subsystems and adapt to occupancy patterns, human comfort zones, and ambient environments. (ii) Managing multi-building interactions to develop (near) optimal distributed control and coordination schemes that provide performance guarantees. (iii) Designing for anomalous conditions such as extreme weather and malicious attacks, where power grid connections and/or cyber-networks are disrupted. The research will provide directions at developing an analytical foundation and cross-cutting principles that will shed insight on the design and control of not only building systems, but also general CPS systems. An important goal is to help bridge the gap between the networking, controls, and civil infrastructure communities by giving talks and publishing works in all of these forums. The investigators will disseminate the research findings to industry as well as offer education and outreach programs to the K-12 students in STEM disciplines. The investigators will also actively continue their already strong existing efforts in recruiting women and underrepresented minorities, as well as providing rich research experience to undergraduate REU students. This project will provide fertile training for students spanning civil infrastructure research, networking, controls, optimization, and algorithmic development. The investigators will also actively include the outcomes of the research in existing and new courses at both the Ohio State University and Virginia Tech.

Computer systems are increasingly coming to be relied upon to augment or replace human operators in controlling mechanical devices in contexts such as transportation systems, chemical plants, and medical devices, where safety and correctness are critical. A central problem is how to verify that such partially automated or fully autonomous cyber-physical systems (CPS) are worthy of our trust. One promising approach involves synthesis of the computer implementation codes from formal specifications, by software tools. This project contributes to this "correct-by-construction" approach, by developing scalable, automated methods for the synthesis of control protocols with provable correctness guarantees, based on insights from models of human behavior. It targets: (i) the gap between the capabilities of today's hardly autonomous, unmanned systems and the levels of capability at which they can make an impact on our use of monetary, labor, and time resources; and (ii) the lack of computational, automated, scalable tools suitable for the specification, synthesis and verification of such autonomous systems. The research is based on study of modular reinforcement learning-based models of human behavior derived through experiments designed to elicit information on how humans control complex interactive systems in dynamic environments, including automobile driving. Architectural insights and stochastic models from this study are incorporated with a specification language based on linear temporal logic, to guide the synthesis of adaptive autonomous controllers. Motion planning and other dynamic decision-making are by algorithms based on computational engines that represent the underlying physics, with provision for run-time adaptation to account for changing operational and environmental conditions. Tools implementing this methodology are validated through experimentation in a virtual testing facility in the context of autonomous driving in urban environments and multi-vehicle autonomous navigation of micro-air vehicles in dynamic environments. Education and outreach activities include involvement of undergraduate and graduate students in the research, integration of the research into courses, demonstrations for K-12 students, and recruitment of research participants from under-represented demographic groups. Data, code, and teaching materials developed by the project are disseminated publicly on the Web.

Securing critical networked cyber-physical systems (NCPSs) such as the power grid or transportation systems has emerged as a major national and global priority. The networked nature of such systems renders them vulnerable to a range of attacks both in cyber and physical domains as corroborated by recent threats such as the Stuxnet worm. Developing security mechanisms for such NCPSs significantly differs from traditional networked systems due to interdependence between cyber and physical subsystems (with attacks originating from either subsystem), possible cooperation between attackers or defenders, and the presence of human decision makers in the loop. The main goal of this research is to develop the necessary science and engineering tools for designing NCPS security solutions that are applicable to a broad range of application domains. This project will develop a multidisciplinary framework that weaves together principles from cybersecurity, control theory, networking and criminology. The framework will include novel security mechanisms for NCPSs founded on solid control-theoretic and related notions, analytical tools that allow incorporation of bounded human rationality in NCPS security, and experiments with real-world attack scenarios. A newly built cross-institutional NCPS simulator will be used to evaluate the proposed mechanisms in realistic environments. This research transcends specific cyber-physical systems domains and provides the necessary tools to building secure and trustworthy NCPSs. The broader impacts include a new infrastructure for NCPS research and education, training of students, new courses, and outreach events focused on under-represented student groups.

Securing critical networked cyber-physical systems (NCPSs) such as the power grid or transportation systems has emerged as a major national and global priority. The networked nature of such systems renders them vulnerable to a range of attacks both in cyber and physical domains as corroborated by recent threats such as the Stuxnet worm. Developing security mechanisms for such NCPSs significantly differs from traditional networked systems due to interdependence between cyber and physical subsystems (with attacks originating from either subsystem), possible cooperation between attackers or defenders, and the presence of human decision makers in the loop. The main goal of this research is to develop the necessary science and engineering tools for designing NCPS security solutions that are applicable to a broad range of application domains. This project will develop a multidisciplinary framework that weaves together principles from cybersecurity, control theory, networking and criminology. The framework will include novel security mechanisms for NCPSs founded on solid control-theoretic and related notions, analytical tools that allow incorporation of bounded human rationality in NCPS security, and experiments with real-world attack scenarios. A newly built cross-institutional NCPS simulator will be used to evaluate the proposed mechanisms in realistic environments. This research transcends specific cyber-physical systems domains and provides the necessary tools to building secure and trustworthy NCPSs. The broader impacts include a new infrastructure for NCPS research and education, training of students, new courses, and outreach events focused on under-represented student groups.

The project focuses on swarming cyber-physical systems (swarming CPS) consisting of a collection of mobile networked agents, each of which has sensing, computing, communication, and locomotion capabilities, and that have a wide range of civilian and military applications. Different from conventional static CPS, swarming CPS rely on mobile computing entities, e.g., robots, which collaboratively interact with phenomena of interest at different physical locations. This unique feature calls for novel sensing-motion co-design solutions to accomplish a variety of increasingly complex missions. Towards this, the overall research objective of this project is to establish and demonstrate a generic motion-sensing co-design procedure that will significantly reduce the complexity of the mission design for swarming CPS, and greatly facilitate the development of effective, efficient and adaptive control and sensing strategies under various environment uncertainties. This project aims to offer comprehensive scientific understanding of the dynamic nature of swarming CPS, contribute to generic engineering principles for designing collaborative control and sensing algorithms, and advance the enabling technologies of practically applying CPS in the challenging environment. The research solutions of this project aim to bring significant advance in the environmental sustainability, homeland security, and human well-being. The project provides unique interdisciplinary training opportunities for graduate and undergraduate students through both research work and related courses that the PIs will develop and offer. The project significantly advances the state of the art in cooperative control and sensing and provide an enabling technology for swarming CPS through highly interrelated thrusts: (1) a generic sensing and motion co-design procedure, which reveals the fundamental interplay between the sensing dynamics and motion dynamics of swarming CPS, will be proposed to facilitate the development of effective and efficient control and sensing strategies; (2) by following such co-design procedure, provable correct, computation efficient, and communication light control and sensing strategies will be developed for swarming CPS with constrained resources to accomplish specific missions, e.g., locating pollutants, in an unknown field, while navigating through uncertain spaces; (3) to provide an enabling mobile platform to verify the proposed strategies, innovative small, highly 3D maneuverable, noiseless, energy-efficient, and robust robotic fish fully actuated by smart material will be designed to meet the maneuvering requirements of the proposed algorithms; (4) novel Magnetic Induction (MI)-based underwater communication and localization solutions will be developed, which allows robotic fish to timely and reliably exchange messages, while simultaneously providing accurate inter-fish localization in the harsh 3D underwater environment; and (5) the proposed sensing-motion co-design strategies will be verified and demonstrated using a school of wirelessly interconnected robotic fish in both lab-based experiments and field experiments.

Modern medical devices increasingly incorporate connectivity mechanisms that offer the potential to integrate devices via network/middleware technology into larger systems of cooperating devices. Initial integration efforts in the industry are focused on streaming device data into electronic health records and integrating information from multiple devices into single customizable displays. This proposal provides a research foundation for engineering and verification of these safety critical systems through creating an open source Medical Device Coordination Framework (MDCF) which includes: 1)middleware for integrating medical devices and electronic health records, and 2) a model-based development environment that implements medical device coordination applications (apps for short), enabling a systems of systems paradigm for medical devices. The project has substantial broader impact via tools and techniques for verifying the integration of medical systems that are compatible with the Integrated Clinical Environment standard. In addition, the proposer includes extensive interaction with FDA specialists who are looking to transition these methods into their validation and verification processes for their regulatory mission.