Visible to the public CPS: Medium: A Novel Human Centric CPS to Improve Motor/Cognitive Assessment and Enable Adaptive Rehabilitation

Project Details
Lead PI:Fillia Makedon
Co-PI(s):Dan Popa
Heng Huang
Vassilis Athitsos
Zhengyi Le
Performance Period:09/15/10 - 02/29/16
Institution(s):University of Texas at Arlington
Sponsor(s):National Science Foundation
Award Number:1035913
1922 Reads. Placed 84 out of 803 NSF CPS Projects based on total reads on all related artifacts.
Abstract: The objective of this research is to develop methods and tools for a multimodal and multi-sensor assessment and rehabilitation game system called CPLAY for children with Cerebral Palsy (CP). CPLAY collects and processes multiple types of stimulation and performance data while a child is playing. Its core has a touch-screen programmable game that has various metrics to measure delay of response, score, stamina/duration, accuracy of motor/hand motion. Optional devices attached to extend CPLAY versions provide additional parallel measurements of level of concentration/participation/engagement that quantify rehabilitation activity. The approach is to model the process as a cyber-physical system (CPS) feedback loop whereby data collected from various physical 3D devices (including fNIR brain imaging) are processed into hierarchical events of low-to-high semantic meaning that impact/ adjust treatment decisions. Intellectual Merit: The project will produce groundbreaking algorithms for event identification with a multi-level data to knowledge feedback loop approach. New machine learning, computer vision, data mining, multimodal data fusion, device integration and event-driven algorithms will lead towards a new type of cyber- physical rehabilitation science for neurological disorders. It will deliver fundamental advancements to engineering by showing how to integrate physical devices with a computationally quantitative platform for motor and cognitive skills assessment. Broader Impacts: The project delivers a modular & expandable game system that has huge implications on the future of US healthcare and rehabilitation of chronic neurological disabilities. It brings hope to children with Cerebral Palsy via lower cost and remote rehabilitation alternatives. It brings new directions to human centered computing for intelligent decision-making that supplements evidence-based practices and addresses social and psychological isolation problems.