A Novel Human Centric CPS to Improve Motor/Cognitive Assessment and Enable Adaptive Rehabilitation

Abstract:

The objective of this research is to develop methods and tools for a multimodal and multi-sensor assessment and rehabilitation system called CPLAY to help children with Cerebral Palsy (CP). CPLAY collects and processes multiple types of stimulation and performance data while a child is playing in different types of therapy games simulating traditional therapy sessions. The project has developed tools to collect and measure responses such as delay of response, score, stamina/duration, accuracy of motor/hand motion, level of concentration (with eye trackers and camera) and other metrics. Wearables are used to measure physiological responses, level of participation/engagement. A library of appropriate multiplatform and adaptive games have been developed that adjust to user capabilities. 

Approach:

The proecess is modeled as a cyber-physical system (CPS) feedback loop whereby multimodal and multisensory data is collected and analyzed to show event patterns and how the game-based intervention impacts the child with Cerebral Palsy. The game system can be used at home of clinic and additional environmental factors (e.g., "when, where, how" game is being played) are used to help the expert make targeted decisions in guiding the treatment. the occupational therapy expert receives summarized progress reports over a period of 1-2 weeks and accordingly guides rehabilitation by using the knowledge of quantitative performance measurements with traditional therapy practices during actual visits. The system is evaluated by comparing traditional therapy with and without the use of the CPLAY system, in terms of ability to perform actions such as hand-reaching out, grasping, spasticity, and daily activities of buttoning, eating, and others. Occupational therapists at two hospitals in the Dallas and Fort Worth area found the systems very valuable and the children who used it, very enjoyable.