‘Video Game’ More Accurate than Standard Tests at ID’ing Kids with Attention Deficits, Study Shows
Response Time to Stimuli Quicker, More Consistent in ‘Neurotypical’ Participants
A digital assessment platform designed to look and feel like a video game may successfully flag children with attention disorders, according to the results of a study published Sept. 20, 2016, in Translational Psychiatry. Ultimately a therapeutic version of the platform could be used to treat conditions such as attention deficit hyperactivity disorder (ADHD).
To assess the diagnostic capability of the platform, which is being developed as a medical device, researchers studied children with a genetic condition known as 16p11.2 deletion, which is associated with challenges with social communication. Some children may have an autism diagnosis, as well as attention deficits.
“Tests that measure cognitive control deficits in children with autism or ADHD often have only modest sensitivity,” said first author Joaquin A. Anguera, PhD, from the departments of neurology and psychiatry at UC San Francisco and the UCSF Weill Institute for Neurosciences. “Here we wanted to see if a device with engaging, game-like functions that uses adaptive algorithms to automatically assess a user’s ability level would be able to measure selective attention with more precision than non-adaptive traditional tests.”
In the study, 20 children with the deletion, whose average age was 10, interacted with the Project: EVO™ platform on an iPad for approximately 10 minutes. The game-like test, which was designed with graphics similar to current consumer video games, consists of three components: visuomotor tracking, where participants steer a character through winding paths avoiding walls and obstacles; perceptual discrimination, where they respond selectively to colored targets by tapping on the screen while ignoring other targets or stimuli; and multitasking, where participants perform both tracking and discrimination simultaneously. The test is designed to adapt in real-time to continually challenge the user.
Lack of Engagement may Make Testing Less Sensitive
The children also had cognitive assessments using two standard, non-adaptive tools on the iPad: a visual search and a Flanker task. Both tests measured response time to target stimuli while low-level distracting elements were presented. However, Project: EVO™’s multitasking assessment also allows for testing these selective attention abilities under high “interference,” through a set of algorithms licensed from UCSF. The group’s performance on the three tests was compared with 91 children without the deletion, whose average age was also 10.
The results of the tests using Project: EVO™ showed that children with the deletion had longer response times and more variability compared to their peers without the condition. However no such group differences were found on either the Flanker or visual search task, suggesting that the Project: EVO™ test was more robust in characterizing selective attention abilities than traditional tests.
“These standard tests have regularly failed to show clear differences in selective attention abilities between children with autism or ADHD, versus neurotypical children,” Anguera said. “Such null effects may result from a lack of engagement and/or tools that are too coarse to reveal subtle differences in cognitive abilities in populations, especially children that are known to be inherently variable when being assessed.”
Results Predictive of School Performance, Quality of Life
The ability to accurately assess cognitive control in children is important because these abilities determine how we reach goals and interact with our environment, according to senior author Elysa Marco, MD, director of the UCSF Sensory Neurodevelopment and Autism Program and associate professor in the UCSF departments of Neurology, Psychiatry and Pediatrics.
Support Sensory and Attention Research
Thanks to the groundbreaking work from UCSF Benioff Children’s Hospital San Francisco, we are learning new and better ways to assess attention in children, including children with genetic disorders like 16p11.2 copy number variation. There is much work to be done and a funding gap. We still need to:
- Understand the genetic contributors for sensory processing and attention
- Uncover the risk factors for sensory processing and attention
- Understand the neural networks that play a critical role in sensory processing and attention and help make them more efficient
- Determine if current interventions are truly effective for changing the brain
- Develop new and more powerful therapies based on scientific evidence
You can pave the way for a new era of sensory and attention research and therapies by supporting UCSF Sensory Neurodevelopment and Autism Program.
“Cognitive control is predictive of academic performance and influences quality of life. But not every child with a 16p11.2 copy number variation will have challenges in attention, as this cognitive ability has multiple contributors,” Marco said. “Knowing who is at risk, so that they can be monitored and treated as needed, is the way to move to a more personalized approach to medicine.”
Project: EVO™ grew from previous work at UCSF led by Anguera and colleagues involving the digital platform NeuroRacer, which was found to enhance multitasking performance in older adults and improve both untreated attention and working memory abilities. Project: EVOTM is currently in development by Akili Interactive Labs, which was co-founded by UCSF neuroscientist Adam Gazzaley, MD, PhD, who was not a co-author on the current paper. The Project: EVO™ platform is being developed to act not only as a diagnostic tool, but also as a personalized treatment for cognitive deficits. However Marco cautioned against optimism that Project: EVO™ would be helpful to all children with attention disorders.
“While we can detect and potentially train children with attention challenges, not all kids with challenges in one skill will end up with overall learning difficulties that need remediation,” she said. “They may have already found work-around abilities or solutions that compensate for them.”
Two researchers in the study, Jeffrey Bower, PhD, and W. Eddie Martucci, PhD, are employees of Akili Interactive Labs, the developer of Project: EVO™, and supplied the product to the study participants. No further conflicts of interest were declared. Research was supported by grants from the Simons Foundation, Wallace Research Foundation, James Gates Family Foundation and Kawaja-Holcombe Family Foundation.
Co-authors of the study are Anne Brandes-Aitken, Camarin Rolle, Sasha Skinner, Shivani Desai and Elliott Sherr, MD, all from UCSF; Jeffrey Bower, PhD, and W. Eddie Martucci, PhD, of Akili Interactive Labs, Boston; and Wendy Chung PhD, of Columbia University Medical Center, New York.
UC San Francisco (UCSF) is a leading university dedicated to promoting health worldwide through advanced biomedical research, graduate-level education in the life sciences and health professions, and excellence in patient care. It includes top-ranked graduate schools of dentistry, medicine, nursing and pharmacy; a graduate division with nationally renowned programs in basic, biomedical, translational and population sciences; and a preeminent biomedical research enterprise. It also includes UCSF Health, which comprises top-ranked hospitals, UCSF Medical Center and UCSF Benioff Children’s Hospitals in San Francisco and Oakland – and other partner and affiliated hospitals and healthcare providers throughout the Bay Area.