Sign in
CompletedNo phase

Artificial Intelligence and Augmentative and Alternative Communication AAC

Key facts

Who runs it
Penn State University
Where
University Park, United StatesSee the site
Trial code
Status
Completed
People taking part
6 people enrolled
Started
24 Sept 2024
Ended
1 May 2025
Type of study
Interventional
Treatments tested
  • Testing artificial intelligence algorithms for interpreting gestures
Record updated
3 June 2025

Who can take part

Age
18 years and older
Sex
Women and men
Healthy volunteers
Cannot take part

The registry criteria, word for word

Show all 4 criteriaShow less

Who can take part

  • Have motor impairment, which can present in diverse/multiple ways, including spasticity, ataxia, or dystonia (these types of movement disorders are different from one another, and can result from diverse genetic conditions or injury to the brain before or shortly after birth, and generally all fall under the umbrella term cerebral palsy or movement disorder). Note: Presence of intellectual disability in addition to motor disability is not an exclusionary criteria, meaning that we will include both individuals with intact intellectual ability as well as those with intellectual disability
  • Can/will tolerate a small biosensor (about the size of a medallion) attached to a limb (for instance, wrist or elbow) embedded within a soft wrist band

Who cannot take part

  • Do not have motor disabilities
  • Cannot tolerate a small biosensor (about the size of a medallion) attached to a limb (for instance, wrist or elbow) with a soft wrist band

Where in United States

  • The Pennsylvania State UniversityUniversity Park, United States

About the trial

What the trial wants to find out

The overarching objective of this project is to transform access to assistive communication technologies (augmentative and alternative communication) for individuals with motor disabilities and/or visual impairment, for whom natural speech is not meeting their communicative needs. These individuals often cannot access traditional augmentative and alternative communication because of their restricted movement or visual function. However, most such individuals have idiosyncratic body-based means of communication that is reliably interpreted by familiar communication partners. The project will test artificial intelligence algorithms that gather information from sensors or camera feeds about these idiosyncratic movement patterns of the individual with motor/visual impairments. Based on the sensor or camera feed information, the artificial intelligence algorithms will interpret the individual's gestures and translate the interpretation into speech output. For instance, if an individual waves their hand as their means of communicating "I want", the artificial intelligence algorithm will detect that gesture and prompt the speech-generating technology to produce the spoken message "I want." This will allow individuals with restricted but idiosyncratic movements to access the augmentative and alternative communication technologies that are otherwise out of reach.

The group in the trial

  • Evaluation of learnability and utility of artificial intelligence algorithmTreatment being tested

    Participants will be learning to use the artificial intelligence algorithms and testing them for ease of use and efficiency

    Treatment: Testing artificial intelligence algorithms for interpreting gestures

Data and sources

Registry record
Listed on ClinicalTrials.gov.How to verify a trial in the registry
Official title
Application of Artificial Intelligence to Improve Access to Augmentative and Alternative Communication
Record updated
3 June 2025