Autism Care

A mobile app to support families with children who have autism.

2019-04-06 — 2019-04-07 •🏅 USC AthenaHacks 2019
  • The app's login page.
    The app's login page.
  • Using text analysis to help the child understand the sentiment of the words.
    Using text analysis to help the child understand the sentiment of the words.
  • A schedule that the parents can modify.
    A schedule that the parents can modify.
  • A screen showing the location and heart rate of the child.
    A screen showing the location and heart rate of the child.
  • A chat bot to help the child manage their anxiety.
    A chat bot to help the child manage their anxiety.

What is this?

Autism Care aims to help parents of children who have autism while also improving the lives of the children themselves. The mobile app has two screens: for the child and the parents.

On the child side, the child can learn new vocabulary words by taking pictures on the app. They can also submit a text or a voice message to understand the sentiment of the words they are trying to say. Children with autism tend to have high levels of anxiety, so this app lets them talk to a chatbot to decrease feelings of anxiety, improve their communication with the family, and better express their feelings.

On the parent side, this app allows parents to keep track of their child’s location. It will also monitor the child’s heart rate and motion using a Fitbit watch to detect if the child is having an anxiety or panic attack. The parents can also create a schedule for their child to follow by sending alerts to the child’s account.

Our team won the “Microsoft Azure Champ Challenge” out of 74 submissions.

What was your role in the team?

I developed and designed the Fitbit watch app. I created and deployed an Express server on Microsoft Azure for both apps to interact with each other. I also integrated multiple Microsoft APIs for the mobile app.

How was this built?

  • Node.js + Express + Microsoft Azure App Service for the server.
  • Fitbit SDK to develop the watch app and get the child’s heart rate and motion.
  • Ionic Framework for creating the mobile app.
  • Microsoft Azure Text Analysis for analyzing the tone of text or voice message.
  • Microsoft Azure Computer Vision for describing the picture the child submitted.
  • Microsoft Azure Bot Framework + LUIS.ai for the chatbot and natural language conversation.
  • Microsoft Azure Maps for displaying the child’s location to the parents.
Back to projects.