Skip to content

HackWidMaddy/Synapse

Repository files navigation

🧠 Synapse - AI Powered Cognitive Retraining Platform

Synapse is a revolutionary AI-driven cognitive training platform designed for children with ADHD, Autism Spectrum Disorder, and Learning Disabilities.

🎯 Inspiration

Access to professional cognitive therapy for children with ADHD, autism, and learning disabilities is limited, especially in rural or underserved areas. Families often lack affordable, accessible, and personalized tools to help their children improve memory, focus, problem-solving, and emotional regulation.

Synapse bridges this gap using AI, neurotechnology, and gamification to create an adaptive home-based cognitive retraining platform that empowers children, supports parents, and enables therapist collaboration.


⚙️ What It Does

Synapse delivers personalized cognitive training through gamified sessions that evolve in real-time based on the child’s EEG, emotional state, and engagement.

Core Features

  • EEG-enabled neurofeedback for attention and cognitive load measurement
  • AI-driven adaptive exercise engine for memory, focus, and behavioral skills
  • Multi-modal emotion and speech recognition for engagement tracking
  • Personalized rewards and AI-generated comics
  • Parental dashboards with WhatsApp progress reports
  • Therapist portals for data-driven insights
  • Secure decentralized data storage (IPFS)

🛠️ How We Built It

  • ESP32-based EEG devices streaming brain signals via Python LSL
  • SARVAM AI for multilingual speech-to-text and text-to-speech
  • DeepFace for emotion detection and OpenAI Whisper-v3 for speech emotion analysis
  • Columnar database for scalable real-time analytics
  • Adaptive game modules targeting cognitive domains
  • Automated reports stored on IPFS and sent via Twilio WhatsApp API
  • pyannote.audio for speaker diarization and conversational dynamics
  • Gamified multi-language UI for accessibility

🧩 Challenges We Ran Into

  • Ensuring EEG accuracy with affordable hardware
  • Integrating multiple AI models seamlessly (EEG, emotion, speech)
  • Managing multimodal data streams with low latency
  • Building adaptive difficulty that balances engagement and therapy
  • Maintaining privacy in decentralized environments
  • Creating interfaces suitable for children with diverse cognitive needs
  • Educating families and therapists for effective usage
  • Balancing technology with emotional warmth and simplicity

🏅 Accomplishments We're Proud Of

  • Developed a real-time adaptive neurofeedback system
  • Integrated EEG + emotion + speech AI for multi-dimensional insights
  • Deployed IPFS-based decentralized storage with WhatsApp delivery
  • Built multi-stakeholder collaboration tools (child-parent-therapist loop)
  • Designed AI-generated comics for personalized engagement
  • Created a multi-language, accessibility-first platform

📚 What We Learned

  • Real-time multimodal tracking enhances personalization
  • Low-cost EEGs can yield clinical-grade insights with AI
  • Parental involvement boosts engagement and outcomes
  • Therapist validation improves credibility and results
  • Gamification improves retention when balanced with goals
  • Accessibility and cultural adaptability are essential
  • Cross-disciplinary collaboration is key
  • Decentralized storage requires good user education

🚀 What’s Next for Synapse

  • Refine adaptive AI with longitudinal data
  • Expand multilingual support for Indian and global languages
  • Add in-app teletherapy sessions with live video
  • Upgrade personalized comic engine with interactive storytelling
  • Enable offline mode and edge AI for low-connectivity regions
  • Launch large-scale clinical validation with partners
  • Offer SDK/API for third-party health integrations

🧩 Tags

AI Cognitive Training ADHD Autism Learning Disabilities Neurofeedback Gamification Adaptive Learning EEG Speech Emotion Recognition Therapist Dashboard Parent Support Accessibility Multilingual Decentralized Data Digital Therapeutics Personalized Comics


🧠 Built With

Technology Description
Python / FastAPI Backend, data processing
React / Next.js / TypeScript Frontend and dashboard
ESP32 EEG hardware device
DeepFace / Whisper-v3 / pyannote.audio Emotion and speech AI
LangChain / LangGraph Adaptive AI workflows
SARVAM AI Multilingual support
IPFS Decentralized storage
Supabase Database and authentication
TensorFlow Cognitive model training
Twilio API WhatsApp report delivery
Vercel Deployment

🌐 Try It Out


👥 Created By

Madhav Shah U.S. Gov Hall of Fame | NASA & WHO LoA | SPIT ’27 | CSNP | Red Team | Malware Dev | CVE-2024-57522 | 6x Hackathon Winner | Intern @Barclays 📧 madhav.shah24@spit.ac.in

Kush Tejani Full-Stack Developer | AI & IoT Innovator | Hackathon Builder

Meet Mehta Early-Career Data Scientist | ML & Deep Learning | 4x Hackathon Winner | Content Writer @Medium


🧩 Synapse connects minds, builds futures, and transforms cognitive care — one child at a time.


About

Comprehensive AI-Powered Cognitive Retraining Platform for Children with Disabilities

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages