Advanced multimodal AI healthcare assistant designed for elderly and disabled users with comprehensive health monitoring and accessibility features.
- 73% of elderly users struggle with complex healthcare apps
- Fragmented health data leads to poor care coordination
- Accessibility barriers prevent disabled users from accessing digital health tools
- Limited multimodal input options for health monitoring
MediVision Assistant - An AI-powered healthcare companion that makes medical assistance accessible to everyone, especially those with visual impairments or accessibility needs.
- AI Skin Analysis - Upload photos and videos for instant skin condition assessment
- AI Health Infographics - Generate professional medical infographics using advanced AI image generation
- Voice Symptom Logger - Record and transcribe health symptoms using speech-to-text
- Medication Scanner - OCR-powered medication identification and management
- AI Health Chat - Conversational AI for health questions and guidance
- Seamless Analysis-to-Chat Integration - Continue conversations with AI based on analysis results
- Full Accessibility Support - Voice navigation, screen reader compatibility, high contrast mode
- Voice navigation and screen reader optimization
- High contrast modes and font scaling
- Keyboard-only navigation support
- Simple, large UI elements for motor impairments
- Progressive Web App - Works offline, installable on any device
- Installable on any device (phone, tablet, desktop)
- Background sync for health data
- Native app experience without app stores
| Feature | Description | AI Model |
|---|---|---|
| Skin Analysis | Analyze photos of skin conditions, rashes, wounds | Gemini 2.5 Flash |
| Video Analysis | Analyze health videos for movement, posture, gait | Gemini 2.5 Flash |
| Medication Scanner | Identify pills, check interactions, verify dosages | Gemini 2.5 Flash |
| Health Infographics | AI-generated medical visual content and schedules | Imagen 4.0 |
| Voice Logger | Process voice descriptions of symptoms | Gemini 2.5 Flash |
| Health Chat | Intelligent health conversations with context | Gemini 2.5 Flash |
- Secure Storage: HIPAA-compliant data handling with Supabase
- Conversation History: Persistent chat records with analysis
- Health Statistics: Track symptoms, medications, vital signs over time
- Export Data: Download health records in multiple formats
- Data Insights: AI-powered trend analysis and recommendations
- Voice Commands: Complete app navigation using voice commands
- Offline Mode: Cached data work without internet
- Install Anywhere: Works on phones, tablets, computers as native app
- Background Sync: Data syncs automatically when connection restored
- Next.js 15 - React framework with App Router
- TypeScript - Type-safe development
- Tailwind CSS - Utility-first styling
- Lucide Icons - Accessible icon system
- Google Gemini 2.5 Flash - Advanced LLM for health analysis
- Google Imagen 4.0 - AI-generated health infographics
- Google Live API - Real-time streaming responses
- Web Speech API - Voice recognition and synthesis
- MediaDevices API - Camera and microphone access
- Supabase - PostgreSQL database, authentication, storage
- Vercel - Serverless deployment and analytics
- PWA Service Worker - Offline functionality and caching
Homepage Dashboard: Clean, accessible dashboard with health summary and quick actions
Skin Analysis: AI-powered skin condition analysis with detailed insights

Voice Logger: Voice-to-text symptom recording with transcription

Health Chat: Conversational AI for health questions
AI Health Infographics: Professional medical infographics
Accessibility Features: Comprehensive accessibility toolbar with voice navigation
git clone https://github.com/omkardongre/medi-vision-assistant-ai
cd medi-vision-assistant-ai
npm install# Copy environment template
cp .env.example .env.local
# Add your API keys:
GOOGLE_AI_API_KEY=your_gemini_api_key
GCP_PROJECT_ID=your_gcp_project_id
CUSTOM_KEY=your_custom_key
NEXT_PUBLIC_SUPABASE_URL=your_supabase_url
NEXT_PUBLIC_SUPABASE_ANON_KEY=your_supabase_anon_key
SUPABASE_SERVICE_ROLE_KEY=your_supabase_service_role_key
NEXT_PUBLIC_SITE_URL=https://medivision.yourdomain.com# Set up Supabase database using the provided SQL schema
# Import the supabase-schema.sql file into your Supabase project
# This will create all necessary tables for health records, conversations, and user data
# The schema includes proper RLS policies and triggers for data securitynpm run dev
# Open http://localhost:3000# Build for production
npm run build
# Test PWA features locally
npm start- Skin Analysis: Upload a photo → See AI medical analysis with confidence scores
- Voice Commands: Use voice navigation → Experience accessibility features
- Health Chat: Ask health questions → Get AI-powered responses
- PWA Install: Click browser install prompt → Use as native app
- Voice Logger: Record symptoms → See transcription and analysis
- Multimodal AI analysis with image, video, and voice processing
- Accessibility-first design with voice navigation and screen reader support
- Progressive Web App with offline functionality
- Voice accessibility with natural language commands
- Professional medical UI with comprehensive health monitoring
✅ Only solution combining multimodal AI with accessibility-first design
✅ Real-time streaming analysis vs batch processing competitors
✅ PWA deployment = zero app store friction
✅ Open source friendly vs proprietary closed systems
- Advanced AI Integration: Latest Gemini 2.5 models with streaming
- Real-time Intelligence: Emergency detection during live conversation
- Production-Ready: PWA with offline functionality and background sync
- Accessibility Leadership: Voice-first design with full WCAG compliance
- Inclusivity Focus: Built for underserved elderly and disabled communities
- Healthcare Access: Breaks down barriers to digital health tools
- Family Peace of Mind: Caregivers get comprehensive health monitoring
- Accessibility Leadership: Voice-first design with full WCAG compliance
- First-of-its-kind: Multimodal AI healthcare companion with accessibility focus
- Advanced AI Integration: Latest multimodal models for comprehensive health analysis
- Cross-platform PWA: Works everywhere without app stores
- Open Development: Extensible architecture for future enhancements
We welcome contributions! See our Contributing Guide for details.
- 🎨 UI/UX Design - Accessibility improvements
- 🧠 AI/ML - Enhanced health pattern recognition
- 🔒 Security - HIPAA compliance and privacy features
- 🌍 Internationalization - Multi-language support
- 📱 Mobile - Native iOS/Android app versions
- MIT License - Open source and freely usable
- HIPAA Considerations - Built with healthcare privacy in mind
- Accessibility Compliance - WCAG 2.1 AA standards targeted
- Medical Disclaimer - For informational purposes, not medical advice
- 💬 Issues: GitHub Issues
- 📧 Email: omkardongre5@gmail.com







