EchoSense-AI is an open source, accessibility-focused visual assistance app. It combines the camera, local computer vision, speech, OCR, and an on-device multimodal language model to describe surroundings and make printed information easier to access.
Features
• Assistant provides multi-turn text or voice chat and can analyze a camera photo, stored image, PDF, or text document.
• Navigate describes the current scene and accepts optional voice commands such as “help me find my keys.”
• Safety combines object detection with ARCore metric depth and vertical-plane checks when supported, then falls back to camera-relative proximity estimates.
• Currency identifies visible bank notes.
• Read extracts document text from the camera or an imported file, reads it aloud, and offers Guided Scan with spoken page-edge guidance, automatic stable-page capture, perspective correction, image enhancement, and a manual capture fallback. It also identifies the approximate center color, reports camera-relative light level, and scans common barcodes and QR codes entirely on-device. Its accessible Magnifier provides zoom, freeze, flashlight, contrast, inversion, and grayscale controls.
• Translate extracts document text and translates it to English.
• On-device analysis uses a downloaded Gemma multimodal model without sending camera images to an AI provider.
• Optional online analysis supports user-provided Gemini or OpenAI API keys and configurable ask, fallback, or prefer-online behavior.
afety warnings are experimental estimates based on camera detections. EchoSense is not a certified mobility aid and should not replace a cane, guide dog, attentive travel, or other established safety practices.
