AmblyOverlay: An Input-Transparent, Assistive Overlay for Binocular Visual Therapy and Dichoptic Filtering

Abstract

AmblyOverlay is presented here as a proof-of-concept prototype, demonstrating feasibility of dichoptic overlays for binocular therapy, with clinician-guided validation planned in future work. Am-blyopia, strabismus (including exophoria), and double vision are vision disorders that disrupt binocular coordination and often require visual therapy. Traditional treatments involve patching or the use of specialized games that rely on red-green or red-blue goggles to stimulate cooperation between the eyes. However, these games are primarily designed for young children [20] and may not be engaging for older users [21] who prefer fast-paced, modern games. AmblyOverlay is a software-based assistive tool that enables patients with binocular vision issues to play any game of their choice, including action-heavy titles, while undergoing visual therapy. Developed using Python, OpenCV, NumPy, and PyQt5, the application applies a red-cyan dichoptic filter across the entire screen. The overlay is presented through a transparent, click-through window, allowing the user to interact with their screen normally. Unlike previous approaches that target only specific games or rely on fixed visual content, AmblyOverlay provides a system-wide solution compatible with dynamic and interactive content. The project faced and addressed key technical challenges, including maintaining real-time performance, preserving user interactivity through a transparent overlay, and ensuring stable screen capture. While AI-based methods for adaptive filtering were explored, they were not implemented in the final system due to complexity and resource constraints. Ongoing development focuses on connecting visual calibration to the filter and UI customization, with the long-term goal of making binocular therapy more engaging, accessible, and compatible with how patients use their devices.