Back to Portfolio
Accessibility Technology

BrailleSight: Real-Time Text-to-Braille Conversion

Portable assistive device using OCR, Liblouis translation, and electromechanical display for real-time printed text to tactile Braille conversion

OCR Accuracy
95.2%
Braille Translation
97%+ Accuracy
Response Time
1.2 seconds
Team Size
5 Members

Empowering Independent Reading for Visually Impaired Users

"BrailleSight bridges the accessibility gap by converting any printed text into real-time tactile Braille output, enabling independent reading and expanding educational and professional opportunities for the visually impaired community."

Accessibility Challenge

The visually impaired population faces significant barriers in accessing printed materials due to the scarcity and high cost of Braille-printed resources. Traditional Braille books are bulky, slow to produce, and cannot keep pace with the growing volume of published content, creating substantial educational and professional limitations.

Unlike audio-based aids, tactile reading enhances literacy, spatial understanding, and privacy, making it essential for comprehensive education and professional development.

Critical Accessibility Barriers:

  • Limited Braille Resources: Expensive and time-consuming traditional Braille publishing processes
  • Immediate Access Gap: No real-time conversion of printed materials to tactile format
  • Educational Inequity: Reduced access to diverse learning materials and current publications
  • Professional Limitations: Inability to independently access workplace documents and materials
  • Privacy Concerns: Dependence on others for reading assistance compromises personal privacy

BrailleSight: Innovative Assistive Solution

BrailleSight revolutionizes accessible reading by providing real-time conversion of any printed text into tactile Braille output through an integrated system combining advanced image processing, optical character recognition, and electromechanical Braille display technology.

Core Innovation Features:

📷
Advanced OCR Pipeline
Multi-stage image preprocessing with Tesseract OCR, achieving 95.2% accuracy even in challenging lighting conditions
⠁⠝⠎⠓
Grade 2 Braille Translation
Liblouis-powered contracted Braille conversion with 97%+ accuracy, supporting efficient reading patterns
🔧
Electromechanical Display
Modular refreshable Braille cells with DC motor actuation, providing precise tactile feedback
📱
Portable Design
Raspberry Pi-based system with ergonomic housing, enabling independent use in various environments

Technical Architecture:

Python 3.x OpenCV Tesseract OCR Liblouis Raspberry Pi 4B CMOS Camera GPIO Control DC Motors

Interdisciplinary Team Expertise:

Ansh Srivastava
Computer Science Engineering
Advaith A
Computer Science Engineering
Megha Modi
Electronics & Communication
Mrigaannkaa Singh
Electronics & Communication
Gaurav Raju
Mechanical Engineering

System Architecture & Processing Pipeline

The BrailleSight system follows a comprehensive end-to-end pipeline designed for reliability, accuracy, and real-time performance in diverse reading scenarios.

Image Capture to Tactile Braille Output

📷
Image Capture
CMOS Camera + Stability Detection
🔧
Preprocessing
CLAHE + Multiple Binarization
🔍
OCR Processing
Tesseract + Quality Assessment
Braille Translation
Liblouis Grade 2 Conversion
🤲
Tactile Output
Electromechanical Display

Advanced Image Processing Techniques:

  • Adaptive Preprocessing: Non-Local Means Denoising and CLAHE for contrast enhancement
  • Multi-Method Binarization: Otsu, adaptive mean, and adaptive Gaussian thresholding
  • Quality Assessment: Sharpness, contrast, and brightness evaluation for optimal OCR results
  • Corruption Detection: Heuristic scoring to filter unreliable OCR outputs
  • Multiple PSM Modes: Tesseract Page Segmentation Modes for diverse document layouts

Hardware Components Integration:

  • Processing Unit: Raspberry Pi 4B (4GB RAM) for real-time computation
  • Image Acquisition: 1/4" CMOS 640x480 USB camera with adjustable mounting
  • Braille Display: Modular electromechanical cells with 6-dot pin actuation
  • Motor Control: DC motors with GPIO interface for precise pin positioning
  • User Interface: Tactile navigation buttons for seamless interaction

Performance Results & Validation

Comprehensive testing across diverse document types and lighting conditions demonstrates exceptional performance in accuracy, responsiveness, and user satisfaction, validating BrailleSight's effectiveness as a practical assistive device.

OCR Performance Metrics:

95.2%
Standard Print Accuracy
Books, newspapers, magazines
91.5%
Low Contrast Accuracy
Challenging lighting conditions
89.8%
Complex Layout Accuracy
Tables, columns, mixed formats
2.1s
Average Processing Time
Image capture to text extraction

Braille Display Performance:

98.7%
Pin Actuation Accuracy
Correct raised/lowered pins
1.2s
Display Response Time
Update after receiving data
97%+
Braille Translation Accuracy
Grade 2 contracted Braille
100+
Operational Cycles
No mechanical failures

User Validation & Impact:

  • User Satisfaction: Positive feedback from visually impaired users highlighting responsiveness and Braille clarity
  • Improved Accessibility: More than 20% improvement in responsiveness compared to existing solutions
  • Ease of Use: Intuitive navigation and tactile feedback systems appreciated by users
  • Real-World Readiness: Successful testing across various document types and environmental conditions
  • Award Recognition: Best Research Prototype at RVCE Innovation Expo 2025

Comparative Advantages:

Key Advantages Over Existing Solutions:

  • Affordability: Lower cost through off-the-shelf components and open-source software
  • Portability: Compact, lightweight design for daily use
  • Real-Time Operation: Immediate conversion without delay or cloud dependency
  • Customizability: Open-source architecture allows for feature expansion and updates
  • Independence: Enables autonomous reading without requiring assistance

Technical Implementation & Innovation

The project demonstrates sophisticated interdisciplinary engineering combining computer vision, embedded systems, mechanical design, and assistive technology principles to create a robust, user-centered solution.

Software Architecture Innovations:

  • Robust OCR Pipeline: Multiple binarization methods and PSM modes ensure high accuracy across diverse document types
  • Adaptive Quality Assessment: Real-time image evaluation prevents processing of unsuitable captures
  • Advanced Error Handling: Corruption detection algorithms filter unreliable OCR results
  • Efficient Braille Translation: Liblouis integration supports contracted Grade 2 Braille for optimal reading efficiency

Hardware Design Excellence:

  • Modular Braille Display: Easy maintenance and scalability through modular cell design
  • Precise Motor Control: DC motor actuation with calibration routines for reliable pin positioning
  • Ergonomic Housing: 3D-printed enclosure designed for comfort and durability
  • Safety Features: Current limiting and emergency stop functions for user protection

System Integration Achievements:

  • Real-Time Synchronization: Seamless communication between processing unit and display hardware
  • Comprehensive Testing: Unit, integration, and user testing ensuring reliability
  • Iterative Refinement: User feedback-driven improvements in both hardware and software
  • Cross-Platform Compatibility: Python-based architecture enables future portability

Future Enhancements & Impact

BrailleSight establishes a foundation for next-generation assistive reading technology with multiple pathways for enhancement and broader societal impact in accessibility and inclusive design.

Planned Technical Enhancements:

  • Miniaturization: Further size and weight reduction for enhanced portability
  • Audio Integration: Multimodal accessibility with text-to-speech capabilities
  • Wireless Connectivity: Bluetooth and Wi-Fi for remote updates and smartphone integration
  • Machine Learning OCR: Deep learning models for improved accuracy in challenging conditions
  • Multi-Language Support: Expansion to additional languages and Braille codes

Broader Impact Potential:

  • Educational Equity: Democratizing access to educational materials in classrooms and libraries
  • Professional Empowerment: Enabling independent document access in workplace environments
  • Social Inclusion: Reducing barriers to information access and social participation
  • Technology Transfer: Open-source architecture enabling widespread adoption and customization

Research Contributions:

  • Interdisciplinary Methodology: Successful integration of computer vision, embedded systems, and assistive technology
  • Cost-Effective Design: Proof-of-concept for affordable assistive devices using commodity components
  • User-Centered Development: Validated approach to designing with and for the visually impaired community
  • Open Innovation: Contributing to the body of knowledge in accessible technology design