Intellectual Property India Publishes Patent Application for Ai-Based Real-Time Speech-To-Indian Sign Language (isl) Classroom Ally System

MUMBAI, India, Sept. 14 -- Intellectual Property India has published a patent application (202641106699 A) filed by Ruchita Singhania; Dayananda Sagar Academy Of Technology & Management; Deekshitha R; Manya M; Praveen; and Kushal Varma D L on September 04, 2026, for Ai-Based Real-Time Speech-To-Indian Sign Language (isl) Classroom Ally System.

Inventors include Ruchita Singhania; Dayananda Sagar Academy Of Technology & Management; Deekshitha R; Manya M; Praveen; and Kushal Varma D L.

The application for the patent was published on September 11, 2026, under issue no. 37/2026.

Abstract: The present invention discloses an AI-based real-time speech-to-Indian Sign Language (ISL) system, named "Classroom Ally," designed to bridge the communication gap between hearing teachers and deaf students in educational settings. The system captures teacher speech through a browser-based AudioWorklet interface, transmits PCM audio frames via WebSocket to a FastAPI backend, and processes them through a five-stage pipeline: (1) Silero Voice Activity Detection filters silence, (2) faster- whisper large-v3-turbo model transcribes speech to text with sub-500ms latency on CUDA-enabled hardware, (3) a spaCy-based English-to-ISL gloss conversion engine applies ISL grammar rules including Subject-Object-Verb reordering, auxiliary dropping, and WH-word final placement, (4) a hybrid sign mapper resolves each ISL token against a 300-word ISLRTC dictionary producing video clip actions or fingerspelling sequences, and (5) a Next.js 16 frontend renders ISLRTC professional sign videos or fingerspelled letters in real time. The system incorporates a Human-in-the-Loop (HITL) feedback mechanism allowing users to correct incorrect signs, with corrections stored in PostgreSQL and applied via a correction reranker. The invention achieves 75% exact-match gloss accuracy and 100% token accuracy tested on ISLTranslate-style classroom sentences, covering 16.7% of the ISLRTC 10,000-word dictionary with 50 priority classroom words.

Disclaimer: Curated by HT Syndication.