Intellectual Property India Publishes Patent Application for Multimodal Interactive Platform For English Communication Skill Development Through Speech, Gesture And Text Analysis

MUMBAI, India, Sept. 14 -- Intellectual Property India has published a patent application (202641105908 A) filed by Dr. T. Balamurugan; Mr. M. Balakrishnan; Dr. R. Senguttuvan; Mr. M. Varadharajan; Dr. M. Rukmangathan; Dr. S. Sundaraselvan; Mr. M. Thiyagarajan; Dr. G. B. Sathishkumar; Dr. R. G. Padmanaban; and Dr. A. Joseph Arockiam on September 02, 2026, for Multimodal Interactive Platform For English Communication Skill Development Through Speech, Gesture And Text Analysis.

Inventors include Dr. T. Balamurugan; Mr. M. Balakrishnan; Dr. R. Senguttuvan; Mr. M. Varadharajan; Dr. M. Rukmangathan; Dr. S. Sundaraselvan; Mr. M. Thiyagarajan; Dr. G. B. Sathishkumar; Dr. R. G. Padmanaban; and Dr. A. Joseph Arockiam.

The application for the patent was published on September 11, 2026, under issue no. 37/2026.

Abstract: A multimodal interactive platform for English communication skill development through speech, gesture, and text analysis is disclosed. An acquisition subsystem captures, during a communicative exercise conducted in English, a learner's speech as audio, gesture and body language as video, and text. A speech analysis module applies automatic speech recognition and acoustic-prosodic analysis to measure fluency, pronunciation, and prosody; a gesture analysis module applies computer-vision pose estimation to measure the appropriateness and expressiveness of gesture, posture, and engagement; and a text analysis module applies natural-language processing to measure grammatical correctness, vocabulary richness, and organization. A fusion and assessment module, in embodiments a trained machine learning model, fuses the heterogeneous multimodal measures into an integrated assessment of the learner's communication skill across the verbal, vocal, and visual modalities together, capturing their coordination, rather than as isolated modalities. A feedback and adaptation module generates personalized, specific, actionable feedback across all modalities and adaptive exercises addressed to the learner's deficiencies. The platform conducts interactive conversations, presentations, and role-plays, developing communication skill objectively, consistently, and at scale where conventional instruction is partial, isolated, and human-limited.

Disclaimer: Curated by HT Syndication.