MUMBAI, India, Nov. 21 -- Intellectual Property India has published a patent application (202521077872 A) filed by Qualitykiosk Technologies Private Limited, Navi Mumbai, Maharashtra, on Aug. 15, for 'a system and method for functional evaluation and performance characterization of retrieval-augmented generation based chatbots.'
Inventor(s) include Mehul Vohra; Pranav Mehra; Rohit Sinha; and Radha Krishna Selvaraj.
The application for the patent was published on Nov. 21, under issue no. 47/2025.
According to the abstract released by the Intellectual Property India: "A system and method are disclosed for evaluating retrieval-augmented generation based chatbots in the field of natural language processing. The invention comprises a test case generation module (1) that generates evaluation queries and retrieves expected answers, and a test case preparation module (2) including a response generation submodule (2a) and an input data amalgamation submodule (2b) to consolidate query data with a chatbot's generated answer and retrieved context(s). A data preprocessing module (3) sanitizes text, removes extraneous tokens, and compresses context(s), while a calibration module (4) establishes evaluation thresholds based on semantic similarity metrics. An evaluation module (5) computes cosine similarity using embedding techniques, and a report generation module (6) aggregates these metrics via ensemble methods. The invention further integrates performance reporting to output quantitative scores, providing a structured evaluation approach for enhanced chatbot performance assessment."
Disclaimer: Curated by HT Syndication.
