MUMBAI, India, Nov. 7 -- Intellectual Property India has published a patent application (202421035511 A) filed by Lti Mindtree Ltd., Maharashtra, on May 5, 2024, for 'method and system for performing end-to-end evaluation of a large language model (llm).'
Inventor(s) include Ashish Varerkar; Vishwanathan Raman; Anindita Desarkar; Sateesh Gottumukkala; Ruchita Motwani; and Raj Shah.
The application for the patent was published on Nov. 7, under issue no. 45/2025.
According to the abstract released by the Intellectual Property India: "A method and a Large Language Model (LLM) evaluation system (106) provides an end-to-end evaluation of LLM, which includes evaluating both input prompts and output prompt responses, wherein the evaluation includes assessing a plurality of input and output characteristics that encompasses both quality and quantity. Each of the plurality of input characteristics are assigned with a corresponding normalized score by employing one or more statistical techniques to derive a composite health score for the input prompts. Evaluation further comprises evaluating output prompt responses in both absence and presence of the ground truth. Upon evaluating both input prompts and output prompt responses, a final aggregated health score for the LLM is computed by a scorer module (214) employing threshold based statistical techniques that considers input prompt health and output prompt response health, wherein the aggregated health score is generated based on the granular scores of each characteristic."
Disclaimer: Curated by HT Syndication.
