MUMBAI, India, March 14 -- Intellectual Property India has published a patent application (202441069222 A) filed by L&T Technology Services Limited, Chennai, Tamil Nadu, on Sept. 12, 2024, for 'method and system for creating pruned large language models.'
Inventor(s) include Sudhir Bhadauria; and Vikram Subramani.
The application for the patent was published on March 13, under issue no. 11/2026.
According to the abstract released by the Intellectual Property India: "A method (500) and a system (100) for creating a pruned large language model (LLM) (400A) is disclosed. A processor (104) receives a weight file of a pretrained LLM (300A), a first metadata (300C), a predefined pruning criterion, and a predefined pruning ratio. A set of target layers are identified. At least one weight is determined from each of the set of target layers based on the predefined pruning criterion and the predefined pruning ratio. A position index of the at least one weight corresponding to each of the set of target layers is determined based on the set of weight matrices. A compressed weight file and a second metadata (400B) are generated by removing the at least one weight from each of the set of target layers based on the position index. The pruned LLM (400A) is created using the compressed weight file and the second metadata (400B)."
Disclaimer: Curated by HT Syndication.
