Tehran: A group of artificial intelligence (AI) experts at Iran's Amirkabir University of Technology has developed an evaluation system for Persian language models, which is regarded as the most comprehensive model of its type. The system is aimed at equipping Iran's AI arena with an accurate and integrated metric for assessing large language models. According to Islamic Republic News Agency, Saeedeh Momtazi, a member of the Academic Board at the university's Faculty of Computer Engineering, stated that experts from the Part Artificial Intelligence Research Center and the Natural Language Processing Laboratory at Amirkabir University have developed the most comprehensive and powerful evaluation system for Persian language models, known as Open Persian LLM Leaderboard. She explained that the newly-developed evaluation system includes over 40,000 samples. Some of these samples have been translated from several reputable global benchmarks into Persian, while others have been created and labeled domestically f rom scratch. Furthermore, Momtazi noted that the evaluation dataset for this system is continuously increasing and being updated to improve the accuracy of the assessments. According to Momtazi, the model presented in this project is as valuable as the top global projects. A segment of the dataset for this evaluation system is currently available to the public as open-source, allowing broader access and contribution to its development.
Recent Posts
ECO and WHO Discuss Strengthening Health Cooperation in Tehran
October 10, 2026
IRGC Confirms Explosion of Supertanker in Strait of Hormuz
October 10, 2026
Iran and Russia Discuss Oil Exploration in Southern Caspian Sea
October 10, 2026
Iran-FAO Collaboration Strengthens Amidst Political Pressure
October 10, 2026
Iranian Red Crescent Rescues Thousands During Conflicts
October 10, 2026