{"id":14206,"date":"2026-07-29T01:45:36","date_gmt":"2026-07-29T01:45:36","guid":{"rendered":"https:\/\/sawahsolutions.com\/range\/nist-unveils-new-ai-evaluation-platform\/"},"modified":"2026-07-29T01:45:36","modified_gmt":"2026-07-29T01:45:36","slug":"nist-unveils-new-ai-evaluation-platform","status":"publish","type":"post","link":"https:\/\/sawahsolutions.com\/range\/nist-unveils-new-ai-evaluation-platform\/","title":{"rendered":"NIST unveils new AI evaluation platform"},"content":{"rendered":"
\n

The National Institute of Standards and Technology launched a new program on Monday granting researchers access to an isolated testbed environment to safely evaluate artificial intelligence models against various commands.\u00a0<\/p>\n

The AI Technology Evaluation, or AITE, is a voluntary testing vehicle focused on AI model safety analysis. It provides blind data for models to process when completing tasks to gain objective insights and conduct evaluations of model capabilities. Notably, the evaluation data is not intended to serve as training data for the models.<\/p>\n

Initially, AITE will focus on conducting image analysis tasks using large vision language models across three domains: quantum science, genomics\u00a0and public safety. More tasks will be available in the future.<\/p>\n

AITE\u2019s fundamental goal is to offer a universal rubric to effectively evaluate AI models’ capabilities and determine the state of the art for model performance.\u00a0<\/p>\n

\u201cThe infrastructure provided by NIST will provide common data, metrics and scoring to help developers understand the performance of their models,\u201d the press release said.<\/p>\n

Both data providers and model providers working with AITE will need to submit materials related to the testing. Data providers are asked to submit original datasets that are inaccessible publicly,\u00a0along with a \u201cmeaningful\u201d task suited for the data.\u00a0<\/p>\n

Model developers, likewise, will submit their AI models to be tested using the datasets. The first set of evaluations will start in August 2026.\u00a0<\/p>\n

The formation of AITE is the latest step in the Trump administration\u2019s strategy to work with major AI developers in advancing model safety through voluntary model submissions.<\/p>\n

The Commerce Department\u00a0announced a renegotiated deal\u00a0in May between the agency and three companies\u2014Google Deepmind, Microsoft and xAI\u2014to evaluate their models through the Center for AI Standards and Innovation.\n\n<\/svg><\/p>\n<\/div>\n