Google launches open source framework for cross-model evaluation

Google has launched LMEval, a powerful open source framework designed to make large model evaluation faster, easier, and more consistent across providers. This release aligns with the ongoing collaboration with Giskard, which uses LMEval to run the Phare benchmark—an independent test for assessing model safety and security.

- 

With LLMs evolving rapidly, developers and researchers need reliable tools to assess model performance across tasks and providers. Until now, cross-model benchmarking has been complex and resource-heavy. LMEval changes that.