Independent evaluation of LLMs on the performance, complexity, quality, and security of code generation.

Analysis is based on a combination of public and proprietary benchmarks of programming assignments, incorporating an evaluation of the quality, security, and maintainability of the generated code.

Want to nominate a model for evaluation or license Sonar's training and benchmark data? Contact us.