Gemini Pro will top 50% on Humanity’s Last Exam

The next Google Gemini Pro model will record an HLE Accuracy of at least 50% on the Humanity’s Last Exam and will appear on the agi.safe.ai leaderboard. The HLE is a 2,500-question benchmark and recent Gemini variants have scored in the 37 to 45 percent range, so a 50 percent-plus result will tight…