☰
XTX Markets announces plans for $2m progress prize for Artificial Intelligence Mathematical Olympiad
23 September 2024
XTX Markets today announces that the second progress prize for the Artificial Intelligence Mathematical Olympiad (AIMO) will launch on Kaggle in the coming weeks. The closing date will be announced on launch.
This second progress prize will increase the level of challenge for participants to National Olympiad level and will include 100 new maths problems to solve. The new challenges will be ‘AI hard’, meaning they will require mathematical reasoning, rather than brute force calculations or guesswork. The second progress prize totals $2.097 million, doubling the pot of the first progress prize awarded in July 2024.
Second progress prize details:
- $2.097 million prize pot.
- The Kaggle platform's private leaderboard will determine the distribution of $507,904 among the top five teams.
- Remainder of the pool shall be awarded to the highest-ranking team that achieves a score of at least 47/50 on both public and private test sets. If not won, it will roll over to the next year's prize pot.
- Eligibility for prizes requires the open publication of the teams' code, methodology, data, and model parameters.
For more details of the overall competition, please visit the AIMO Prize website or join the conversation on Reddit: r/AIMOprize.
XTX Markets is delighted to once again partner with Kaggle on this next phase of the AIMO competition. Competition rules will be fine-tuned for the second progress prize including updated ways open-source AI models can be used, and a substantial planned increase in provision of compute for participants. All new competition rules will be shared at launch.
This initiative is part of the $10 million AIMO Prize, launched in November 2023, aimed at fostering the development of AI models capable of mathematical reasoning. The ultimate goal is to create a publicly shared AI model that could achieve a gold medal standard at the International Mathematical Olympiad (IMO).
The first progress prize of $131k was won by Project Numina in July 2024. As well as publicly sharing their winning 7bn parameter model, Project Numina also released a 72bn parameter model and a dataset of 860k maths problems and solutions.
Terence Tao, UCLA, Fields Medallist and member of the AIMO Advisory Committee said
“The first competition demonstrated that lightweight, open-source models could solve a large fraction of high school competition mathematics problems with a small amount of compute.
This was an encouraging first step, but there are still several levels of difficulty remaining between the problems in our initial contest and the problems at the IMO, some of which have been recently shown to be attackable by much larger and compute-intensive proprietary models.
Our second competition, with increased problem difficulty but also a substantial planned increase of compute allocation, will hopefully make progress in closing the gap between these achievements.”
Terence Tao speaking at IMO 2024, sponsored by XTX Markets