Inspired by Google's AlphaCode and AlphaCode 2 coding tools, Codium AI announced that it has just achieved promising results in the research and development process of AlphaCodium - a new artificial intelligence (AI) code generation tool.
Based on the test results, AlphaCodium is the best code generation method, outperforming Google's AlphaCode and AlphaCode2 without additional model tuning, bringing humanity one step closer to letting AI write code instead of humans.
Codium AI has set itself the mission of 'helping developers code faster and with fewer errors'. The AlphaCodium engine was tested on the CodeContests dataset, which contains around 10,000 programming problems. The technology's performance on this benchmark shows an improvement in accuracy from GPT-4 from 19% to 44%. "This result is not only a quantitative improvement but also a breakthrough in the code generation capabilities of Large Language Models (LLMs), setting a new standard in the field," CodiumAI said.
AlphaCodium consists of two main phases: Preprocessing phase and Code iteration phase. In the preprocessing phase, the model focuses on the goal, inputs, outputs, rules, constraints and describes them in bullet points. After analysis and testing, the tool generates several possible solutions to the problem and ranks them from complex to simple.
In the next phase, the solutions will iteratively run on AI-generated test cases and correct the code as errors are encountered until a final solution is reached that is unlikely to be an error. The model uses a test pattern with specific questions to distinguish incorrect code during iteration.
CodiumAI, founded in 2022, raised $10.6 million in funding in March 2023.
(according to MTP)
Excessive expectations about AI are holding back the tech world
Google Chrome browser launches 3 new AI features at the same time
AI will be able to invent, trade and manage businesses.
Source
Comment (0)