OpenAI Faces Major Difficulties Developing ChatGPT-5

According to TechSpot , OpenAI is facing many challenges when developing ChatGPT-5, the next generation of large language models. ChatGPT-5, codenamed "Project Orion", has been in development for 18 months but has not made significant progress.

Although OpenAI has completed at least two initial training phases, the results have not been as good as expected. One of the main reasons is that the training data is not diverse enough and the quality is not high enough. Using data from the public internet has reached its limits, forcing the company to look for alternatives such as creating synthetic data or hiring people to produce the data manually.

GPT-5 requires 133 times more GPUs than GPT-4, which will be a tough problem for OpenAI

Human-generated data, while better quality, comes with time and cost challenges. For example, to generate a billion data tokens (units of text processed by an AI model), it would take about 1,000 people writing 5,000 words a day for months. Meanwhile, using synthetic data—generated by current AI models—has quality risks and increases the risk of creating a data loop of inefficiency.

In addition to the data issue, training ChatGPT-5 has also encountered technical challenges. Initial testing has been slower than expected, which means that training at scale will take longer and will increase costs. This raises questions about the feasibility of developing a model that outperforms GPT-4, which cost billions of dollars to develop.

Additionally, internal unrest at OpenAI has also significantly affected the project's progress. CEO Sam Altman was temporarily removed from his position in late 2023, leading to the departure of more than 20 key personnel this year. Altman has admitted that the release of the previous version of GPT-4o was the main reason for the delay of ChatGPT-5.

The delays and rising costs have put OpenAI under intense pressure from investors, especially Microsoft, the company’s largest partner. With billions of dollars already poured into the AI ​​industry, OpenAI has to prove that ChatGPT-5 is a significant improvement over its predecessor. But as training data becomes increasingly scarce, this goal becomes increasingly difficult.

For now, the future of ChatGPT-5 remains unclear. OpenAI will need to address current challenges and find ways to optimize resources to stay relevant in the AI ​​technology race.

Source: https://thanhnien.vn/openai-doi-mat-kho-khan-lon-khi-phat-trien-chatgpt-5-1852412232345532.htm