OpenAI faces significant challenges in developing ChatGPT-5.

According to TechSpot , OpenAI is facing many challenges in developing ChatGPT-5, a next-generation large language model. ChatGPT-5, codenamed "Project Orion," has been under development for 18 months but has not made significant progress.

Although OpenAI has completed at least two initial training phases, the results have not been as promising as expected. One of the main reasons is the insufficient diversity and quality of the training data. The use of data from the public internet has reached its limit, forcing the company to seek alternatives such as creating aggregated data or hiring people to manually produce data.

GPT-5 requires 133 times more GPUs than GPT-4, which will be a difficult challenge for OpenAI.

While human data generation offers better quality, it faces obstacles in terms of time and cost. For example, generating one billion tokens (units of text processed by AI models) of data would require approximately 1,000 people writing 5,000 words each day for many months. Meanwhile, methods using aggregated data—generated by current AI models—carry risks regarding quality, increasing the likelihood of inefficient data loops.

Beyond data issues, the ChatGPT-5 training process also faced technical obstacles. The initial testing phase proceeded more slowly than expected, leading to longer training times and increased costs for large-scale training. This raised questions about the feasibility of developing a model superior to GPT-4, which had already cost billions of dollars to perfect.

Furthermore, internal instability at OpenAI has significantly impacted the project's progress. In late 2023, CEO Sam Altman was temporarily suspended, leading to the departure of over 20 key personnel this year. Altman has admitted that the earlier release of GPT-40 was the primary reason for the ChatGPT-5 delay.

Delays and rising costs have put OpenAI under significant pressure from investors, particularly Microsoft – the company's largest partner. With billions of dollars already poured into the AI ​​field, OpenAI is compelled to demonstrate that ChatGPT-5 represents a significant improvement over its predecessor. However, with increasingly scarce training data, this goal is proving difficult to achieve.

Currently, the future of ChatGPT-5 remains uncertain. OpenAI will need to address current challenges and find ways to optimize resources to maintain its position in the artificial intelligence technology race.

Source: https://thanhnien.vn/openai-doi-mat-kho-khan-lon-khi-phat-trien-chatgpt-5-1852412232345532.htm