OpenAI, Google Finding It Tough To Induce More AI Innovation


Rohit Kulkarni

Rohit Kulkarni

Nov 18, 2024


OpenAI, the company who has stirred up the world with its ChatGPT, is now training its new AI model Orion. However, the new model has failed to meet the expectations during its initial training despite being able to significantly outperform previous versions like ChatGPT.

OpenAI, Google Finding It Tough To Induce More AI Innovation

OpenAI’s Orion Struggles with Coding

Despite being a step forward than earlier predecessor, Orion struggled, particularly with coding tasks. This issue also goes on to reflects broader challenges in the AI industry, which includes the likes of companies like Google and Anthropic, which are encountering diminishing returns on their increasingly expensive AI models.

A key obstacle is difficulty of sourcing high-quality training data, with Orion’s coding performance limited by insufficient data. In addition to this, from economic point of view, even these incremental improvements do not justify the enormous costs of building and running new models.

OpenAI has been refining Orion through a post-training process while incorporating human feedback and adjusting the model’s responses, but the release isn’t expected until early 2025.

Challenging the AI Assumption: Experts Question the Path to AGI Amid Rising Costs and Data Constraints

There is an assumption in Silicon Valley that larger models as well as more computing power would lead to inevitable breakthroughs and these issue challenge this assumption. Many experts are now questioning the feasibility of achieving artificial general intelligence (AGI) in the near future.

Dario Amodei of Anthropic acknowledged that challenges such as data limitations could derail progress, although he remains optimistic about overcoming these hurdles.

Tech companies are increasingly relying on synthetic data and specialized experts to improve training, but these efforts are slow and costly. With increasing complexity of AI models, the cost of these system increases which leads to difficult decisions about whether to continue investing in newer models or improve older ones.

OpenAI, for example, has focused on incremental updates to ChatGPT rather than introducing a major new release like GPT-5. Ultimately, these challenges raise doubts about the rapid pace of AI advancement and the sustainability of the industry’s current trajectory.


Rohit Kulkarni
Rohit Kulkarni
  • 1178 Posts

Subscribe Now!

Get latest news and views related to startups, tech and business

You Might Also Like

Technology
Sep. 8, 2022

Samsung Launches The Wall All-In-One and Flip Pro: Is This The Future Of Display Technology?

Samsung has launched The Wall All-In-One – the modular MicroLED it says is revolutionizing the future of display and the Flip Pro, which is an interactive display. Both were unveiled at the InfoComm India 2022 which is India’s Professional AudioVisual (Pro AV) and Systems Integration Technology Exhibition. This took place in Mumbai from September 5-7. […]

Technology
Jul. 28, 2022

Google Street View Launches In India Across These 10 Indians Cities! Plans To Expand To 700,000 Kms, 50 Cities In 2 Years

Google’s Street View is finally available in India a decade after it was prevented from capturing data for its Street View services. Second coming Street view offers a 360-degree interactive panorama feature initially for 10 Indian cities with data from local partners Tech Mahindra and Mumbai-based Genesis International. Its entry into India is facilitated by […]

Technology
Jul. 10, 2022

This Electricity-Free Cooler Developed By IIT Researchers Can Replace Air Conditioners! How It Work?

Indian Institute of Technology Guwahati researchers have built a ‘Radiative Cooler’ which does not require electricity to operate. This is an affordable and efficient ‘passive’ radiative cooling system that can serve as an alternative to ACs. The coating material is an electricity-free cooling system that can be applied in the rooftops and functions during both […]

Technology
Jun. 27, 2022

This New Battery Will Enable Electric Cars To Run 1000 Kms In Single Charge! Will This Transform Electric Mobility?

Chinese company Contemporary Amperex Technology Co Ltd (CATL) has developed a battery that gives EVs a driving range of over 1,000 km or 621 miles on a single charge. About the company The company is China’s leading automotive lithium-ion battery maker. Tesla, Volkswagen, BMW, and Nio are among the companies for which CATL supplies batteries. […]

Recent Posts

Related Videos

   

Subscribe Now!

Get latest news and views related to startups, tech and business

who's online