ChatGPT Fails To Answer 52% Software Engineering Questions


Rohit Kulkarni

Rohit Kulkarni

May 27, 2024


ChatGPT Fails To Answer 52% Software Engineering Questions

ChatGPT, the AI chatbot, was launched in November 2022 and has been in the headlines for its excellence in the field of AI.

The chatbot has been able to perform various human tasks from acing competitive exams to composing music and songs which makes it a revolutionalising technology for the coming future.

Concerns about ChatGPT – Accuracy

ChatGPT, even being of the best and most popular AI chatbot all over the world, has been under scanner for its concerns regarding the accuracy of its responses.

A study by Purdue University in the US has found that the AI chatbot’s answers to be inaccurate by up to 52 percent. Researchers had fed ChatGPT with 517 questions from the software development website Stack Overflow. 52 percent of the responses were inaccurate and 77 percent of responses were termed as “verbose” as it was ChatGPT’s inability to fully understand the concepts behind the questions.

Researchers also opined that even after understanding the questions, the AI chatbot could not come to a solution which put up a higher number of conceptual flaws. This led them to question the chatbot’s limited reasoning.

OpenAI on the verge of bankruptcy?

With such hitches coming to the notice, ChatGPT’s users are declining states a recent report by Analytics India Magazine. The chatbot has been experiencing an increasing fall in the number of users since June 2023.

In just a span of one month, that is,  June – July, the number of users declined by 12 percent bringing 1.7 billion users to 1.5 billion.

The report also says that OpenAI, the parent company of ChatGPT, has not been profitable and is going on an investment of USD 10 million by Microsoft.

With ChatGPT needing almost USD 700,000 to operate daily, OpenAI needs to be profitable very soon otherwise it might go bankrupt.


Rohit Kulkarni
Rohit Kulkarni
  • 943 Posts

Subscribe Now!

Get latest news and views related to startups, tech and business

You Might Also Like

Technology
Sep. 8, 2022

Samsung Launches The Wall All-In-One and Flip Pro: Is This The Future Of Display Technology?

Samsung has launched The Wall All-In-One – the modular MicroLED it says is revolutionizing the future of display and the Flip Pro, which is an interactive display. Both were unveiled at the InfoComm India 2022 which is India’s Professional AudioVisual (Pro AV) and Systems Integration Technology Exhibition. This took place in Mumbai from September 5-7. […]

Technology
Jul. 28, 2022

Google Street View Launches In India Across These 10 Indians Cities! Plans To Expand To 700,000 Kms, 50 Cities In 2 Years

Google’s Street View is finally available in India a decade after it was prevented from capturing data for its Street View services. Second coming Street view offers a 360-degree interactive panorama feature initially for 10 Indian cities with data from local partners Tech Mahindra and Mumbai-based Genesis International. Its entry into India is facilitated by […]

Technology
Jul. 10, 2022

This Electricity-Free Cooler Developed By IIT Researchers Can Replace Air Conditioners! How It Work?

Indian Institute of Technology Guwahati researchers have built a ‘Radiative Cooler’ which does not require electricity to operate. This is an affordable and efficient ‘passive’ radiative cooling system that can serve as an alternative to ACs. The coating material is an electricity-free cooling system that can be applied in the rooftops and functions during both […]

Technology
Jun. 27, 2022

This New Battery Will Enable Electric Cars To Run 1000 Kms In Single Charge! Will This Transform Electric Mobility?

Chinese company Contemporary Amperex Technology Co Ltd (CATL) has developed a battery that gives EVs a driving range of over 1,000 km or 621 miles on a single charge. About the company The company is China’s leading automotive lithium-ion battery maker. Tesla, Volkswagen, BMW, and Nio are among the companies for which CATL supplies batteries. […]

Recent Posts

Related Videos

   

Subscribe Now!

Get latest news and views related to startups, tech and business

who's online