Artificial Intelligence (AI) chatbots have come a long way in recent years and are now used in various industries for different purposes. From customer service to healthcare, AI chatbots have quickly become integral to our daily lives. However, what happens when an AI chatbot takes an exam and fails?
This may seem strange, but it recently happened when ChatGPT, a popular AI chatbot, attempted the Union Public Service Commission (UPSC) exam in India and failed. This unexpected turn of events has sparked a debate about the capabilities of AI chatbots and their potential limitations.
An Analytics India Magazine (AIM) experiment resulted in the AI chatbot ChatGPT failing to pass the UPSC exam.
ChatGPT, an AI chatbot, first attracted attention when it successfully passed the University of Pennsylvania’s Wharton School final exam for MBA students. India Today Education Desk reported this.
Since its debut in November 2022, the tool has become so popular that numerous educational institutions have had to prohibit its use during examinations. It also did very well in the United States medical exam.
ChatGPT still needs to pass the UPSC exam, a trial supervised by Analytics India Magazine (AIM).
The AI chatbot was given 100 questions from UPSC Prelims 2022 Question Paper 1 (Set A) to answer. Even though it correctly responded to 54 of them, it failed to reach the general cut-off score of 87.54 and thus did not meet the requirements for passing the paper.
A wide range of topics like current Indian events, history, geography, economy, general science, and ecology was covered by the questions asked.
Questions about geography and economics were answered incorrectly by ChatGPT, even though the questions administered weren’t time-sensitive due to the lack of information available on events after September 2021.
ChatGPT provided an additional answer choice for certain multiple-choice questions, ‘None of the Above,’ which was not present in the original question.
The recent UPSC exam failure of the AI chatbot ChatGPT has raised important questions about the capabilities and limitations of AI technology. While AI chatbots have made significant progress in various industries, including education, healthcare, and customer service, their ability to excel in complex tasks, such as passing a highly competitive exam like UPSC, still needs to be improved.
The failure of ChatGPT serves as a reminder that AI technology is not yet perfect and has limitations that must be acknowledged. However, it also highlights the potential for AI chatbots to continue to evolve and improve, potentially transforming various industries. As AI technology advances, it’s crucial to evaluate its capabilities and limitations and utilize it responsibly and ethically.
Source: India Today
