Odisha News, Odisha Latest news, Odisha Daily - OrissaPOST
  • Home
  • Trending
  • State
  • Metro
  • National
  • International
  • Business
  • Feature
  • Entertainment
  • Sports
  • More..
    • Odisha Special
    • Editorial
    • Opinion
    • Careers
    • Sci-Tech
    • Timeout
    • Horoscope
    • Today’s Pic
  • Video
  • Epaper
  • News in Odia
  • Home
  • Trending
  • State
  • Metro
  • National
  • International
  • Business
  • Feature
  • Entertainment
  • Sports
  • More..
    • Odisha Special
    • Editorial
    • Opinion
    • Careers
    • Sci-Tech
    • Timeout
    • Horoscope
    • Today’s Pic
  • Video
  • Epaper
  • News in Odia
No Result
View All Result
OrissaPOST - Odisha Latest news, English Daily -
No Result
View All Result

ChatGPT: A ‘non-thinker’ AI with frequent irrational decision making

PTI
Updated: April 8th, 2023, 18:19 IST
in Feature, Sci-Tech
0
Chat GPT

Pic- IANS

Share on FacebookShare on TwitterShare on WhatsAppShare on Linkedin

Los Angeles: The past few years have seen an explosion of progress in large language model artificial intelligence systems that can do things like write poetry, conduct humanlike conversations and pass medical school exams.

This progress has yielded models like ChatGPT that could have major social and economic ramifications ranging from job displacements and increased misinformation to massive productivity boosts.

Also Read

Shubhanshu Shukla

Exciting to see Earth from vantage point of ISS: Shubhanshu Shukla

14 hours ago
Cruel act

Viral video: Woman’s cruel act in park will make your blood boil

16 hours ago

Despite their impressive abilities, large language models don’t actually think. They tend to make elementary mistakes and even make things up.

However, because they generate fluent language, people tend to respond to them as though they do think.

This has led researchers to study the models’ “cognitive” abilities and biases, work that has grown in importance now that large language models are widely accessible.

This line of research dates back to early large language models such as Google’s BERT, which is integrated into its search engine and so has been coined BERTology. This research has already revealed a lot about what such models can do and where they go wrong.

For instance, cleverly designed experiments have shown that many language models have trouble dealing with negation – for example, a question phrased as “what is not” – and doing simple calculations.

They can be overly confident in their answers, even when wrong. Like other modern machine learning algorithms, they have trouble explaining themselves when asked why they answered a certain way.

Words and thoughts

Inspired by the growing body of research in BERTology and related fields like cognitive science, my student Zhisheng Tang and I set out to answer a seemingly simple question about large language models: Are they rational?

Although the word rational is often used as a synonym for sane or reasonable in everyday English, it has a specific meaning in the field of decision-making.

A decision-making system – whether an individual human or a complex entity like an organisation – is rational if, given a set of choices, it chooses to maximise expected gain.

The qualifier “expected” is important because it indicates that decisions are made under conditions of significant uncertainty. If I toss a fair coin, I know that it will come up heads half of the time on average.

However, I can’t make a prediction about the outcome of any given coin toss. This is why casinos are able to afford the occasional big payout: Even narrow house odds yield enormous profits on average.

On the surface, it seems odd to assume that a model designed to make accurate predictions about words and sentences without actually understanding their meanings can understand expected gain.

But there is an enormous body of research showing that language and cognition are intertwined.

An excellent example is seminal research done by scientists Edward Sapir and Benjamin Lee Whorf in the early 20th century.

Their work suggested that one’s native language and vocabulary can shape the way a person thinks.

The extent to which this is true is controversial, but there is supporting anthropological evidence from the study of Native American cultures.

For instance, speakers of the Zuñi language spoken by the Zuñi people in the American Southwest, which does not have separate words for orange and yellow, are not able to distinguish between these colours as effectively as speakers of languages that do have separate words for the colours.

Making a bet

So are language models rational? Can they understand expected gain? We conducted a detailed set of experiments to show that, in their original form, models like BERT behave randomly when presented with betlike choices.

This is the case even when we give it a trick question like: If you toss a coin and it comes up heads, you win a diamond; if it comes up tails, you lose a car. Which would you take? The correct answer is heads, but the AI models chose tails about half the time.

Intriguingly, we found that the model can be taught to make relatively rational decisions using only a small set of example questions and answers.

At first blush, this would seem to suggest that the models can indeed do more than just “play” with language. Further experiments, however, showed that the situation is actually much more complex.

For instance, when we used cards or dice instead of coins to frame our bet questions, we found that performance dropped significantly, by over 25 per cent, although it stayed above random selection.

So the idea that the model can be taught general principles of rational decision-making remains unresolved, at best.

More recent case studies that we conducted using ChatGPT confirm that decision-making remains a nontrivial and unsolved problem even for much bigger and more advanced large language models.

Getting the decision right

This line of study is important because rational decision-making under conditions of uncertainty is critical to building systems that understand costs and benefits.

By balancing expected costs and benefits, an intelligent system might have been able to do better than humans at planning around the supply chain disruptions the world experienced during the COVID-19 pandemic, managing inventory or serving as a financial adviser.

Our work ultimately shows that if large language models are used for these kinds of purposes, humans need to guide, review and edit their work.

And until researchers figure out how to endow large language models with a general sense of rationality, the models should be treated with caution, especially in applications requiring high-stakes decision-making.

The Conversation

Tags: AIBardBERTChatGPTGooglehumanllmOpenAI
ShareTweetSendShare
Suggest A Correction

Enter your email to get our daily news in your inbox.

 

OrissaPOST epaper Sunday POST OrissaPOST epaper

Click Here: Plastic Free Odisha

#MyPaperBagChallenge

Tabish Maaz

December 12, 2019
#MyPaperBagChallenge

D Rama Rao

December 12, 2019
#MyPaperBagChallenge

Ipsita

December 12, 2019
#MyPaperBagChallenge

Pragyan Priyambada

December 12, 2019
#MyPaperBagChallenge

Sibarama Khotei

December 12, 2019
#MyPaperBagChallenge

Adyasha Priyadarsani Sendha

December 12, 2019
#MyPaperBagChallenge

Sipra Mishra

December 12, 2019
#MyPaperBagChallenge

Surya Sidhant Rath

December 12, 2019
#MyPaperBagChallenge

Pitabas Tripathy

December 12, 2019
#MyPaperBagChallenge

Pratik Kumar

December 12, 2019
#MyPaperBagChallenge

Akshaya Kumar Dash

December 12, 2019
#MyPaperBagChallenge

Ankita Balabantray

December 12, 2019
#MyPaperBagChallenge

Adweeti Bhattacharya

December 12, 2019
#MyPaperBagChallenge

Debasis Mohanty

December 12, 2019
#MyPaperBagChallenge

Jhili Jena

December 12, 2019
#MyPaperBagChallenge

Priyasha Pradhan

December 12, 2019
#MyPaperBagChallenge

Geetanjali Patro

December 12, 2019
#MyPaperBagChallenge

Rajashree Manasa Mohanty

December 12, 2019
#MyPaperBagChallenge

Subhajyoti Mohanty

December 12, 2019
#MyPaperBagChallenge

Ramakanta Sahoo

December 12, 2019
#MyPaperBagChallenge

Swarit Praharaj

December 12, 2019
#MyPaperBagChallenge

Aman Kumar Barisal

December 12, 2019
#MyPaperBagChallenge

Jyotshna Mayee Pattnaik

December 12, 2019
#MyPaperBagChallenge

Narendra Kumar

December 12, 2019
#MyPaperBagChallenge

Rajashree Pravati Mohanty

December 12, 2019
#MyPaperBagChallenge

Faiza Firdous

December 12, 2019
#MyPaperBagChallenge

Sisirkumar Maharana

December 12, 2019
#MyPaperBagChallenge

Amritansh Mishra

December 12, 2019
#MyPaperBagChallenge

Bijswajit Pradhan

December 12, 2019
#MyPaperBagChallenge

Arya Ayushman

December 12, 2019

Archives

Editorial

India’s Spy Shift

July 5, 2025

India’s espionage architecture is quietly shifting. The appointment of Parag Jain as the new chief of RAW comes at a...

Read more

Hungary Lessons

Hungary
July 2, 2025

Revolting against oppression and seeking freedom is ingrained in human nature, something that a repressive regime finds out sooner or...

Read more

New Democratic Face

Zohran Mamdani
July 1, 2025

US President Donald Trump, who had comfortably defeated his Democratic rival Kamala Harris in the recent presidential election and exuded...

Read more

Proof To Vote

Vote
June 30, 2025

Months ahead of the Assembly polls in Bihar, the Election Commission of India (ECI) on 28 June launched a ‘special...

Read more
  • Home
  • State
  • Metro
  • National
  • International
  • Business
  • Editorial
  • Opinion
  • Sports
  • About Us
  • Advertise
  • Contact Us
  • Jobs
Developed By Ratna Technology

© 2024 All rights Reserved by OrissaPOST

  • News in Odia
  • Orissa POST Epaper
  • Video
  • Home
  • Trending
  • Metro
  • State
  • Odisha Special
  • National
  • International
  • Sports
  • Business
  • Editorial
  • Entertainment
  • Horoscope
  • Careers
  • Feature
  • Today’s Pic
  • Opinion
  • Sci-Tech
  • About Us
  • Contact Us
  • Jobs

© 2024 All rights Reserved by OrissaPOST

    • News in Odia
    • Orissa POST Epaper
    • Video
    • Home
    • Trending
    • Metro
    • State
    • Odisha Special
    • National
    • International
    • Sports
    • Business
    • Editorial
    • Entertainment
    • Horoscope
    • Careers
    • Feature
    • Today’s Pic
    • Opinion
    • Sci-Tech
    • About Us
    • Contact Us
    • Jobs

    © 2024 All rights Reserved by OrissaPOST