Prompt Hallucination in ChatGPT!

This blog aims to explain the concept of Prompt Hallucination in ChatGPT, to be more general, in Generative API’s!

Harshit Dawar
3 min readMay 26, 2023
Image by Author!

ChatGPT’s hype is the next-level thing at present. Everyone is running behind using ChatGPT unknowing of some of the very crucial facts. I will create a list of blogs covering such facts. However, the goal of this blog is to explain what is Prompt Hallucination?, & How it can mislead you?

Since, ChatGPT is a generative AI Model, i.e., it is trained to generate responses based on the input it receives, therefore, there are chances that you will be getting made-up stories from ChatGPT instead of the realities.

Before understanding what is Prompt Hallucination, let’s first understand what a prompt is.

What is Prompt?

In very simple words, a prompt is just the query that you ask to ChatGPT. In other words, the question that you ask to ChatGPT is known as Prompt.

Prompt Hallucination

It is a scenario in which you ask a query to ChatGPT, but the response that you receive is completely made-up, i.e., it is false.

An example of the same is given in the below image as well as in the thumbnail of this blog, in which a prompt is been given to ChatGPT & the response of the ChatGPT can be clearly seen.

Image by Author!

Link to my code for the same:

Reason for Prompt Hallucination

The reason behind prompt hallucination is the generative approach, ChatGPT is developed in a way that it has to answer, it doesn’t matter whether the answer produced will be authorized or not or we can say whether the answer produced is trustworthy or not.

Therefore, you need to be very sure about the response that you are getting from ChatGPT, don’t believe on whatsoever is been generated by ChatGPT for you.

There exists a solution for this problem, I will cover that in my next blog. Till then, please have some patience, process what you have learned & enjoy.

I hope my article explains each and everything related to the topic with all the detailed concepts and explanations. Thank you so much for investing your time in reading my blog & boosting your knowledge. If you like my work, then I request you to applaud this blog & follow me on Medium, GitHub, & LinkedIn for more amazing content on multiple technologies and their integration!

Also, subscribe to me on Medium to get updates on all my blogs!

--

--

Harshit Dawar

AIOPS Engineer, have a demonstrated history of delivering large and complex projects. 14x Globally Certified. Rare & authentic content publisher.