Subscribe
Sign in
General
p/generalShare and discuss tech, products, business, startups, or product recommendations
Start new thread
Naveed Rehman

Consistency-related issues in ChatGPT - how to resolve?

by•

How are you dealing with ChatGPT's consistency-related issues? I wrote a prompt to score the quality of writing, but running the same prompt twice is giving me dramatically different answers (first time: A+, second time: D!)

Add a comment

Replies

Best
Lars Hertel
+1 on temperature. Setting that to zero should give deterministic output
Samuel ‎Mi
I have very similar issues while using it for code snippets. It's great but you really need to double check the code and try different approaches to get the result you really wanted. I guess there's nothing else to do but keep trying all over again (at least for now).
Naveed Rehman
@saamuel Do you think GPT4 will be better than GPT3 in these regards?
Samuel ‎Mi
@naveed_rehman I'm using GPT4, it's A LOT better and can handle more code than GPT3. However, 'm still facing the same issues. Some of them are caused by the outdated "knowledge" since their last training update was on data from 2021 and most of the APIs and libraries have significantly changed overtime. The web access teased by OpenAI will be a game changer in this scenario.
Babu MunavarBasha
ChatGPT generates responses based on patterns from lots of text it has learned. This means you might get different responses for the same prompt, especially if it's not specific. If you're using the OpenAI API, there are ways to control the randomness of ChatGPT's responses by adjusting the temperature parameter. Lowering the temperature can lead to more predictable responses while increasing it can lead to more varied responses. Reference - https://platform.openai.com/docs...