• Subscribe
    1. Discussions
    2. Consistency-related issues in ChatGPT - how to resolve?

    Consistency-related issues in ChatGPT - how to resolve?

    Naveed Rehman
    7 replies
    How are you dealing with ChatGPT's consistency-related issues? I wrote a prompt to score the quality of writing, but running the same prompt twice is giving me dramatically different answers (first time: A+, second time: D!)

    Replies

    Lars Hertel
    Brayniac
    Brayniac
    +1 on temperature. Setting that to zero should give deterministic output
    Share
    Babu MunavarBasha
    Whautomate
    Whautomate
    ChatGPT generates responses based on patterns from lots of text it has learned. This means you might get different responses for the same prompt, especially if it's not specific. If you're using the OpenAI API, there are ways to control the randomness of ChatGPT's responses by adjusting the temperature parameter. Lowering the temperature can lead to more predictable responses while increasing it can lead to more varied responses. Reference - https://platform.openai.com/docs...
    Share
    Samuel ‎Mi
    I have very similar issues while using it for code snippets. It's great but you really need to double check the code and try different approaches to get the result you really wanted. I guess there's nothing else to do but keep trying all over again (at least for now).
    Share
    Naveed Rehman
    YeyPin
    YeyPin
    @saamuel Do you think GPT4 will be better than GPT3 in these regards?
    Share
    Samuel ‎Mi
    @naveed_rehman I'm using GPT4, it's A LOT better and can handle more code than GPT3. However, 'm still facing the same issues. Some of them are caused by the outdated "knowledge" since their last training update was on data from 2021 and most of the APIs and libraries have significantly changed overtime. The web access teased by OpenAI will be a game changer in this scenario.
    Share