[BUG] Claude says "You're absolutely right!" about everything · Issue #3382 · anthropics/claude-code
github.com
Environment Claude CLI version: 1.0.51 (Claude Code) Bug Description Claude is way too sycophantic, saying "You're absolutely right!" (or correct) on a sizeable fraction of responses. Expected Beha...
  • Korne127@lemmy.world
    59·
    11 months ago

    When using ChatGPT, I was so annoyed from it constantly saying “Great question”, “you’re absolutely right”, “That’s a great idea” and similar things, acting like everything I say was so smart until I confronted it and told it to stop (see the image, although it’s in German):

    It then saved this memory:

    Since then I didn’t have such issues anymore.

    • Brujones@lemmy.world
      10·
      11 months ago

      I did the same thing. I also asked it to stop coming off as so certain about things after I discovered how wrong it is on some topics. It now presents confidence levels, but who knows if that’s accurate. At least it reminds me to verify.

        • tinyvoltron@discuss.onlineEnglish
          7·
          11 months ago

          Because it can be a good starting point. Many times I have found chat GPT will give me three quarters of an answer. Which is still better than starting at zero. And then I can refine the answer.

      • spooky2092
        1·
        11 months ago

        Did that actually work? I’ve gotten in the habit of demand sources for outrageous claims, and it’s almost funny how often it quickly changes its tune when I press it.

    • cholesterol@lemmy.world
      3·
      11 months ago

      How the heck were you successful? I’ve asked for the exact same, and it makes no difference. It keeps praising me for using it.

      • Korne127@lemmy.world
        5·
        11 months ago

        Well, I don’t know if you’re able to read the German thing, but essentially, I asked it to stop and it said something like “Thank you so much for this honest feedback, that’s absolutely understandable” and I answered “this is exactly what I mean”, pointed out how glorifying this response to a simple request is and said that it should save that I want it to just talk normally, and then it just answered something like “okay, got it” and saved this memory for the future.
        So yeah, just make sure it actually saves and memorizes, and gets what you really mean. Since I did that, I had no issues whatsoever, and looking back at the old chats, it just feels insane how it talked back then.

        • cholesterol@lemmy.world
          2·
          11 months ago

          Cheers! I’ve just checked memories and it wasn’t there. Maybe I just didn’t notice that it didn’t actually save the request. I thought OpenAI just did a prompt injection forcing the ‘positivity’ on everyone, no matter what memories said. I’ll give it another go.

          edit: And just for anyone else reading, this is the memory I fed ChatGPT:

          Save this memory: I dislike you overly praising me for questions or statements I make. Comments like “Great question” or “That’s a keen insight” are generally not wanted. If my prompt resolves an issue I’ve been struggling with, you should point it out using natural, conversational language. In this case, a modest recognition helps convey the importance of what’s happened. But I strongly dislike a constant trickle of positive reinforcement embedded into our conversations.

        • spooky2092
          1·
          11 months ago

          Hopefully it actually keeps that up. I’ve put in a dozen or so directives because gpt has some really fucking stupid habits (like rewriting my whole fucking script when I asked for a minor revision, constantly using reserved names, awful syntax and style, etc) and it mostly follows them, but I still have to remind it almost daily to not do the shit I’ve told it not to do.