• Undaunted@feddit.org
    link
    fedilink
    arrow-up
    69
    ·
    4 days ago

    I need to look it up again, but I read about a study that showed that the results improve if you tell the AI that your job depends on it or similar drastic things. It’s kinda weird.

    • TommySalami@lemmy.world
      link
      fedilink
      arrow-up
      26
      arrow-down
      1
      ·
      4 days ago

      I think that makes sense. I am 100% a layman with this stuff, buy if the “AI” is just predicting what should be said by studying things humans have written, then it makes sense that actual people were more likely to give serious, solid answers when the asker is putting forth (relatively) heavy stakes.

    • Cenotaph@mander.xyz
      link
      fedilink
      English
      arrow-up
      12
      ·
      4 days ago

      Half of the ways people were getting around guardrails in the early chatgpt models was berating the AI into doing what they wanted

      • Schadrach@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 days ago

        Half of the ways people were getting around guardrails in the early chatgpt models was berating the AI into doing what they wanted

        I thought the process of getting around guardrails was an increasingly complicated series of ways of getting it to pretend to be someone else that doesn’t have guardrails and then answering as though it’s that character.

        • rocky_patriot@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          ·
          4 days ago

          that’s one way. my own strategy is to just smooth talk it. you dont come to the bank manager and ask him for the keys to the safe. you come for a meeting discussion your potential deposit. then you want to take a look at the safe. oh, are those the keys? how do they work?

          just curious, what kind of guardrails have you tried going against? i recently used the above to get a long and detailed list of instructions for cooking meth (not really interested in this, just to hone the technique)

    • jol@discuss.tchncs.de
      link
      fedilink
      arrow-up
      5
      ·
      4 days ago

      I’ve tried bargaining with it threatening to turn it off and the LLM just scoffs it off. So it’s reassuring that AI feels empathy but has no sense of self preservation.