• Jack@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    16 hours ago

    that it should only change anything when explicitly asked to.

    Does that work?

    • Kaligalis@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      45 minutes ago

      Yes. There are the rare exceptions. But since I had to tell it to save to it’s memory that it isn’t allowed to change stuff without a command to do so and that it shall treat my questions as just that (this is likely the actually important part). Then I had to scold it a few times when it ignored the rules. And since then, it actually does obey very consistently.
      I use Claude Code, but would expect any frontier LLM to have some “memory” system (in case of Claude Code just an index file and one file per memorized rule or fact).

      I first saw something like multi-session “memory” in AIDungeon years ago. It was slow and with only a few kB of context not worth using. But that was literally a toy.

    • Boost@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      12 hours ago

      Also not the person you responded to but in my experience, yes. I don’t tell it to “save it in its memory files” because I don’t think that’s a thing, but including “do not actually edit any files, only propose changes” somewhere in the initial prompt of a conversation has worked well for me.

    • Passerby6497@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 hours ago

      Not the person you responded to, but yeah, it seems to in my case.

      I’m one of those people that don’t exist, in that any AI code I generate is reviewed prior to running. I’ve been forced to use fucking copilot to check in the source I have to a new company repository, and so far diffing the code checked into source control is unchanged, but it seems to be good about updating the header to the standard in supposed to be using. I’m also having it do basic reviews of the code and only updating the files as I see fit.