17 comments

  • synalx an hour ago

    I have this problem even in codebases. Claude will work on something, and add detailed comments in which it extrapolates the from the design and confidently states intentions and decisions which aren't actually grounded in reality. Then, later sessions suffer when it reads back those hallucinations and treats them as canonical.

      mrtesthah 36 minutes ago

      Probably good to establish canonical spec documents up front that it can use and maintain as an independent reference?

        lupire 34 minutes ago

        Doesn't need to be "up front", but you do need to curate the context.

        AI can't read your mind, and it will read what you (or anyone else) wrote.

          Sharlin 2 minutes ago

          Humans can’t read minds either, but most humans aren’t so dumb as to forget what is a normative spec and what is just their own current, evolving model of the problem space. (Though some humans certainly are…)

          pydry 21 minutes ago

          It can't but it will try and getting it to stop is often infeasible.

      bsjdhdudj 16 minutes ago

      why would you not delete the comments? why are they saved or checked in? don't you read the code? and if you don't: ISN'T THIS WHY YOU NEED TO?

      I feel like I'm losing my mind, what the fuck is wrong with all of you?

  • helsinkiandrew 23 minutes ago

    There was a related study posted awhile ago:

    > When people think AI did the creative work, task meaning and effort decline

    https://www.brookings.edu/articles/when-people-think-ai-did-...

  • chessucation 20 minutes ago

    i've been dabbling with various assistant models and instances and find that there's an interesting "idea" that pops up from their synthesis and relevancy analysis at a decent frequency. some kind of "inverse prompting" in which the machine has an angle, perspective, opportunity (based on the context it's working with/in) and the human turns those seedlings into something useful... or else decides its weed to be discarded.

      HPsquared 9 minutes ago

      The prompter becomes the prompted!

  • gdulli 29 minutes ago

    What am I even here for if not to have my own ideas?

      datakan 11 minutes ago

      “After we started thinking for you it became our society” The Matrix 1999

  • zazuke 2 hours ago

    While I use Claude a lot for my Omarchy plugins and Linux optimization/failure detection, I don’t use it for writing and note-taking, especially for coming up with unique ideas and driving them home by writing them through to the end.

    It's so hard to finish an idea that is not yours and is just suggested by AI.

      lupire 32 minutes ago

      It's also hard to finish an idea that is mine.

  • empath75 an hour ago

    I think having AI keep it's _own_ notes in Obsidian is a good idea because it makes them convenient for you to read, but yeah you need to quarantine agent ideas from your own ideas because otherwise you get bad cito-genesis problems. https://xkcd.com/978/

      mrtesthah 14 minutes ago

      This might work to keep work separate:

      https://github.com/eighttrigrams/us-vs-them

      lupire 31 minutes ago

      I don't understand. Are you saying that AI should write notes but then they should be excluded from the AI's context?

        swiftcoder 18 minutes ago

        Two different knowledge bases. One to store AI's "learned" context, the other for you to manually edit.