What Is a Harness?

40 points | by tosh an hour ago

27 comments

  • theturtletalks 31 minutes ago

    Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.” Right now, it’s like an AC vs DC between Claude and ChatGPT, but once that settles, the harnesses will be the actual value providers.

    And Pi is the best harness because of the amazing extension system. You can build extensions that turn Pi into a stock trader, software factory, anything. I tried switching to another harness but none have extension functionality as good as Pi.

    Even if there is a new harness or agent project, I tell Pi to dig into the codebase and then make me an extension that brings that functionality into Pi. I did it with Prime Intellect’s and Deepseek’s harnesses and those are built on Pi.

      amelius 6 minutes ago

      > If LLMs are electricity, harnesses are the “electronics.” (...) the harnesses will be the actual value providers.

      Don't get ahead of yourself. Harnesses are not exactly rocket science and will be a commodity.

      The real value providers here are the hardware, then the LLM as a distant second, and at a much larger distance the harness.

      mpawelski 16 minutes ago

      > Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.”

      I really though this comment was a satire ...

        grey-area 3 minutes ago

        Sadly, many people have bought into the cult that LLMs will lead to AGI. I guess if that is your worldview then all this babbling about new frontiers makes more sense.

        They probably used an LLM to come up with this bizarre metaphor.

      jrflo 11 minutes ago

      I've never used Pi but I don't see why you can't use stock codex or claude code for the same purpose, what makes Pi special? I've built plenty of custom harnesses on top of claude code and codex using custom skills or simple markdown instructions and subagents. Never had any issues or limitations with that approach.

      I do agree that harnesses are going to extend AI capabilities a lot in the next year, but after reading Pi's page I don't see anything that makes it particularly special in terms of functionality, other than being more provider-agnostic.

        lebek a few seconds ago

        Codex and Claude historically had more bloat in their system prompt and tools. Pi is minimal by design so more adaptable. But to be fair Claude Code is moving in the Pi direction with a small system prompt.

        throwup238 5 minutes ago

        For one you can ask Pi to create a TUI extension, so along with the agent interface you can add whatever custom TUI you need, such as portfolio stock tickers, alerts, whatever you want.

        Many of my harnesses eventually turn into customized UIs around the chat interface.

      GodelNumbering 20 minutes ago

      This is a plug, but relevant. I recently added a 'build native tools on the fly' functionality to Dirac (https://github.com/dirac-run/dirac) that works like:

      1. You can use the '/new-tool' and tell what kind of tool you want (including whether it should be task-scoped, workspace-scoped, or global), the model builds it, the harness runs validation and other tests until the tool is ready

      2. The model decides that in such and such task, it would be helpful to have a tool like this, it can build a task-scoped tool.

      In either scenario, the tool catalog is rebuilt, and the new tool is instantly available in the next turn.

      sejje 15 minutes ago

      What did you bring over from prime-agent? (I use prime-agent as my daily since it launched)

      I primarily like how it manages sessions, and how agents can easily reference other sessions.

      timbowhite 18 minutes ago

      Pi's most popular extensions, by download count:

      https://pi.dev/packages?type=extension

      oceansky 27 minutes ago

      I want to move from Claude Desktop to Pi, but I found it a little unfriendly. Any tips to set it up?

        theturtletalks 11 minutes ago

        Pi doesn’t have a UI like Claude Desktop. It also doesn’t work with the Claude subscription, only API key and pricing.

        So if you do want to use it, use the Codex sub. Once you install it, run Pi and /login and you’ll get login with ChatGPT. From there, Pi can tweak it’s settings if you ask. Check out their extensions (or ask Pi) and that will take you most of the way there.

        What hiccups were you having?

        zukzuk 13 minutes ago

        I haven’t tried it myself yet but I’m under the impression that Hermes Agent might be what you’re looking for?

      Topfi 10 minutes ago

      Please tell me this is satire, it reads like straight from the depths of LinkedIn where a while loop is seen as the second coming…

      hliyan 7 minutes ago

      Are human HN commenters now starting to speak in a dialect of Claudish?

      irishcoffee 26 minutes ago

      How does Pi compare to vscode? Admittedly that is the only “agent/harness” I’ve ever used.

      dominotw 17 minutes ago

      i think its the opposite. claude code apparently removed hundreds of lines of system prompt because its not relavent anymore with newer models.

      also i think its hard to build general harnesses if they were trained on specific harness architecture.

        theturtletalks 4 minutes ago

        Yes but Pi has had a minimal system prompt since inception. Skills and Pi extensions let you make a hyper specific harness for specific use cases. For general conversation, harnesses are overkill most times.

        There’s evidence of harnesses making a smaller, weaker model perform better than SOTA and some benchmarks ban harnesses because it becomes too easy.

      cyanydeez 27 minutes ago

      what have you built other than a harness?

        theturtletalks 8 minutes ago

        I built a software factory and am now building a stock trader using opencandle extension[0] and a custom extension. For inspiration for how to tweak Pi, check out OMP, Prime Intellect, and Deepseek harnesses.

        0. https://github.com/Kahtaf/OpenCandle

  • tosh 3 minutes ago

    i also like the backpack analogy

    the harness is what you take with you on a trip/task

    whatever you take with you is not free (system prompt, tools, skills …)

    some models are really good even if you bring almost no skills, tools or system prompt

    the harness is the complement to the model

    the better the model the more minimal the harness can be

    harnesses like pi [0] and smol [1]are on the more minimal end of things

    [0] https://github.com/earendil-works/pi

    [1] https://github.com/smol-env/smol

  • thelastgallon 2 minutes ago

    Is harness load-bearing?

  • childofhedgehog 33 minutes ago

    Clear, relevant, and easy to understand. Thank you for writing this up, I’ll be sharing this link with all my non-tech friends!

  • jascha_eng 29 minutes ago

    The ai hype word for 2026 after agent in 2025 for any LLM powered application.

    Well kind of, I wouldn't be surprised to see that some things marketed as agents are actually good old deterministic software.

  • webdoodle 4 minutes ago

    I thought this was the next evolution of the smartphone. One so smart that it does all the thinking for you. You don't even have to be conscious, you just do whatever it tells you too. Oh wait, that's what they do already.