I love LLMs, I hate hype

102 points | by therepanic an hour ago

42 comments

  • dom96 6 minutes ago

    I love LLMs too, but I am concerned about their cost. They are all still very subsidised. Is there any guarantee that I'll be able to run a Opus 4.8-level model on my personal computer before the big AI labs decide to hike up the prices?

      EgregiousCube 2 minutes ago

      Guarantee is too strong a thing to seek, but healthy competition makes it highly likely that the supply/demand curve will meet at a healthy place.

      You're always guaranteed that you can stash away the open models!

  • TheAceOfHearts 32 minutes ago

    At least for me, the jump in productivity has resulted in building stripped down one-off software for my highly specific use-cases.

    You can use an LLM to create anything but you still need to know what it is that you're building, and you need to think through how everything should work or the LLM will just fill it with sausage. You can tell that the models are still quite jagged and limited by the mixed quality from a lot of the software that these presumed trillion dollar companies are putting out. The future is sausage.

  • hamandcheese 34 minutes ago

    > where’s all this new magical software that the productivity improvements should imply?

    It's running, privately, in my homelab.

    I think we are entering what I call the "have it your way" era. If an open source project doesn't do exactly what you want it to do, fork it, or create a new version. It's too easy.

    This makes me a bit concerned about the future of open source. Upstreaming used to be worth it, since maintaining a fork is effort too. But now the balance has shifted significantly. Especially with many projects becoming a lot stricter about contributing, and some becoming outright hostile to AI. I can't blame them. But I think the effect will be that improvements are less likely to make it back to the community as AI adoption increases.

      blauditore a few seconds ago

      You will likely end up in maintenance hell soon. This will likely not be much easier with AI because coding is not the hard/annoying part, it's the fact that you need to dust off every little project every time a tiny fix is needed, and that's a lot of toil in the long run.

      atomicnumber3 26 minutes ago

      Remember: code is free as in "free puppy". FOSS communities were never valuable because of the code. It was the shared written and oral traditions that make the software useful, usable, and updated.

      paulryanrogers 33 minutes ago

      You still have to track upstream and merge conflicts. Or else you have to get LLMs to fix all the CVEs in your fork.

        otabdeveloper4 18 minutes ago

        People who vibecode don't know what a "fork" or a "CVE" is.

  • kenforthewin 20 minutes ago

    I felt the same way in 2024-2025. Then Sonnet 4 was released, and things started feeling different. Opus 4.5 was another step change for me. Everything feels like it's accelerating, and timelines are getting crunched. I guess in some ways I envy OP, who would "bet everything" against ASI - the truth is I don't know, and I don't think anyone knows, where this ends.

  • password54321 26 minutes ago

    Yeah I don't think any of the labs have some secret sauce for intelligence either. It seems most of the advancements are still coming from hardware, making LLMs more efficient and throwing more compute and data at problems. And even those problems still require a lot of prompt engineering: https://cdn.openai.com/pdf/04d1d1e4-bc75-476a-97cf-49055cd98...

      andy99 21 minutes ago

      The secret sauce is training data. They’re not just taking advantage of more compute (which obviously is necessary but as mentions basically a commodity). They are paying billions to data labelers and making judgements about the nature of the training data they best need to make the product they want. This seems to get pushed aside as a minor point but it’s the primary differentiator of the big labs.

        password54321 16 minutes ago

        As a I said, compute and data. But LLMs can be distilled, so even their data is not much of a secret sauce.

  • kordlessagain 44 minutes ago

    There's good reason to hate the merchants and their marketing. But builders are not merchants. They build with whatever tool is available.

  • neiman 39 minutes ago

    Honestly, who likes any hype in anything ever? Especially if you genuinely like and understand the thing being hyped.

      tuvix 14 minutes ago

      Agreed, but I do think this is a wholly different kind of hype. With crypto currencies it was the promise of modernizing value exchange, with some zealots promising the end of traditional currency.

      With this, I’m hearing (from supposedly reputable publications, in addition to random people) that this is going to end knowledge work in general and take out a large percentage of the world’s labor force. I’m being told to pick up a trade, and that the career I have and the knowledge I’ve gained is now worthless.

      The worst part seems to be that it’s pretty much impossible to quantify any kind of impact these tools will have until after the impact is actually felt. We’ve been in limbo while the tech sector is just rotting.

      cautiouscat 35 minutes ago

      C-suites. Marketers. People with stock portfolios. Banks. Politicians.

      So all people that don’t understand the thing being hyped.

        an0malous 7 minutes ago

        Basically all people with monetary investment in the thing being hyped

      moffkalast 37 minutes ago

      Stocks and politics I guess.

  • ks2048 12 minutes ago

    > What I don’t like is two things. One, this constant bullshit about some window closing, or the perpetual underclass, or falling hopelessly behind.

    The blog has a tagline, "the singularity is nearer". I think belief in a "singularity" almost implies these things to some degree.

      therepanic 7 minutes ago

      the author does not believe in the technological singularity.

  • sigmar 43 minutes ago

    >One, this constant bullshit about some window closing, or the perpetual underclass, or falling hopelessly behind. This is negative valence hype, not only is it not true, it’s mostly designed to make you feel bad about yourself and move to shitty San Francisco where everything really does suck like how these people claim.

    It's possible to use LLMs without logging onto twitter to be exposed to the people spouting off about a "perpetual underclass." I love the internet, but it really feels like (now more than ever) you have to be intentional about what sites you visit.

      cautiouscat 28 minutes ago

      Those people are not just on Twitter. They’re here on HN, they’re at work, they’re at your next social gathering.

      I’ve found them to be unavoidable to some degree.

      ToValueFunfetti 25 minutes ago

      Agreed. There's sort of this spiteful anti-hype here that I find very offputting, and ultimately I think it's because a lot of folks are going out and encountering opinions I never see. I hear wild conspiracy theories about data centers and the financials of involved companies that make their way to me from bluesky or instagram, often through here, but never the unstoppable tide of hype that people are allegedly[1] railing against. I do read Scott Alexander, but he's a lot more reserved than people make him out to be on this.

      [1] Allegedly because I have no firsthand experience, not to imply doubt.

      paulryanrogers 30 minutes ago

      Does Xitter still have people complaining about class divisions?

      (Genuinely curious, I hadn't ever seen that there though I don't go there much any more.)

        ToValueFunfetti 22 minutes ago

        "Permanent underclass" is the notion that people who get involved at the ground floor will essentially get infinite wealth relative to the ones who don't. It's a little goofy, but more of the capitalism you'd expect from today's X than the communism you're imagining in yesterday's Twitter.

  • Razengan 23 minutes ago

    I recently realized, that ever since I've had AI to "talk" to, I haven't had a stuck or "downtime" moment; there's always something to at least brainstorm on.

    In the past when I couldn't figure out something, I'd take a break for a couple days, while going through Google → Stack Overflow → Reddit, and by the time you got to that point you rarely got useful answers, usually either trolls or silence.

    Now I can just ask AI about fleeting ideas and always have a starting point for some area of some project to work on.

    A lot/some of the concerns about the AI Age could be alleviated if people got UBI and a 4-day workweek.

    like if AI's supposed to be so great why do we still have to work so much??

    and if we don't have to work, how do we pay for food and bed?

      jagenabler2 12 minutes ago

      Do you feel like the ideas you’re getting from brainstorming these days are the same level of quality as in the past? I’ve been doing some of the same, but I’ve also been feeling like the downtime where I’m genuinely stuck is where my most innovative solutions come to light. I’m not going as deep into problem spaces anymore.

      I’ve also lost my ability to self-filter. In the past, I’d write down an idea and if I was stuck for too long, I’d discard it. Now I feel like I have an obligation to build everything.

      Maybe it never mattered and the quantity of solutions is truly the most valuable thing.

        Razengan 4 minutes ago

        > Do you feel like the ideas you’re getting from brainstorming these days are the same level of quality as in the past?

        You have to be careful and remain "yourself":

        Like I've been trying to think of a generic save/load system for my game framework, but the ideas given by Codex so far don't suit my desired design/interface, BUT it makes me certain of how I DON'T want to do it heh

        If I got lazy and just blindly did what the AI says, I'd end up in deeper tech dept.

        You have to take advantage of and "exploit" the way LLMs work, which seems ideal for shaping vague ideas, by using the AI's fuzziness to help you decide what you do and don't want.

  • wxw 38 minutes ago

    > What I don’t like is two things. One, this constant bullshit about some window closing, or the perpetual underclass, or falling hopelessly behind.

    > And two, this strawman jump from, oh hey, it’s a fancy autocomplete, smart compiler, better search engine, to it’s gonna like own the whole light cone bro like if you aren’t in SF and at the right parties there’s gonna be like a flash of light in the sky one day and you’re not even gonna know what happened but everything just Changed.

    Haha, OP has a way with words.

    In a way, both these emotional extremes (FOMO & the singularity) are just tools being used to continue driving the massive CapEx behind LLM improvement. Hate to love it? Love to hate it?

  • HellDunkel 35 minutes ago

    How to you love this stuff so hard? I could newer love any ai generated music, book or artwork. Anything ai gemerated i have ever seem or heard was either disgustingly slop or indistinguishable from something else which was real. It‘s a like finding a cool track only to discover it‘s a lazy bootleg.

      m463 31 minutes ago

      I've made ai generated art using family photos as the starting point, and it was wonderful. :)

      ivanjermakov 28 minutes ago

      I'm sure most engineering is LLM-assisted already and nothing is wrong with it. It's just the one-shot vibe-coded low quality slop that spoils sentiment of this tools. Also many people are interested in what agents can build unsupervised as a test of "superintelligence".

  • jdw64 8 minutes ago

    >One, this constant bullshit about some window closing, or the perpetual underclass, or falling hopelessly behind

    Is this person looking at different statistics than I am? I think what I said is correct.[1]

    Realistically, to do programming, you need to know English. If you don't know English, you just fall behind. All the resources are in English, so non-native speakers start at a disadvantage. That's why English itself often becomes a kind of social class barrier.

    And realistically speaking, there might be some blessed geniuses for whom a degree doesn't matter, but for most people, if you're poor, it's hard to engage in high-level thinking. Unless you give up on social success or isolate yourself from social relationships, it's hard to just code at home.

    I think people who say otherwise probably haven't really experienced poverty firsthand.

    I'm not sure if I'm looking at the wrong stats. Realistically, looking at the statistics, aren't the bottom class permanently stuck? Doesn't the US venture capital scene look at degrees and connections? It seems different from the statistics I'm seeing.

    [1]https://opportunityinsights.org/paper/the-fading-american-dr...

  • jacobgold 32 minutes ago

    As soon as we started unironically calling LLMs "AI" we went down the hype path. That has plenty of downsides, like stressing out the entire world and attracting cryptocurrency bros, but also the major upside massive of funding/acceleration.

    So far, all we have is more software running on computers. It's powerful, and it's amazing, but it's not magic.

    Calling it "AI" was possibly a net-negative but we don't know yet.

      nylonstrung 2 minutes ago

      I think calling it AI has been very negative.

      One of the lesser, but still underdiscussed ramifications is that I think it has limited the public's ability to comprehend the Yann LeCunn argument, that genuine AI is likely possible but that LLMs and transformers are a dead end and we need to explore different modalities

      lukan 23 minutes ago

      "It's powerful, and it's amazing, but it's not magic"

      But since its creators and as of my knowledge everyone else totally did not see it coming, that you can now give a vague prompt full of spelling errors - and get returned a working program - I would say it is pretty close to magic (as in we don't really understand why it works so good).

      I also don't see how you cannot call it AI. Especially since simple chess engines and alike were called AI long ago. So it is not general strong AI and has no consciousness and no mind and is pretty dumb too often - but the general concept - getting from a some vague text to a working program has some connection to intelligence to me.

      cautiouscat 25 minutes ago

      > Calling it "AI" was possibly a net-negative but we don't know yet.

      I’m not sure it’s net negative or not. I’ve found that it’s reductive though. We have this really broad field of artificial intelligence reduced down to at worst a “slop machine” and at best a single tool.

      Imagine being a CS professor that studied AI in the 90s and how you have to over explain you don’t mean LLM chatbots to a layman.

  • apsurd 38 minutes ago

    Your SF hate isn't a good look.

    There are many things to be critical about but shoehorning an entire metro into the echo-chamber you're supposedly beyond yet can't help but orient your entire world view as the anti-SF-tech-bro all while running a startup and discussing AI on HN.

    TLDR: SF is more than Paul Graham worship parties.

    EDIT: Think I'm being misunderstood! author goes out of his way to blame shitty San Francisco.

    > This is negative valence hype, not only is it not true, it’s mostly designed to make you feel bad about yourself and move to shitty San Francisco where everything really does suck like how these people claim.

      markasoftware 23 minutes ago

      the vast majority of the target audience of this blog post would only consider moving to SF because of the tech scene. This isn't a mountain biking or asian food blog.

      NetOpWibby 31 minutes ago

      False equivalency

        apsurd 20 minutes ago

        ooh I like your site: https://webb.page

        false equating that author's AI hate is hating SF tech-bros? Oh I think I am being misunderstood, that makes me feel better about the insta-downvotes. Author states it plainly:

        > This is negative valence hype, not only is it not true, it’s mostly designed to make you feel bad about yourself and move to shitty San Francisco where everything really does suck like how these people claim.

      apsurd 31 minutes ago

      damn, you all hate SF that much?