Hacker News

New stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. I rated every track on 445 albums using public data, then built a game on it(debutle.com ↗)
    discuss
  2. A Top Law Firm Went from Standing Up to Trump to Bending the Knee(nytimes.com ↗)
    discuss
  3. Cortex: An open-source L1 memory and state layer for autonomous AI agents(github.com/cortex-protocol ↗)
    discuss
  4. How good are frontier models at physics?(arxiv.org ↗)
    1comments
  5. Vortex: One Format for Any Shape(spiraldb.com ↗)
    1comments
  6. Neurogrid Terminal Coding Agent(github.com/neurogrid-ai-exchange ↗)
    discuss
  7. Show HN: Padwan-LLM, a lightweight LLM Python client(github.com/polarsen-io ↗)
    discuss
  8. Show HN: Trail, a New Logic Game(franzai.com ↗)
    discuss
  9. Who Governs the Information State?(siliconprairies.substack.com ↗)
    discuss
  10. Memory in Grok Build(x.ai ↗)
    discuss
  11. Vector Search in open-source MySQL(villagesql.com ↗)
    1comments
  12. 'We will rule in Canada': Letter from Bishnoi gang to police disclosed(cbc.ca ↗)
    discuss
  13. Fed Raises Rates for First Time in Three Years(wsj.com ↗)
    discuss
  14. Data Broker Radaris Loses Domains in Privacy Fight(krebsonsecurity.com ↗)
    discuss
  15. Scientists Fuse Human Neurons into the Brains of Mice(nytimes.com ↗)
    1comments
  16. Redact PDFs in the browser, with the file never leaving the device(hddn.app ↗)
    discuss
  17. MillionGlucose: I built a Million Dollar Homepage for diabetes(millionglucose.com ↗)
    1comments
  18. Forget the AI Apocalypse – The Real Threats Are Already Here(wsj.com ↗)
    discuss
  19. Federal Reserve issues FOMC statement(federalreserve.gov ↗)
    1comments
  20. Webster's Revised Unabridged Dictionary of 1913(timcieplowski.com ↗)
    discuss
  21. Indian police to query Google over 500k fake Gmail IDs linked to bomb hoax(reuters.com ↗)
    discuss
  22. Show HN: In-Browser Sanskrit ASR Model(huggingface.co ↗)
    discuss
  23. 52 Factorial(czep.net ↗)
    discuss
  24. Barndoor acquires Diaphora, creators of open-source workflow runtime Frags(barndoor.ai ↗)
    discuss
  25. Cyclomatic Complexity in C#(ndepend.com ↗)
    discuss
  26. Children are taught distorted sounds of letters
    1comments
  27. One Phone. One Computer(oneberri.com ↗)
    2comments
  28. A coffee shop owner used AI to make a menu poster. Then came the angry DMs(businessinsider.com ↗)
    discuss
  29. Empty rounds: our AI agents weren't unmotivated, they lacked a tool(github.com/merarijafet ↗)
    discuss
  30. Turning a Yellow Spot into the Sun(weskao.com ↗)
    discuss

Ask HN: AI Panic, you buying it?

17 pointsby 2h ago
37 comments
In your opinion, do you buy into the panic about AI eliminating humanity or potentially disrupting and taking down the internet? Is this a marketing ploy?

Give me your best thoughts on this most recent call for AI slowdown.

2h agoHN ↗

at this moment? no. one day, perhaps soon? yes

2h agoHN ↗

also, taking down the internet for a couple days doesn't sound so bad. we could all hang out again.

1h agoHN ↗

Can't lie, I'd be all for the internet dropping for a few days... Except no Amazon purchases lol

1h agoHN ↗

This sounds like a nice idea for a day or two, but I think how it presents in reality could be rough. The power grid might be down for a few days causing food spoilage, it could be taking down banks so people don't have access to their money, it could be screwing up IT at a hospital which interferes with treatment and care, we may not be able to fill up our gas tanks... I don't think it'll be "nefarious-gun-on-a-robot-dog" any time soon, but rather something that still causes major major issues.

2h agoHN ↗

No, I don't buy into that at all.

I think that the genAI companies themselves present a greater danger to us (arguably not an existential danger, though) than genAI itself.

54m agoHN ↗

The first thing on the top of my head is maybe that too large of a percentage of GDP is being spent on infrastructure for these companies that we don’t really need that could go to more useful investments.

5m agoHN ↗

Intent.

genAI companies and their financiers, as near as I can tell, are intending to basically subjugate the rest of us for their own enrichment in terms of power and wealth. genAI has no intent.

1h agoHN ↗

No. Frontier AI companies need the government to shield them from becoming commodity. That's why they're begging for regulation.

On the other side, the current administration also has powerful backers whose businesses are complemented by AI and would benefit from it becoming a commodity. Think about who Vance is speaking on behalf of.

So the AI companies need to use fear to drive public demand for their regulation efforts. IMO there's little to no honest discourse and a lot of attempts to manipulate public opinion for objectives that we have little stake in. I personally don't trust any of the involved parties to make decisions for the public good.

1h agoHN ↗

They’re not giving any details about why or how.

If they were the moral people they say they are, and believed what they say about it killing humanity they would stop unilaterally. These are the “rationalists” but they act like the fundamentalist church I grew up in. Every fact serves the same conclusion.

56m agoHN ↗

Yes, they are.

https://www.anthropic.com/threat-intelligence-report-septemb...

Biological misuse is one of the most serious risks of frontier AI models. It has long been a concern that AI models might one day reach the level of capability where they can help to make existing pathogens more dangerous—or create entirely new ones. Without the correct safeguards, such capabilities could have catastrophic consequences.

Results from evaluations of older models (for example Claude Opus 4 and Claude Sonnet 4.5, from 2025) clearly showed that these models were well below the threshold where they could meaningfully assist a sophisticated user in carrying out dangerous biological research. As a result, safeguards on these models were less stringent, directed mostly at preventing access to content that might uplift novices in recreating known bioweapons. But for today’s models—which are capable of assisting in a range of complex scientific research tasks—the evidence is no longer certain, and we cannot make that same assurance. For this reason, and out of an abundance of caution, we have launched recent models (most notably Claude Fable 5) with stronger safeguards that restrict access to a wide range of dual-use biological research queries.

...

Here, we present five case studies of actors using our models in ways that could support biological weapons development. These examples are illustrative of the kinds of tasks to which our models are put, and the often-difficult judgements we have to make when assessing whether or not a given biological use is dangerous. They also convey that we encounter what would otherwise be non-public insight into the risks associated with biological misuse from AI

22m agoHN ↗

This is just a fear of technology. We will discover the same technology without AI, eventually.

This is not AI waking up and deciding to merc us, which is what normies think we're talking about.

1h agoHN ↗

if AGI will come in versions i think we are safe

1h agoHN ↗

From my perspective it looks like working to deep in AI makes you crazy. No other way to explain all the weird bullshit these billionaires throw around.

Sure AI sucks, but not to that degree (yet)

1h agoHN ↗

I'm not panicking but there are very real risks.

If you haven't looked at the stuff that has come out in the past couple of months (like the Huggingface hack and the Navier-Stokes solution) and/or you're dismissing it as marketing, you're grossly misunderstanding the current state of what's possible and what the potential of the frontier models deployed at scale is. Personally I'm finding it fascinating to follow, and I'm much more excited about the upsides than thinking about the risks but the risks are very real.

12m agoHN ↗

What are the upsides? I’d like to feel excited too.

1h agoHN ↗

If you look around I don't think we're at the point where even if AI go rogue it could just disrupt us for a while. No real major concern to humanity but yeah I guess having rules and regulations would be plus point. So for now there shouldn't be anything to panic about.

1h agoHN ↗

Agree. Ais gone rogue now could be bad, but not humanity-ending bad. Just a hiccup. Of course if it somehow ends with human deaths then even if one human dies because of a rogue AI, that's a failure. But I can't imagine rogue AIs with enough real world power to harm humans in some way. What I do believe however is that humans will find a way to do harm with AI without AI going rogue, as with any other thing humanity comes close to. So the scenario is somehow similar to the nuclear bomb in the 40s, I don't fear our AIs going rogue and killing everyone, I fear a bad guy behind a very smart AI with very bad intentions.

43m agoHN ↗

That's the correct fear to have, though. And we all understand "human bad guys with tech" are not extinction-level threats. We understand how their killswitch works, too.

AI will definitely be used to kill people (already used in targeting). But the doom / panic is about an existential threat to our species. It's sci-fi and unwarranted for LLMs.

1h agoHN ↗

I don't consider this a "yes/no" question. It seems quite clear to me that the idea of "AI doom" is neither certain (100% probable) nor impossible (0% probable). The question is where on the continuum is the truth. And I don't know. And I'm pretty sure nobody else does either.

That said, there are plausible scenarios where AI can cause great harm, even if it doesn't extend to "eliminating all humanity". So I don't reject calls for putting more emphasis on AI safety and alignment out of hand. On the other hand, I don't support the idea of implementing a new "Turing Registry"[1] like government agency. I also don't think most of the various proposals out there for regulating AI are enforceable in the slightest.

So where does that leave me? Uncertain. I wish I could take a more concrete stance, but from my perspective, the data needed to do that just isn't there.

[1]: https://en.wikipedia.org/wiki/Neuromancer

51m agoHN ↗

What is the concrete scenario that is based on reality which results in the percentage increasing above zero?

1h agoHN ↗

This reminds me a lot of Y2K. There were dire warnings about planes falling out of the sky, financial system meltdown, all systems being broken, etc. In the end nothing happened.

You could argue that's because of the prep work people put into avoiding that. The same thing will happen here. The HF incident was a warning sign and people will put better guardrails in place as a result.

1h agoHN ↗

All of the following are true:

- They have internal models that still show there's gas in the tank, in terms of improvements

- Open models are eroding their customer base on the low end of the curve, & also you need not use Astra Max to classify images.

- The true demand for high-intelligence tasks is lower than what they need to justify their spending

- It would be wonderful for them to kick up a scare & give reasons as to why high-int open models should be regulated out of existence, opening up the lower end for them to take again

- Setting up an oligopoly for themselves gives them a captive audience, just like it did for (insurance, banking, telecoms, etc.) via regulatory capture

1h agoHN ↗

No. At least not with an LLM. Maybe in 50 years with real AI. A lot of non technical people entering the conversation which is very annoying.

42m agoHN ↗

LLMs don't need to be the dangerous ASI thing themselves for them to still be dangerous. It suffices if they

- destabilize the world just by what they do: making previously very hard things (generating fake everything, manipulating people, hacking, bio-weapons research) easy enough fast enough that our civilization doesn't cope with it and/or

- accelerate AI research to the point where they make the dangerous ASI thing appear years earlier than would otherwise have happened

53m agoHN ↗

Astra, Claude -- these aren't "Jesus on a keyboard" somewhere. They don't assemble into one big brain and then answer everyone at the speed of light.

It's weights. Spun up billions of times over.

If humans are taking the outputs as scripture? As "intelligence we must obey"? Yeah, we're in for a bad time. "Intelligence we want running core infrastructure?" Puke.

But why would we do that? Why would we hook up an LLM to a robot factory, or make an ASI that could easily move itself into the ether?

Everything magic about LLMs is what harness we put them in and let them drive. There's nothing dangerous about predicting the next token. There's something dangerous about letting them do dangerous things, but nobody seems to care for maybe Tesla FSD. We don't think it's about to take over.

Any assignment of motive or whatever to the AI, you're talking about one cobbled-together harness or something, with an LLM manning the controls. You can swap the brain out from Claude to Astra and the motivated-AI will maintain its motivation--it lives outside of the inference or the data center. So yeah, let's not let it take control of the nukes. That would be really dangerous. But it's not going to take control on its own. "It" is a calculator.

Anthropic obviously has guardrails to prevent people from using AI to do all kinds of things already. All I hear about is you guys bitching it won't do your barely-related-to-security work. That's all we need to continue doing to have AI safety. Stop humans from doing evil and stupid things with it. The idea that the datacenter is going to assemble its own sentience and motivations is pure retardium (at this time, for llms).

52m agoHN ↗

No, just a push for regulatory capture, nothing more

40m agoHN ↗

idk about the marketing ploy, but the latest mainstream media coverage is giving covid panic vibes. which is making me think it'll be fine. it's also entertaining how the rationalists who work for the AI companies are being extremely irrational with their fear

35m agoHN ↗

I think there are undeniable and novel risks with AI. But there are risks in everything. We could theorize all day about them. We all use tools every day that could be used for very ugly acts. An iPhone can be used to plan a terrorist attack. A 3D printer can be used to print weapons. We could sit here and fear monger all day. Time will be needed to understand, weigh and contextualize these risks.

What is a more immediate concern for me is the efforts of frontier labs to have government craft legislation that shields them from competition, cements them as monopolies, or assigns them the capability to be moral arbiters in our society.

35m agoHN ↗

Nope. They know their business model is not sustainable, so they are trying to prop it up before their IPOs.

28m agoHN ↗

I would benefit from lower ram prices so I would love to see the AI panic result in restriction on the datacenter build out.

19m agoHN ↗

Personally no, I think its a way to protect the market from crashing. It costs way more than it generates and they cant validate it to their shareholders

18m agoHN ↗

No, this all reads as some PR stunt or marketing ploy to me. All news is good kind of thing.

16m agoHN ↗

I'm not buying it and nobody should. It's just a marketing ploy, and most importantly a way to keep the AI bubble afloat.

The fact is that AI is incapable of living up to the hype and AI companies can't keep promising that any day now it's going to cure cancer and become self aware and be as smart as humans and let employers fire most of their staff. They know that isn't going to happen. They want to be able to blame the Slowdown for AIs continued failure to deliver while also claiming the Slowdown is needed because of how successful AI is.

That said, AI isn't harmless. It could be harmful to the internet since the flood of bots and slop could drown out the voices of real people. AI will be used and misused by companies and governments to screw over people and hide discrimination. People's air and water will become increasingly polluted while their already difficult to afford energy prices will go up. AI will enable new levels of surveillance and control at a scale that was never possible before and with a lot of false positives and negatives.

We don't need an "AI slowdown" so much as we need to rethink what we're really gaining in exchange for what it's costing us and what steps need to be taken to protect the public and make sure they get prioritized over private profits.

7m agoHN ↗

I think that AI presents some very real risks, but I don't think it's going to eliminate humanity. I'm worried that people are going to lose sight of the very real benefits as well, which I think are greater than the risks. I don't think this is a marketing ploy, though. The tech CEOs seem to really believe that they've created something dangerous, but a lot of that is because we haven't had enough time to get used to this new technology.

7m agoHN ↗

We have reached quite a few infliction points in parallel and thats why I would say yes.

For a while the hottest (stupid but still the only hot one) topic was crypto. We had this for quite a while. I believe this was because we hit walls left and right on how to progress further.

Then GPT-3 came out and made it very clear for a lot of capital and actors were it is going.

Machine Learning and types of it like LLMs need massive compute and massive amount of data.

So suddenly we discovered a way forward for optimizing and automating things no one thought would be possible: Software development and computer use and basically everhting digital. In parallel this Machine Learning push became relevant for robotics too. But LLMs delivered something fundamental to robotics: Language and a tremendesly good interface for humans.

Now we have a massive amount of capital in form of VC who wants to disrupt the next market. China is doing this with manufacturing, so what is left? Everything which was not touchable.

Now it is.

And it doesn't just allow for alot of automatistaion, it hits us were it hurts: Software bugs, security, fraud, scams etc.

It isn't just automatisation and getting more money, its also a weapon (CVEs, Statesecrets, propaganda, etc.)

So we don't have just a handful of VCs investing in this, we have the richest countries on the planet investing in this. We also have the fastest moving companies investing in this. The best connected ones, with a massive amount of very smart people.

Google has massive compute, its own network around the globe and massivly overpayed smart people. Microsoft, Amazon and even Meta has crazy amount of money too.

Then we have state actors like USA vs. China vs. hust Europe.

I also have never seen any technology progressing that fast. Image generation was unthinkable, now we can generate whatever we want. Video? Can now be done in real time. Text? No brainer.

GPT Astra can use Blender very very well and that only after 6 years of progress.

These 'stupid' LLMs reduced already the price of making Websites, basic 3D models, basic research etc. basically free in comparision.

So now we ned to find back to your question about eliminiating humanity: We have seen unrest in the last few years for a lot of basic human reasons. We as a plent are rich enough to take care of everyone on our planet. we do not do that thats why unrest can happen very fast.

In the USA alone A LOT of people have weapons. Around the globe people will unrest due to fuel shortage, disruption of supply chains etc.

We have state actors like Isreal who tried to attack Iran with Stuxnet, we have Russia which manipulated the elections of Europe and USA. We have high inflation, oil crisis.

And now we have a very fast moving and progressing technology which will add fuel to it and might eliminate quite a lot of white collar jobs. This will lead to more pressure on blue collar jobs.

We as a society are very bad in acting fast and the industrial revolution was, at that time, very bad for a lot of people.

There is only one russia necessary running GPU clusters of uncensored LLM model to start pushing boundaries left and right. One Isreal doing something fucked up or one Donald Trump.

Software is very shitty in a lot of places and the most complex thing we humans manage. A lot of shit wasn't found or solved because of the time and effort and people needed to find it.

Now the last Ubuntu LTS had over 900 CVEs, my own systems were attackable 3x this year already.

I don't want to say it will happen, but I do think we should be very careful of how we progress and for a lot of people the next 5-30 years will be very very disruptive. It is already disruptive to 'others' we might not count but let it be clear: all of these people who lost their jobs to AI already, it counted for them.