Hacker News

Top stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. Breaking Up with Google Play: Why Conversations Is Now Free (gultsch.de)
    186comments
  2. PipePipe: NewPipe hard fork implementing SponsorBlock (github.com/infinityloop1308)
    44comments
  3. Fifteen years later, the Apple Cards origin story (lexontech.org)
    39comments
  4. Show HN: A Claude Code skill to analyze your chess games (github.com/brumar)
    18comments
  5. The Lost Atomic Update on Loongson CPU (jia.je)
    —discuss
  6. Modern Object Pascal Introduction for Programmers – Castle Game Engine (castle-engine.io)
    29comments
  7. I'm the Mom in That Viral Giants Clip. Let Me Tell You About My Husband (themomoftheyear.substack.com)
    20comments
  8. Revealing the details of how OpenAI agents hacked Hugging Face (swarmtraces.org)
    398comments
  9. Reflections on 1,000 Days of Math (gmays.com)
    8comments
  10. We're gonna need a lot more mathematicians (terrytao.wordpress.com)
    369comments
  11. Analyzing Frontier Model Progress with My Favourite Game: Prince of Persia (blog.priyan.in)
    19comments
  12. Plan mode is dead (aymannadeem.com)
    426comments
  13. Banks and Credit Unions to Team Up Against Apple Pay Fees (macrumors.com)
    4comments
  14. Ollaya – Ollama for open-source, Jev-style decision models (ollaya.dev)
    134comments
  15. Make Claude your assistant in excalidraw (tangled.org)
    2comments
  16. Floci: Locally emulating any cloud service (floci.io)
    23comments
  17. Is your Postgres migration safe or not safe? (safenotsafe.dev)
    31comments
  18. 16GB iPod Nano 3G Upgrade (tuckerosman.com)
    12comments
  19. New Satellite Engine Could Use Earth's Atmosphere to Stay in Orbit Indefinitely (scitechdaily.com)
    3comments
  20. Parsing Expression Grammar vs. Regexes: Building Org Parser in Lisp, Export HTML (jointhefreeworld.org)
    14comments
  21. Show HN: Jev Plays Pokémon Red (jev-pokemon.vercel.app)
    94comments
  22. A single function Jev-like wrapper for LLMs, including vision models (allanrbo.blogspot.com)
    39comments
  23. What even is an OS now? (sockpuppet.org)
    381comments
  24. Calculating atmospheric drag on satellites for a Cubesat [pdf] (osti.gov)
    7comments
  25. Ask HN: Who's still keeping a DOS machine up because the business depends on it?
    213comments
  26. Gravity seems holographic. What does that mean for reality? (quantamagazine.org)
    197comments
  27. Plunging test scores are a slow-moving catastrophe (economist.com)
    125comments
  28. The Murky History of Soviet-Born Tetris (mitpress.mit.edu)
    18comments
  29. Scientists build most accurate atomic clock (phys.org)
    23comments
  30. Jury finds Facebook liable for deceiving users in Cambridge Analytica case (cbsnews.com)
    94comments

Anthropic Urges Global Pause in AI Development, Flags 'Self-Improvement' Risk

9 pointsby 3mo ago
7 comments
WSJ Anthropic is calling for top artificial intelligence labs to weigh slowing the pace of development, suggesting that AI systems are advancing so rapidly that they may soon be able to improve themselves without human intervention in ways that could pose significant societal risks.

The ability to slow global AI development would “likely be a good thing,” the company said Thursday in a blog post that disclosed internal data documenting how quickly its most advanced models are improving.

The post, written by the head of its internal research institute and head of policy, noted that model advances appear to be on a path toward “recursive self-improvement,” when AI systems can improve on their own without human intervention. Some AI insiders have seen that threshold as a potential marker of danger and enormous societal upheaval.

“We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology,” the post, written by Marina Favaro and Jack Clark, says. It proposes a global agreement on how to potentially slow development and a mechanism for verifying that competitors are respecting it.

The post cautions that recursive self-improvement hasn’t yet happened and isn’t inevitable, “but could come sooner than most institutions are prepared for.”

Anthropic recently concluded a fundraising round that valued the company at almost $1 trillion and filed confidential paperwork to begin the process of publicly listing its shares. The company has recently emerged as the front-runner in a ferocious competition for AI supremacy with ChatGPT-maker OpenAI, which is also expected to file paperwork for an initial public offering soon.

Anthropic’s run-rate, a figure commonly used by startups that forecasts annual revenue based on short-term sales, is on track to reach $50 billion in annualized revenue by the end of this month, up from $9 billion at the end of 2025.

3mo agoHN ↗

Yeah, that's not gonna happen. I'm sure Anthropic isn't pausing their AI development, why do they expect anyone else to?

3mo agoHN ↗

Not gonna happen in a million years! I mean, this is outright hypocrisy! The adversaries, such as the CCP, do not give a toss about what they "aDvOCate."

3mo agoHN ↗

Alternative interpretation of the facts - "our slop generator has become buried in slop - could we all just take a breather for a moment?"

3mo agoHN ↗

It's strange to be asking for this as the company is preparing for its IPO. Hmm ...