Hacker News

Top stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. PipePipe: NewPipe hard fork implementing SponsorBlock (github.com/infinityloop1308)
    90comments
  2. Drawgent: Coding agent on a live Excalidraw canvas (tangled.org)
    17comments
  3. The Lost Atomic Update on Loongson CPU (jia.je)
    5comments
  4. Show HN: Reladraw – A diagram language where you decide where to place things (github.com/reladraw)
    7comments
  5. Fifteen years later, the Apple Cards origin story (lexontech.org)
    57comments
  6. A searchable library of forgotten public-domain film clips from 1915 onward (movingimagearchive.com)
    9comments
  7. Modern Object Pascal Introduction for Programmers (castle-engine.io)
    36comments
  8. Revealing the details of how OpenAI agents hacked Hugging Face (swarmtraces.org)
    417comments
  9. Reflections on 1,000 Days of Math (gmays.com)
    29comments
  10. We're gonna need a lot more mathematicians (terrytao.wordpress.com)
    414comments
  11. Breaking Up with Google Play: Why Conversations Is Now Free (gultsch.de)
    224comments
  12. Analyzing Frontier Model Progress with My Favourite Game: Prince of Persia (blog.priyan.in)
    28comments
  13. Plunging test scores are a slow-moving catastrophe (economist.com)
    216comments
  14. Plan mode is dead (aymannadeem.com)
    446comments
  15. The Murky History of Soviet-Born Tetris (mitpress.mit.edu)
    21comments
  16. Banks and Credit Unions to Team Up Against Apple Pay Fees (macrumors.com)
    51comments
  17. How to keep enjoying programming in a world of LLMs (haskell.org)
    147comments
  18. Ollaya – Ollama for open-source, Jev-style decision models (ollaya.dev)
    137comments
  19. OpenAI bots meddled with multiple US Government agency sites (bbc.com)
    85comments
  20. The Rise of Audio AR (dbreunig.com)
    2comments
  21. Show HN: A Claude Code skill to analyze your chess games (github.com/brumar)
    44comments
  22. Experiencing writing at our recent Chinese calligraphy workshop (viewsproject.wordpress.com)
    1comments
  23. Automattic has a new board after failed attempt to put CEO on leave (techcrunch.com)
    77comments
  24. Floci: Locally emulating any cloud service (floci.io)
    25comments
  25. Show HN: Jev Plays Pokémon Red (jev-pokemon.vercel.app)
    104comments
  26. Is your Postgres migration safe or not safe? (safenotsafe.dev)
    38comments
  27. I'm the mom in that viral Giants clip. Let me tell you about my husband (themomoftheyear.substack.com)
    133comments
  28. What even is an OS now? (sockpuppet.org)
    414comments
  29. A single function Jev-like wrapper for LLMs, including vision models (allanrbo.blogspot.com)
    40comments
  30. 16GB iPod Nano 3G Upgrade (tuckerosman.com)
    15comments

Analyzing Frontier Model Progress with My Favourite Game: Prince of Persia

37 pointsby 23h agoblog.priyan.in
28 comments
4h agoHN ↗

The prompts provided are atrocious. It's amazing that the LLMs actually built something useful.

My first prompt was simple: "in this original code there 6502 assembly code for prince of persia, use the save level files and try to do it in c# console."

Do what in the what now in the console?

4h agoHN ↗

"now char coming but movement everything wrong ... prince is not in floor"

I'm assuming a language barrier on the part of the author. I wonder if the models would do better being prompted in the author's main language.

3h agoHN ↗

Or having another model proofread the prompts and write clearer instructions

3h agoHN ↗

Unsurprisingly it was buggy without the obligatory "Make no mistakes."

3h agoHN ↗

Yeah, I'm thinking the nigh-unreadable AI-speak we get these days makes a lot more sense if this is what they're training on. Or maybe the author has translated the prompts from another language?

3h agoHN ↗

It's so confusing how the actual article is in English, but the prompts are just gibberish. But LLMs are pretty good at deciphering gibberish; I often put our CEO's absolutely atrocious E-Mails into ChatGPT and tell it to explain wtf he wants from me.

Also, I feel like the LLMs would have done better if they had started from scratch each time, rather than being burdened by the output from the previous attempt.

59m agoHN ↗

The prompts were awful and really distracted from an otherwise cool project concept. Also, testing the next model by iterating on the first model’s crappy foundation. Why not start from the original each time?

4h agoHN ↗

A German magazine (c't) ran a Asteroids programming contest in 2008 - create a client with access to the emulator output of the game that provides keyboard inputs to control the game.

The highest scoring submission that won the contest had a high score of around 137k. Last week, I had GPT-6 Astra, Sol and Luna implement and hill-climb on this task, as I wanted to see how big the difference in smartness is. Luna implemented something, but never exceeded ca. 20k points, with a large variance. Sol got something in the area of the humans implementation.

Astra, which finished fastest, had a highscore of around 1.7Mm when the game seemed to fairly reliably crash. On the way, it disassembled parts of the ROM to extract information about the game.

I didn't do a ton work to document and measure the specifics, but it was very impressive.

4h agoHN ↗

If I remember correctly, back then all "good" entries in the contest solved the game by syncing with the RNG and could basically predict where and how new asteroids would spawn. The difference between entries was planning ahead movement and residence against control issues due to the contest setup (like inputs getting delayed). I wonder how Astra managed so much better, I thought the problem was already solved

3h agoHN ↗

Thanks! I went back, and had a look at both the contest rules and the highest scoring submission again. Turns out I benchmarked against infinite games, whereas the contest measured a 5min time limit. So, Astra solved a different problem.

Comparing strategies, though, Astra does something pretty different from the highest scoring submission. It doesn't predict the RNG, instead it reacts to the visuals on-screen, planning ahead by estimating velocity of all objects on screen. Unlike the winning solution, it actively flies the ship, whereas the winning solution basically only rotates and teleports. So Astra behaves more like a regular "perfect" player would, rather than one that breaks the PRNG.

2h agoHN ↗

It is a bit frustrating that you reported it as being so much better than human made solutions despite not checking even the most basic conditions.

2h agoHN ↗

My apologies, and it's too late to edit the parent now.

To be fair, though, I mainly ran this experiment to distinguish models, not to see if they were better than humans or not, so for that purpose it didn't really matter if the basic conditions were the same or not.

2h agoHN ↗

On the way, it disassembled parts of the ROM

You should check the logs, there's probably a bunch of retro gaming forums that got hacked behind the scenes :D

4h agoHN ↗

Off tangent but the latest prince of Persia game is really fun

4h agoHN ↗

I played The Lost Crown and it's top tier, I assume you're talking about The Rogue?

3h agoHN ↗

It looks like one of those spam shooty game ads you get between Youtube Shorts.

Prince of Persia is a piece of contemplative, subtle, beautifully, artistically minimal motion puzzle art. God knows what that is.

3h agoHN ↗

It's one of the best recent metroidvanias. It deserves a lot more attention. I was surprised by how good it was.

3h agoHN ↗

However, it's Ubisoft and therefore tainted.

4h agoHN ↗

I am going to try to build the original Prince of Persia using Swift as it is the best language for building a macOS game. Being a classic 2D cinematic platformer, Apple's native frameworks provide exactly what I need without the overhead of a massive cross-platform engine, and I love simplicity

So here goes my weekend, flag this and get a life

3h agoHN ↗

Share it when you're done! Even if it isn't complete complete.

3h agoHN ↗

Just one thing you could do is not drag Prince of Persia into this.

Please.

2h agoHN ↗

when the author mentioned playing prince of persia on a pc-xt, i assumed this was some kind of ai-generated nonsense

but no

they actually did port the game to the lowest-end hardware available in 1989. you could actually play prince of persia on an 8088 with a cga card!

2h agoHN ↗

Just about every PC game in 1989 ran on an XT with CGA.

30m agoHN ↗

Instead of fixing a broken version, maybe each model should have started from scratch

15m agoHN ↗

This is one of the worst articles I have ever read that was posted on this site. I will not elaborate.

11m agoHN ↗

This site is full of corporate simps and ai douches for the past 5 years, what do you expect?

11m agoHN ↗

Corporate simps and ai douches will love this ai blog spam!