Hacker News

Top stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. GPT-6 Sol and Luna(openai.com)
    688comments
  2. Claude Opus 5.5(anthropic.com)
    904comments
  3. Transit rewards(waymo.com)
    89comments
  4. Data-only attacks are easier than you think (2024)(usenix.org)
    13comments
  5. OpenAI GPT–6 Astra breaks Enigma message that has resisted solution since 2005(cryptocellar.org)
    381comments
  6. Microsoft killed FoxPro in 2007. Anyway, here's FoxPro revived(foxscript.org)
    168comments
  7. 'We hacked the FBI:' Hackers say they have data on all FBI employees(404media.co)
    384comments
  8. ReBarUEFI: Resizable BAR for almost any UEFI system(github.com/xcuri0)
    41comments
  9. Show HN: Npunlock – Run custom C kernels for Intel NPUs(github.com/hsfzxjy)
    1comments
  10. What California is learning from solar panels built over irrigation canals(kqed.org)
    305comments
  11. SAML: A fractal of bad design(trailofbits.com)
    126comments
  12. How did AMD Ryzen get 50% faster in two years?(lemire.me)
    113comments
  13. No Easy Fix for Bogus Respondents in Online Opt-In Polls(pewresearch.org)
    5comments
  14. WordPress: Unauthenticated path traversal leading to conditional RCE(github.com/wordpress)
    93comments
  15. Claude Opus 5.5 Intelligence, Performance and Price Analysis (Max)(artificialanalysis.ai)
    81comments
  16. Pentagon says overreliance on AI contributed to missile strike on Iran school(bloomberg.com)
    290comments
  17. Unreal Agent(unreallabs.ai)
    98comments
  18. The softness of metal(psyche.co)
    5comments
  19. Grammarly will send unhinged messages to all your users if you try to cancel(reddit.com)
    14comments
  20. The current balance of power in open models(interconnects.ai)
    23comments
  21. People hooked on vapes try a new way to quit: cigarettes(bloomberg.com)
    165comments
  22. Obscura: VPN that can't log your activity(obscura.com)
    91comments
  23. OpenAI is well positioned to fast-follow Jev(arcturus-labs.com)
    204comments
  24. Show HN: JevBench, a reproducible benchmark for typed decision models(benchmarkheaven.com)
    24comments
  25. Delta: Highly available, strongly consistent storage using chain replication (2022)(fb.com)
    1comments
  26. Side-stepping the Secretary Problem, unwittingly(evalapply.org)
    13comments
  27. Markdown in /src(htmx.org)
    60comments
  28. Native apps written in TypeScript and CSS(github.com/geastack)
    36comments
  29. Apple has added persistent 'ads' to iOS, and it's driving users crazy(techradar.com)
    504comments
  30. 16-bit Intel 8088 chip (c. 1985)(allpoetry.com)
    15comments

How did AMD Ryzen get 50% faster in two years?

294 pointsby 4d agolemire.me
113 comments
4d agoHN ↗

It would have been funny if the "how" had been dropped to end with "Did AMD Ryzen get 50% faster in two years?"

4d agoHN ↗

Am I missing something? Max boost went up by only 15% but the base frequency went up 38%

Better thermals maybe? Less throttling?

4d agoHN ↗

its manufactured on a smaller node so probably has more leeway for higher freq on all core loads.

I’d also be weary of single core scores,Geekbench is known to be favoring specialized instruction sets like AVX or encryption extensions more and more as the version number progresses. Though I don’t know if GB6 is also like this I wouldn’t be surprised it it was caused by it.

4d agoHN ↗

>Better thermals maybe?

One of the biggest improvements to the Ryzen 7 X3D series (e.g. 9800) is that the caches have been moved from one side of the die (to the other), which places the major heat source closer to the heat sinks.

SO yes, less heat throttling.

4d agoHN ↗

Smaller node size means less voltage.

Power is heat, and the amount dissipated is the square of the voltage- a processor that is reliable at less voltage means you can get a lot more frequency in the same heat envelope.

Yet reliability decreases as frequency goes up, and that can only be stabilized by adding more voltage- so the faster you run the processor, the more voltage you ultimately have to give it, so the power/heat produced grows exponentially until you can't get rid of the heat fast enough (at which point your only option is to actively cool the chip).

This is overclocking 101.

Note that classic overclocking was viable because of arbitrage- buying a processor, pushing it to the point it got too hot, and stress-testing it at that temperature to ensure reliable operation. Processor manufacturers all do that formal verification at the factory now as they'd be uncompetitive otherwise, especially in laptops.

4d agoHN ↗

As ProllyInfamous mentioned; bringing the cores to the top helped reduce heat, which allows them to boost higher for longer periods then the 7800x3d.

4d agoHN ↗

2 years sounds very fast. It seems to be because the 3d cache SKUs of each generation were released at different stages. The Zen 3 one was a later variant.

First zen 3 November 5, 2020 with desktop processors. First desktop Ryzen 9000 processors on August 8, 2024. So the generations were about 4 years apart.

2h agoHN ↗

Yes I stated that as well in the previous comment [1] on how Apple got 50% faster in 3 years.

Compared this to the article "How did AMD Ryzen get 50% faster in two years?" The Zen 3 uArch being used in the article came out in 2020. So it is more like AMD got 50% faster in 5 years.

[1] https://news.ycombinator.com/item?id=49772502

4d agoHN ↗

I suspect the improvements are even more dramatic going from Zen 1 through to Zen 5. AMD has really hit the jackpot with how scalable the Ryzen CPU is considering how they're able to improve the performance from year to year. This is a stark difference to the FX series during the 2010s, which saw very small YoY performance increases by comparison. Ryzen really is AMD's equivalent to what Nehalem/Core was for Intel back in the mid 2000s.

9h agoHN ↗

That is all true but I will defend the FX series a little. Mostly now that there is a lot of software that scales across cores better now, they haven't aged as terribly as others have. They aren't great but not terrible considering.

9h agoHN ↗

Mostly now that there is a lot of software that scales across cores better now

That's pretty much irrelevant since the AMD's FX arch's issues weren't that SW at the time wasn't using all the 8 cores. Intel dropped the Core 2 Duo and Quad into the era where most SW was still stuck in single threaded for a long time and those CPUs still ripped single-threaded SW tasks regardless.

Here's the big reasons why the FX sucked back then and why they still suck today in the multi-thread SW era:

  Instead of discrete, fully independent cores, AMD grouped processing units into "Modules" where each module contained two integer execution units, but they had to share critical resources like one FPU, the instruction fetch/decode pipeline, and the L2 cache so when both "cores" inside a module were heavily taxed especially with math or physics-heavy calculations (like in videogames), they choked fighting over shared hardware.

  AMD designed Bulldozer with a very long pipeline, betting they could sacrifice efficiency per clock cycle in exchange for extraordinarily high clock speeds(a-la Intel Pentium 4) but the IPC was so bad that an FX core was often slower clock-for-clock than AMD’s previous-generation Phenom II chips and also their power consumption exploded. 

  FX processors were plagued by high cache latencies and an inefficient memory subsystem as another bottleneck.

So unless you're into collecting vintage CPUs as display pieces, this one definitely belongs in the e-waste pile instead of burning electricity, because it did not age like wine with the adoption of SW multi threading like people were hoping.

9h agoHN ↗

AMD designed Bulldozer with a very long pipeline, betting they could sacrifice efficiency per clock cycle in exchange for extraordinarily high clock speeds

It blows my mind that AMD watched Intel try to do basically the same thing only a few years prior with NetBurst, and fail so badly that they had to scrap that entire evolutionary branch and start over – and AMD still went and did it again themselves anyway.

8h agoHN ↗

I remember rumblings a decade-ish ago that basically their hand was possibly forced to release the thing to avoid a full on revolt about abandoning all of their work; after all, Intel had been investing in deep pipelines for a while before, they were strapped for cash after the ATI Acquisition, and other 'server-ish' CPUs had done CMT type things in the past (keeping in mind that AMD was seeing a huge surge in server market share due to Hammer.)

8h agoHN ↗

Hyperthreading/SMT is a significant boon for heavily threaded workloads. What makes that such a win while Bulldozer's implementation of "two integer units sharing a front-end, cache and FPU" is supposedly so bad? Because that description makes the 8 core Bulldozers sound exactly like a 4 core with SMT.

8h agoHN ↗

Hyperthreading/SMT is a significant boon for heavily threaded workloads.

That's hugely debatable and depends on SW workloads and the SMT implementation + CPU pipeline design.

In SMT the execution engines, ALUs, FPUs, and caches are completely shared. When one thread stalls waiting for RAM, the second thread sneaks into the idle execution units. At best, SMT yields a ~10% to 20% throughput boost over a single thread.

Because that description makes the 8 core Bulldozers sound exactly like a 4 core with SMT.

It's not the same thing. Bulldozer arch sits between a true 8-core and 4-core + SMT implementation.

8h agoHN ↗

At best, SMT yields a ~10% to 20% throughput boost over a single thread.

Exactly, which is a significant benefit for how marginal the costs are.

It's not the same thing. Bulldozer arch sits between a true 8-core and 4-core + SMT implementation.

Then surely it should be even better than 4 cores with SMT?

If you're going to argue that the problem with Bulldozer was it's weird semi-SMT solution, you need to explain how it would've been better without it (aka as a regular quad core). Because even if it just gets the 10-20% performance improvements from being a form of SMT it would be better to have it than to not. And if you have lots of integer unit-bound threads, it should be even better than that.

8h agoHN ↗

Then surely it should be even better than 4 cores with SMT? If you're going to argue that the problem with Bulldozer was it's weird semi-SMT solution, you need to explain how it would've been better without it

I explained all the bottlenecks of the architecture in a comment above, that the issue was more than 4-core +SMT instead of true 8 cores. Please read it.

2h agoHN ↗

Bulldozer was twice the die size of Intel 4C/8T but with lower performance.

8h agoHN ↗

AFAIR Steamroller was a big 'correction' of the Shared resource issues in the arch (I can't remember if other revisions had other improvements).

AMD was also having to deal with the fact GloFo split off and was relying more on general 'bulk' lithography, which kneecapped them for some time especially due to yield issues on the FX series and overall cost of that deal.

Intel also very quickly after, released Sandy Bridge and aggressively scaled it up and down; the 2500K was so cheap yet powerful I know of at least one setup that ran for a decade an only got replaced because they needed to upgrade to windows 11 for compliance-esque reasons. My own 2500K I replaced in 2017-2018-ish, only because either the motherboard took an unfortunate dive and it was easier to replace both at once.

FWIW, I did do a cheapie FX build in 2015ish for my then-girlfriend as a DVR and light gaming/emulation 'under the TV box', and it did the job well for the price, but it definitely wasn't anything amazing.

It was a tough time for AMD for sure. I think the 'split' between the Cat cores (Bobcat/Jaguar) also hurt them from a resource standpoint, although one could argue that it also kept them alive to recover (i.e. Jaguar in XBox One and PS4 being a volume contract part) [0]. They did a lot of moves that caused short term pain (that glofo spinnoff helped pay off the ATI Acquisition AFAIR) but helped them become the company that is still surviving today.

[0] - One odd side note, I still find it odd that they never did a dual channel Jaguar laptop part. I still ask whether it was because it would have made the FX look that bad...

8h agoHN ↗

Instead of discrete, fully independent cores, AMD grouped processing units into "Modules" where each...

Yeah that's hyper-threading intel was doing it as well and all modern CPUs do it as well. Where AMD dropped the ball, was they did not disclose that in their marketing as clearly as they should.

All CPUs today are marketed as x cores 2x threads, back then some AMD marketing genius in their infinite wisdom put 8 cores on the box, instead of the honest 4 cores with hyperthreading.

8h agoHN ↗

No, AMD's FX "fake" 8-core was more than just 4-cores + hyperthreading. In SMT(hyperthreading) the execution engines, ALUs, FPUs, and caches are completely shared, whereas on FX design, they built two completely separate integer pipelines (schedulers, register files, ALUs, and L1 data caches) inside one module. Only the instruction fetch/decode front-end, the FPU, and the L2 cache were shared. So the FX design would be an in-between a 4-core + SMT and a true 8-core.

7h agoHN ↗

Fair, I had not delved into the details, but still they were not full cores and the marketing did not make a real distinction.

I had a pilledriver one, it was a perfectly good cpu, I would buy it again. If I remember back then it was the best overall performance per dollar, the alternatives if I remember correctly were i7-39.. and i7-38.. and were at best 50% more expensive for 10-15% more performance.

7h agoHN ↗

Depends what you were doing with it. The Piledriver only beat the Intels in heavily multi threaded (preferably integer) workloads like media encoding, which is why it was popular with media creator workstations on a budget, but for most consumer real world tasks at the time, like video games, Intel was way ahead in performance even though it was more expensive.

The Piledriver would win the consumer bang/buck mindset back then because of the 6-core part was reasonably priced and unlocked for overclocking, so people would overclock them to beat the more expensive (locked?) 4-c/8-t Intels at a lower price, but that ignored the costs of massive extra power draw(100+ W) over the Intel, the need for beefier more expensive coolers and power supplies, more expensive AMD motherboards with beefier MOSFET power delivery stages built to withstand the higher power draws of the Piledriver, so in the end the actual bang/buck gain of the AMD system wasn't remotely as big as people were making it out to be, they were just happy to get a "6-core" AMD cheaper than a 4-core Intel thinking more cores = more "better", same how having more mega-herz was also more "better" a decade before that.

The Team AMD VS Team Intel wars on forums on these topics were wild back then.

4h agoHN ↗

(preferably integer) workloads like media encoding

Media encoding is actually an FPU workload, and a pretty brutal one at that.

Media encoding might not use much floating point arithmetic, but it does use massive amounts of packed integer SIMD. And all SIMD instructions (both integer and floating) execute on the shared FPU, not the integer unit. It's only scalar integer instructions that execute on the integer unit.

Which leads me to believe that Bulldozer's shared FPU is not a bottleneck at all. Most evidence seems to point to the shared frontend being the primary bottleneck (which is why steamroller puts some effort into duplicating the instruction decoding, for some pretty large IPC wins)

1h agoHN ↗

No. it's just the opposite of Hyper-thereading. SMT it's about maximize the resource usage of a CPU, running 2 or more threads at the same time. AMD used the opposite technique of SMT. It had a technical name that I can't remember now, and wasn't invented by AMD.

7h agoHN ↗

Instead of discrete, fully independent cores, AMD grouped processing units into "Modules" where each module contained two integer execution units, but they had to share critical resources like one FPU, the instruction fetch/decode pipeline, and the L2 cache so when both "cores" inside a module were heavily taxed especially with math or physics-heavy calculations (like in videogames), they choked fighting over shared hardware.

They did just fine in parallel workloads, so I think this is not accurate. The design scaled just fine. The problem was that each core was weak.

7h agoHN ↗

They did just fine in parallel workloads, so I think this is not accurate

Depends how you define "doing just fine in parallel workloads". The contemporary competition from Intel that was 4-core + SMT was beating AMD's 8-core FX CPUs in most real-world tasks and benchmarks at the time. The 8-core AMD broke even and rarely won only in >4-thread strictly integer benchmarks and some >4-thread media encoding tasks/benchmarks. So if you wanted a prosumer media encoding workstation a budget then yeah, the AMD was better, but for most real world task, it really wasn't.

The design scaled just fine. The problem was that each core was weak.

Can you elaborate and be more exact? What you wrote is technically vague and doesn't mean anything in technical dissection/terms.

5h agoHN ↗

When we say a design "scales", that means that increasing the size of the workload does not incur a lot of overhead. If contention between shared resources meant that the design was not able to achieve an ~8x speedup when run with eight parallel threads, that would mean the design was not scalable. But we did in fact see a roughly 8x speedup with eight threads, so the design scaled just fine. The problem with the design was that each core was individually crummy, so even eight cores running in parallel had lackluster performance.

The myth that each two-core module functioned more like one core with hyperthreading would suggest that these CPUs would have much higher per-core performance when lightly loaded than when fully loaded. That is not what happened. Each core was crummy even when lightly loaded, but under full load you would have eight crummy cores, which would beat four Intel cores on a lot of workloads.

The only time contention was a serious problem was with workloads that were dominated by floating point, which were relatively rare.

5h agoHN ↗

If contention between shared resources meant that the design was not able to achieve an ~8x speedup when run with eight parallel threads, that would mean the design was not scalable.

By that definition it definitely was not scalable.

But we did in fact see a roughly 8x speedup with eight threads,

Care to share a source? Because AFAIR there definitely was no 8x linear speedup with 8 threads even in benchmarks, let alone in real world use cases. The only benchmarks where those 8 threads would scale best and beat Intel were archival compression/decompression and media encoding. At everything else Intel wiped the floor with it.

The only time contention was a serious problem was with workloads that were dominated by floating point, which were relatively rare.

Many real-world compute workloads, especially gaming related, are floating point.

2h agoHN ↗

Instead of discrete, fully independent cores, AMD grouped processing units into "Modules"…

This argument has never made very much sense to me. Yes, the decision to group cores into modules with some shared resources did introduce a bottleneck and result in lower performance than having isolated cores. But this didn't make the processor worse than if it didn't have the additional cores at all. These processors were at their best on highly parallel workloads. AMD shipped far more cores than Intel at the same price. The contention for the shared front end was not serious enough to make up for the core count advantage. How is the module architecture an explanation for why the design failed, when the bottleneck only becomes relevant in situations where the design is winning?

It's hard to find benchmarks from 15 years ago. But Phoronix finds what I describe: the design doesn't scale quite as well as a "true" eight-core design, but still scales better than the competition of the time which had lower core counts. Though it does seem straightforwardly bad at some workloads.

https://www.phoronix.com/review/amd_bulldozer_scaling/7

It's as FlowingRiver said. If we were to release the same parts again with modern software, Bulldozer would be a far stronger competitor to Sandy Bridge. FX aged better than Intel's designs of the same era. But Intel's designs were better to start with, so I'd still take the Core.

The reason they sucked is that they ran hot and their per-core performance was terrible.

1h agoHN ↗

I did run a multithreaded CPU only n-body problem resolvers in FX cores. So heavy double precision work and putting each core to 100% . A Fx-8370E would get a speed up around 7.5 times Vs the single threaded version A FX-4300 would get a speed up around 3.9 times Vs the single threaded version

So in a physical heavy computation task, involving double precision math (where the AMD design of share FPU units should penalize most), the FX cores where happy churning numbers with the expected speedup Vs a single core/thread version of the code. So stop saying that FX cores sucks at multithread. They fucking worked fine on that kind of tasks.

1h agoHN ↗

I just was to say the same thing. I had a good experience with a FX-8370E. They go for too many cores to early, and sacrificed some of the CPU performance to do it. The gamble gone wrong...

7h agoHN ↗

Part of the reason we didn't see much in the way of YoY improvements for Bulldozer, is that AMD almost immediately abandoned it and threw resources at Zen after it launched.

Steamroller did see 30% IPC improvements over Bulldozer (all the design work would have been done before they switched to Zen), but AMD canceled the full FX version, and only ever shipped the APU version of Steamroller (with only 2 modules, aka 4 threads).

If they had shipped a Steamroller FX cpu, the generational improvements would have looked similar to many of the generational improvements that Zen received... but didn't really matter as Bulldozer started so far behind.

4d agoHN ↗

They never shipped the zen 5 epyc big cache chip (e.g. 9685X). :( I'd hoped they pulled it to produce a HBM integrated chip instead, but they didn't do that either.

10h agoHN ↗

I imagine they didn't want to cannibalize upcoming Zen 6 which will have the 3d cache

26m agoHN ↗

I don't think there are many fabs capable of producing HBM

My hope is on Huawei, which has recently developed a stacked chip architecture that reminds me of HBM, and I'm wondering if that's step 1 of China entering HBM production.

I don't know enough about hardware, so I might be saying absolute nonsense, happy to be corrected so I can learn where I'm wrong

10h agoHN ↗

The AMD Ryzen 9 9950X3D / EPYC 4585PX is a beast for 99% of compute workloads.

It has the highest base clock of any modern AMD chip (4.3 GHz), plus 16-cores, which is already more than most workloads need.

Can’t wait to see what Zen 6 brings early next year. Rumors say 24-cores and another big jump in single-core performance.

10h agoHN ↗

I looked at game benchmarks, and sometimes 5600 or 5600X were fastest. With all X3D processors so fast that I would not decide to upgrade above 5700X3D or anything cheaper. Now, with current RAM pricing, getting a X3D CPU with 90+ MB L3 Cache seams the way to go instead of doing a DDR4 -> DDR5 leap.

All stated for gaming, that is.

10h agoHN ↗

I still love my 5800X3D. Drop-in upgrade from a 3700X so I kept my board, RAM, cooler, everything.

4h agoHN ↗

Maybe I should do the same. I have 3800XT, I could go to 5900XT for like $300. I don't see myself upgrading anytime soon because these prices are laughable and will eventually come back down when the AI bubble pops.

8h agoHN ↗

I feel like most benchmarks don’t really capture CPU benefits to gaming.

It’s even difficult to find CPU benchmarks that don’t overemphasize 1080p and eSports scenarios.

My upgrade from 5600x3D to 9850x3D felt kind of dumb at the time, but I decided to do it because Micro Center’s bundle deals are so far below market pricing.

I was shocked at how much better it is. Benchmarks and FPS don’t really show things like micro stutters and little performance wrinkles like that. I’m not even sure 1% low FPS counts capture it.

A great example game for this is Oblivion Remastered. Upgrading my CPU alone with the same GPU took away the environment loading slowdown almost entirely.

The benchmark will tell you that I didn’t gain any FPS during gameplay but every time I open a door into the new environment my CPU is positively impacting the experience.

I would have said the exact same thing you are saying until I actually experienced upgrading to the best on the market. For the record, this is the first time in my life I’ve actually owned the best CPU on the market for gaming.

My old advice would have been to buy one of those sweet spot cheaper mid-range gaming CPUs, but my newer advice is really if you’ve already spent all that you’re willing to spend on a GPU (I have a 9070XT, my only upgrade paths are insanely expensive), buy the highest gaming CPU on the list for gaming benchmarks (e.g., I wouldn’t go crazy with a 9950X3D2 since it doesn’t have any gaming improvements above the 9850X3D).

And the thing about CPUs is they’re not insanely expensive like GPUs. We are talking a price delta of $200 between this beast of a CPU and something way more middling.

7h agoHN ↗

Oblivion remastered is an absolute dumpster fire for performance in general.

Given the massive increase in hardware prices lately, we are going to have to get by with mid range or even low end hardware for a lot longer. Studios will be forced to actually optimise games to not run like shit on a sub $8000 PC.

Every game should be targeting the switch 2 and steam deck in terms of power.

3h agoHN ↗

Every game should be targeting the switch 2 and steam deck in terms of power.

I think PS5 is a perfectly reasonable spec to be targeting, which was the higher end of mid range about 5 years ago, and still significantly out performs Switch 2 (which significantly out performs steam deck). I’m sure the GTA sales will demonstrate that the install base at this spec is wide enough for broad commercial success.

8h agoHN ↗

Most benchmarks use singleplayer games with built it benchmark, you'll not see the biggest difference there. If you play online games like shooters, MMO, anything really with multiple players or entities, theres usually a much bigger difference. Also in rts games and such with many units.

10h agoHN ↗

Compound this with Linux users seeing a ~8% gain (and some very big gains here and there) on performance from ongoing kernel improvements too! https://www.phoronix.com/review/linux-618-73-amd-epyc

This only goes back one year, to Linux 6.18. Wins would be even bigger if we go back another year. Also, this isn't tracking any of the rest of the improvements in userland: it's just the kernel. Some newer GCC, and upcoming new x86-64v3 targets will all have some pretty nice wins too.

Great days to be on open source. And it only ever gets better.

10h agoHN ↗

I love my frameworks strix halo box. 16 zen 5 cores with way more memory bandwidth than they should have for a desktop. Only missing the x3d cache

10h agoHN ↗

Is this what's helping drive their stock price to the moon?

8h agoHN ↗

They're starting to catch up with NVIDIA. Because AI.

3h agoHN ↗

No. They make server CPUs which is predicted/expected to be the next bottleneck after memory.

10h agoHN ↗

Serious question with 1GB L3 isn't it theoretically possible to boot a full Linux without ram?

Edit: dug in it, no, because cache isn't addressable and it's directly managed by the cpu.

9h agoHN ↗

I used to use a full Slackware Linux distribution with X-Windows on a 486 clone with 4 Megabytes of RAM.

9h agoHN ↗

Intel has a cache-as-ram (CAR) mode / Non-Eviction Mode, which is what you wanted but it is only available before DRAM is brought up via core initialization. Not sure about AMD.

5h agoHN ↗

AFAIK AMD doesn’t do this because it’s a pain in the butt to do from a hardware and firmware perspective. They basically have their equivalent of the intel ME do RAM for training and then the main cpu comes on with DRAM already up. At least it was like that five years ago when I last worked on an AMD part.

6h agoHN ↗

I suspect this will also be sliced across cores on a CCD, which means even less effective cache for a single core boot

10h agoHN ↗

I'm not sure focusing on just 3 processors is enough to claim that Ryzen got 50% faster. There were already other, faster Ryzen processors available without the additional cache. The extra cache was a very new thing (and very temperature sensitive), so it makes sense that they start carefully and then get a lot of improvement quickly). And the 5800x3d was for an older chipset, with all the limitations that come with that.

10h agoHN ↗

It's not that temperature sensitive, 90C is plenty. If you can't keep the non-x3d processors underneath that you're just throwing away performance anyways

9h agoHN ↗

Are you? I'm pretty sure when I bought my 7800x3d, everybody was saying you had to be very careful about heat, because these damage more easily from high temperatures than regular CPUs. I just checked, and they do throttle at a lower temperature than others: 89 vs 95 degrees C.

8h agoHN ↗

It will still throttle itself so no real danger.

10h agoHN ↗

The x86 architecture still going strong. I've always though Ryzen was a fitting name, AMD had Ryzen from the ashes and struck a blow to the long dominant Intel.

7h agoHN ↗

When I built my Ryzen 1800X desktop, I named it "AMD Ryzing". My optimism turned out well placed.

I recently upgraded from that to a Core Ultra 7 that I got from work (e-waste recycling). It was not my intended upgrade path, and I hope Lisa isn't too mad lol (I kept my Radeon though).

7h agoHN ↗

a Core Ultra 7 that I got from work (e-waste recycling)

How the hell does a high end CPU that's barely 2 years old end up in e-waste recycling? Was Richie Rich using them or something?

6h agoHN ↗

Was Richie Rich using them or something?

Sort of: there were about half a dozen in micro PCs in a load picked up from a hospital. I was kinda bummed that they were BIOS password locked (as were the other PCs from there). The model didn't have a password reset jumper (or any reset mechanism outside of contact Dell support with proof of purchase), so I couldn't sell them as whole systems, and stripped them for parts.

We get DDR5-based systems from time to time, but they're understandably rare. Most of the time, they still work. My rule: any day I come across DDR5 is a good day.

6h agoHN ↗

But why was the hospital throwing away what was essentially new high end systems that can run all the latest SW and operating systems? For what reason? It just makes no sense to me. Or am I too poor of a peasant to understand?

Are you by any chance in some super-rich part of the US? Because then no wonder your healthcare is so expensive when hospitals treat high end PCs as single use disposables. Here in Europe I sometimes see hospitals and doctors practices using 10+ year old PCs and still rocking the old 17-19 inch 1280x1024 CCFL LCD monitors from like the mid-2000s.

Regardless, I'd love to just run into high end PCs being thrown away here and pick them up for free, but where I live I see people barely throwing away their value-line Dell/HP Core 2 Duo towers with audacity to ask for 25+ Euros for their e-waste with the classic "no lowballs, I know what I got" attitude.

6h agoHN ↗

For what reason? It just makes no sense to me. Or am I too poor of a peasant to understand?

I don't understand it either. Two scenarios make sense to me:

Somewhat probable: everyone in a department got upgraded, no exceptions. 'This is a really nice PC, but the boss says it has to go.' (There were about 100 i5 9th gen mini PCs (still OK), and 500 t640 thin clients in that same load.)

Less probable: some department got closed and cleaned out.

Are you in some rich part of the US?

Pittsburgh, Pennsylvania. Not particularly rich (rust belt), but healthcare is a significant part of the local economy. About 90% of healthcare here seems to run on HP, but Dells can appear.

Here in Europe I sometimes see hospitals and doctors practices using 10+ year old PCs and still rocking the old 17-19 inch 1280x1024 CCFL LCD monitors from like the mid 2000s.

My stomach turns seeing the dozens of 24" probably 1080p monitors we scrap every day. Pretty much all are significantly scratched when they come off the truck, otherwise reselling them might be good business.

6h agoHN ↗

Somewhat probable: everyone in a department got upgraded, no exceptions. 'This is a really nice PC, but the boss says it has to go.'

Here in Europe all that is 100% resold either locally, or further to balkans/eastern-europe due to much lower purchasing power making the resale efforts of ~5 year old HW economically viable. I check the local "craigslist" often and I notice when a business is clearing house due to a flood of used HPs/Dells/Lenovos from a single user. However the list prices aren't remotely palpable to be good deals. I assume the person/business hired for clearing the house is marking them up significantly hoping to squeeze a big win from a mark.

Some of the tech companies I worked for here would first auction their older HW internally at every upgrade cycle to the employees before selling what was left to a clearing company, which makes me feel we're being robbed to be offered by employers to bid for their e-waste when in the US people find better stuff in the trash for free. Europoor indeed.

otherwise reselling them might be good business

I assume those businesses don't bother reselling 1080p monitors and 2 year old PCs, and instead just throw them away, because the price of labor is so high in those parts of the US, that paying a full-time employee to take care of such resale tasks will cost them more money than they expect to make from the sale, so it's assumed to be cheaper and less hassle to just throw everything in the trash instead of wasting time on the used market dealing with tire-kickers just to gain what is essentially peanuts money for those businesses' bottom line.

Am I close with my assessment?

6h agoHN ↗

If an intern did it (or even a low paid full-time employee), one could easily turn a profit selling used equipment. (I work in the refurb department, reselling used stuff is literally my job!) 5 minutes per monitor @ $25/each = $300 per hour. You could sell to wholesalers for much less per unit, in exchange for not wasting time with random people.

I'm not sure how prevalent this practice is, but IT equipment is sometimes on a depreciation schedule. If an employee starts selling the company's PCs and monitors, an accountant will get very angry, because he told the government that the stuff is literally worthless, but it apparently isn't because it was sold for something. IANAL, but I'm fairly sure that's tax fraud. Once it's turned over to someone else (my company) for free, the valuation resets, or something.

1h agoHN ↗

Oh come on, stop felling sorry for yourself. I'm from one of those countries compared to which even Eastern Europe you offload hardware to is a paradise.

None of what you're describing is available here at all. I sometimes see Europeans willing to ship here (already very few) offer heavily used and scratched ThinkPads and Dells for money they weren't worth when they were new. Add at least $80 on top for shipping, and no warranty, you get what you get.

On the local market, you will find those Core 2 Duo with precisely the attitude you're describing, but at 2-4 times the cost.

So I buy everything new, which is expensive with our salaries, but we have no choice. At least new hardware is available now thanks to selling over the internet and improved logistics.

10 years ago you could only buy what was offered by local shops, which was always at least two generations behind, and at least twice as expensive as it was in the EU (forget the US).

For example, if things continued like this to this day, I'd estimate the newest CPU you could buy right now would be something like Ryzen 3600, at twice the cost it was in your country when it just came out. If we're lucky, maybe 7600 would already appear at a similar overprice.

I'm sure many parts of the planet are even in a worse position than we are.

10h agoHN ↗

Single core performance still worse than an iPhone.

The x86 folks lost the ball completely. For workstation/ mobile needs you go to arm. For matmul at scale you go to gpus.

I guess windows gaming with separate gpu is the only remaining market for them.

Unless Nvidia releases a motherboard with an arm cpu on top of their RTX cards, and then that market is gone too.

9h agoHN ↗

The IPhone runs on a battery, with no active cooling.

There is no chance the sustained single core perf is better than a 150=200+w ryzen with a big noctua cooler on it. The power draw alone would kill the battery in a few minutes(?), and the heat would make it catch fire. lol

3h agoHN ↗

I don't think you are correct for single-core performance.

A20 Pro scores around 4725 at 8.9w. Geekerwan's review showed that the iPhone 18 pro could dissipate as much as 6.4w during long gaming tests. Cutting power by 50% likely still keeps around 80% of the clockspeed.

As 9950x scores around 3400-3450 in geekbench, or around 28% slower.

There's a very good chance that the iPhone single thread performance is genuinely faster even during sustained loads.

3h agoHN ↗

Sustained performance is usually based on cooling, not the chip. There is no reason the iPhone chip can't sustain its performance if you give it a small fan.

So whatever your argument is, it doesn't make much sense.

The M6 is based on A20 Pro and it sustains its performance in a Mac Mini indefinitely - likely longer than Ryzens.

6h agoHN ↗

If you compare like for like, ie. take the process node out of the picture, then you need to compare the Ryzen 9000 series to the A16, as both use TSMC's 4NP process.

2h agoHN ↗

There is nothing like for like. We're comparing a fanless phone chip to machines that might have water cooling and nearly unlimited power.

10h agoHN ↗

It's impressive and yet it surely depends what you're doing with it? 50% better performance isn't going to make a local LLM feel quick and yet so many other aspects of computing are quite fast anyhow. I can browse the web fairly comfortably on a Raspberry Pi and it's a bit slow but manageable.

8h agoHN ↗

If your goal is web browsing you will want faster single core performance. Unfortunately that means Apple M series. If your goal is local LLM, I’m afraid a several-year-old GPU will smoke the fastest CPU available today.

7h agoHN ↗

IIRC, compared to GPUs, M-series is currently still stuck in memory bandwidths from around 2016. M7 might catch up to 2019 or so. So GPUs will be better for LLMs for a pretty decent while.

6h agoHN ↗

How so? I don't know of any other mainstream platform with >1TB/s memory bandwidth. Personally I don't want to deal with macOS but between the memory bandwidth and out of box Thunderbolt networking it's hard to argue that Apple doesn't have a couple significant advantages over the current alternatives.

5h agoHN ↗

I don't know of any other mainstream platform with >1TB/s memory bandwidth.

I mean, RTX 5080 has nearly 1TB/s, 5090 has nearly 2TB/s. Maybe you are talking about CPUs / unified memory platforms? I agree nobody else does it better. But for LLMs, GPUs can still be significantly faster than even the most advanced Apple silicon on the planet. TTFT in particular is super inferior with Apple, for now.

That's probably also the reason Apple had to reluctantly give into Nvidia servers for the initial rollout of Siri AI, though they claim to use trusted computing extensions to reach an acceptable level of privacy. (I do not trust that nearly as much as the Apple Silicon nodes)

It'll be amazing five years or whatever down the line to see Apple reaching those figures. They seem to be heading in that direction lately.

8h agoHN ↗

I Picked a threadripper for a box that needed a lot of IO and figured that with that many PCI lanes I couldn't go wrong. But I have to admit I've been more than pleasantly surprised by the performance of the CPU as well, it - easily - outperforms all of the XEON and I7 based boxes that I have. The only thing I wished I would have done different is to max it out with 256G DIMMs when they weren't the price of a car.

7h agoHN ↗

Zen 5 really is nice. I swapped my RAM from a Xeon W Sapphire Rapids machine into a Threadripper Pro 9000 series machine and I get almost double the memory read performance, plus it's a heck of a lot faster in single and multi core performance, and it runs cooler and quieter. Huge win all around. Aside from the price... (I went from Xeon W5-3435X to TR Pro 9985WX, eep.)

6h agoHN ↗

I have the complete opposite experience. Got a 9550x with 64gb ddr5 and a fairly high end mobo about two year ago. Just running the memory at stock speed. About 50% of the time I’d reboot and one or both of the sticks would only be detected as 2gb. Would need to do a hard shutdown to get it back.

I eventually gave up and turned off memory context restore and now I just deal with the minute plus (!) time to Post.

Not sure if amd memory controllers are just garbo or what but I’m going back to intel next chance I get.

6h agoHN ↗

What brand of ram, and was the ram listed on the supported spec sheet for the motherboard?

Up to date on bios updates?

5h agoHN ↗

Yes and yes, it’s crucial ram. Nothing exotic.

5h agoHN ↗

Weird, just had to check.

DDR5 has been kind of a mess imo, just in general.

4h agoHN ↗

Yea I’ve done endless googling around the issue and it seems to be a not uncommon issue with ddr5 but there’s no way I’m buying new parts now so I’ve come to peace with it.

5h agoHN ↗

Doesn't mean it can be broken. Also might be a CPU contact issue.

5h agoHN ↗

On the desktop Intel has better memory controllers last time I looked, but it’s not that big a difference. Something in your setup is just broken. Failures will happen with any brand, so I wouldn’t chalk it up to AMD vs Intel… figure out where your problem is and get the faulty part replaced if you can.

I feel you though, regardless of the cause, that is an extremely frustrating place to be.

4h agoHN ↗

Yea I’m just bummed because it’s a real expensive time to be swapping memory parts around. Like I said, things seem to just work without memory context restore so I’m fine with just paying the cost when I reboot once a week or whatever. I feel like the fact that disabling MCR fixes it should narrow down the issue to some part, I’m just not sure which.

3h agoHN ↗

I went the opposite way and went back to Intel after many many years on AMD. I snagged a Xeon 654 Granite Rapids ($850) for a new workstation geared towards local inference. I don’t need a ton of CPU cores and all Granite Rapids have 8 memory channels where as you need very high end Threadrippers (9975wx for $4000) for an equivalent due to their CCD design.

As a bonus Granite Rapids is super power efficient and runs much cooler than my previous TR and Ryzens. Intel seems to be doing good things again! My only minor complaint is that P2P doesn’t work on my multiple GPU setup because every PCIe5x16 lane has its own dedicated root to the CPU, but all that bandwidth is useful for MoE models that are offloaded to RAM.

59m agoHN ↗

You could get a PCIe switch backplane, stick your GPUs on there and then have them communicate locally through the switch using p2p. For some GPUs you may have to use a hacked driver (google p2p 3090 for instance).

7h agoHN ↗

I’ve been running the 64 core (128 logical cores) Threadripper PRO 3995WX in my dev machine for 4 years now (with 256gb ram).

Not sure I’ll need to upgrade my computer ever again :D

7h agoHN ↗

Threadripper is underrated for IO-heavy boxes. I made the same mistake with RAM prices, though; should have maxed it out when it was cheap

5h agoHN ↗

I picked up a pre-ai-price-insanity AX162-R at Hetzner a while back and loaded it up on memory to max out the 12 channels the 48c EPYC 9454P as a "this will be the last mysql box I'll need" and have I been _wildly_ impressed with it's performance. The things I throw at it are honestly laughable at times, wildly irresponsible queries against a rather large database, the redis qps metrics are ridiculous and I just load it up with random ggufs since the memory bandwidth is... not terrible and 384GB of it is... useful.

The web app that's hosted on it deals with lots of images and text - over 100mil of each deduplicated, embedded, simhashed - it does the hashing, and the embedding in real time during ingest. Just handles it.

These things are absolutely insane.

1h agoHN ↗

i have 2 epyc boards from 2019 and they are still just printing money

6h agoHN ↗

Weird they didn't talk about the DDR4->DDR5 transition. The 5800X3d->7800X3D went from DDR4->DDR5.

DDR5 is literally twice the price per GB. It's better for sure, higher bandwidth but waaaay more expensive. The 9800X3D supports much faster and even more expensive DDR5 than the 7800X3D too (DDR5-2667 to DDR5-5600).

5h agoHN ↗

There was a brief and glorious time before September 2025 where DDR5 was actually pretty comparable.

Even really good DDR5 could be had for cheap; I remember paying like 300$ for 96GB of high-quality M-die hynix DDR5.

5h agoHN ↗

July 11 last year I got a Crucial 128GB kit for $299. Those were the days…

4h agoHN ↗

Zen3 is 7nm, Zen4 is 5nm and Zen5 is n4p. That's also why Apple is ahead; TSMC is a big factor.

3h agoHN ↗

It's not actually 2 years. It is 4 years of progress.

Zen 3: 2020 release

Zen 4: 2022 release

Zen 5: 2024 release

The author is disingenuous by looking at only the X3D variants. The Zen 3 X3D variant came out late.

For comparison, in the same time frame, the M4 is 52% faster in ST and 72% faster in MT than M1.[0] If you go by what you can physically buy in stores since Zen 3 was released to now, Apple's chips have gotten 83% faster in ST and 143% faster in MT.[1]

[0]https://browser.geekbench.com/v7/cpu/compare/433673?baseline...

[1]https://browser.geekbench.com/v7/cpu/compare/435139?baseline...

2h agoHN ↗

It's funny how my 3950X, which I still find to be an absolute monster for anything I throw at it, isn't even in the benchmarks anymore. Hard to believe it's 7 years old.

1h agoHN ↗

Perhaps better looking at it without the 3D Cache on GB6 scores.

2020 Zen 3 AMD Ryzen 7 5800 - 1852

2024 Zen 5 AMD Ryzen 9600X. - 2914

2027? Zen 6 - Est 3200?

And compare this to Apple.

M6 4000+

M5 3600+

M4 3300+

Even the Snapdragon X2 Elite X2E is better at 3300.

The gap isn't exactly shrinking. And I would love x86 to prove me wrong. But even a hypothetical Zen 7 in 2028 ( 2029 for consumer ) may only catch up to Apple's M5 released in 2025.

1h agoHN ↗

With CPUs becoming wider and wider, it's almost like they run VLIW instructions, only more flexible.

1h agoHN ↗

I was recently able to get a workload of mine optimized enough on Zen 5 to hit a sustained 6.0 IPC/core (3.0 / thread) at 5.1 GHz. Seeing the a > 99.8% branch prediction rate and a > 99.99% L2 cache hit rate retiring > 1T instructions every 3 seconds feels amazing.

Zen5 is incredible when you're able to make the most of it. I’m super excited about Zen6.

27m agoHN ↗

zen5 is really the first CPU of the avx512 era (since it's the first time normal compiler devs have them to play with)

4m agoHN ↗

Can you share any more details about the workload? Always interesting to hear of something like that which isn't a useless microbenchmark.

Does it use vector? What can you hit with SMT disabled?

42m agoHN ↗

Because nobody cares about CPUs anymore and they thought now was the time to flex those numbers that were always possible? Because all eyes are on NVIDIA GPUs?

40m agoHN ↗

The article compares 2022 CPU against a 2024 one.