Best stories

Live mirror
30 storiesupdated 0s agoView source snapshot
  1. Show HN: An e-ink frame that hears birds and draws them as 1800s illustrations(github.com/arnegiacomo ↗)
    169comments
  2. I can't stop thinking about Papua New Guinea(notnottalmud.substack.com ↗)
    415comments
  3. 25 years of mass surveillance is enough(schneier.com ↗)
    277comments
  4. XCancel service is suspended until further notice(xcancel.com ↗)
    1009comments
  5. Steam Frame starts at $1059(steampowered.com ↗)
    615comments
  6. iOS 27, iPadOS 27, and macOS 27(apple.com ↗)
    823comments
  7. Dario, Please(rdi.sh ↗)
    298comments
  8. Introducing System One Models and Jev(typesafe.ai ↗)
    197comments
  9. OpenAI bots knew about the RubyGems caching vulnerability(tenderlovemaking.com ↗)
    413comments
  10. Pion, an agent designed to run any company autonomously(andonlabs.com ↗)
    584comments
  11. US confirms for first time it has deployed space weapons(bbc.com ↗)
    295comments
  12. A single firm is behind OpenAI, Anthropic, and Meta hacking scandals(effort.news ↗)
    141comments
  13. Suspected sabotage causes major Netherlands rail disruption(bbc.com ↗)
    380comments
  14. Apple's Dimensional Drawings(developer.apple.com ↗)
    131comments
  15. Linux from Scratch(linuxfromscratch.org ↗)
    109comments
  16. How to write an effective software design document(refactoringenglish.com ↗)
    139comments
  17. Distributed Systems Classics (2017)(nvartolomei.com ↗)
    73comments
  18. An Update on Wayback Machine Access(blog.archive.org ↗)
    175comments
  19. Nike exits the S&P 100 after 18 years and a $200B market-cap wipeout(fortune.com ↗)
    427comments
  20. Java 27(openjdk.org ↗)
    277comments
  21. Charts built for Chat(dbtcharts.com ↗)
    89comments
  22. Let's make quality the norm again(forbrukerradet.no ↗)
    291comments
  23. The case against JPEG XL(giannirosato.com ↗)
    377comments
  24. Ubuntu 26.10 completes transition to Rust-based coreutils(omgubuntu.co.uk ↗)
    295comments
  25. XCancel suspended "due to a new development in the ongoing legal proceedings"(xcancel.com ↗)
    1comments
  26. The contagion of fear(dtrace.org ↗)
    189comments
  27. A beginning for mathematics(daniellitt.com ↗)
    146comments
  28. Show HN: Capsule – Single-file web apps that save their data into SQLite(withcapsule.app ↗)
    113comments
  29. Microsoft patches Windows and Excel – breaks audio, remote access, and paste(theregister.com ↗)
    177comments
  30. Gemini 3.8 Live and 3.8 Live Extended Thinking(blog.google ↗)
    171comments

Ubuntu 26.10 completes transition to Rust-based coreutils

272 pointsby 1d agoomgubuntu.co.uk
251 comments
1d agoHN ↗

I really don't understand why Canonical rushes this. If 'rm' can't remove all possible directory entries, that is a big issue:

  $ podman run --rm -it ubuntu:26.10
  $ apt update -y; apt upgrade -y
  $ rm --version
  rm (uutils coreutils) 0.10.0
  $ gnumkdir -p $(yes a/ | head -n $((32 * 1024)) | tr -d '\n')
  $ rm -rf a
  Segmentation fault (core dumped) rm -rf a
  $ ls a
  a
  $ gnurm -rf a
  $ ls a
  ls: cannot access 'a': No such file or directory
1d agoHN ↗

Rush? This is an interim release (95% or so only tracks LTS's) that is not even out yet... Go file a bug reports if you have some time.

1d agoHN ↗

I have. It has been an open bug upstream for years as well.

1d agoHN ↗

ok, that's concerning, if you post it here I'll vote for it (after confirming).

1d agoHN ↗

Reporting bugs before Ubuntu releases has never worked for me. They always land a bunch of major changes after the supposed "freeze" then they ignore all feedback because of the freeze. It's infuriating.

17h agoHN ↗

I've been a Ubuntu user for about 20 years, and I file bugs every now and then on launchpad. I don't recall any of them ever being fixed.

Maybe the bugs get traction if you have a service contract?

Best to file bugs directly to upstream, but that of course means you should try it on the latest upstream version and not whatever version ubuntu ships, so it's more friction.

13h agoHN ↗

Upstream for much is Debian, but of course Ubuntu forks from testing, and then modifies...

But if you can identify it as a bug in a version in Debian, that's a good place to file, as Ubuntu will get the fix eventually.

12h agoHN ↗

Reporting bugs _at all_ in Ubuntu has never worked for me.

1d agoHN ↗

I did, and the original dev of the component fixed it within a few days. It was straightforward, a backwards reading of a spec, reordered.

The fix is still sitting unmerged many months later.

This surprised me since I thought the project was in heavy bugfix/compat mode. I won’t touch it until I see some velocity on open bugs.

17h agoHN ↗

Fork Ubuntu and threaten their business model, that’ll get their attention.

Only half joking.

14h agoHN ↗

There's very little incentive to switch. When people release for Linux they almost always first/only test it works on Ubuntu - hence it's going to be the least buggy. (ex: GOG only seemingly tested games on Ubuntu)

So the switching cost is buggy software. You'd need something radically different that brings enough new features to the table to make it worth it the switch and dealing with bad/non-existant support.

I think something like Nix/Guix but with stable library versions that matches Ubuntu/Debian LTS ones 1-to-1 could get traction

14h agoHN ↗

Then you would have to embrace their bad decisions, such as this one, and if you do, what’s the point?

Everything just needs to run from a container with their expected runtime environment.

5h agoHN ↗

If you still have toes, take some morphine and reload.

11h agoHN ↗

My solution was to stop using Ubuntu and move to Debian.

9h agoHN ↗

And in that debian install rust unix coreutils as default

17h agoHN ↗

My experience is that filing bug reports to ubuntu is a complete waste of time. Not sure if it's different for paying users.

14h agoHN ↗

This is certainly not just affecting interim releases. Ubuntu 26.04.1 has been released but is currently held back from do-release-upgrade for the LTS channel (which IIRC is unusual for a LTS's .1 release) due to rust-coreutils issue:

Users of Ubuntu 24.04 LTS will be offered an automatic upgrade to 26.04.1 LTS via Update Manager a couple of weeks following this release after some planned backports to address regressions in a recent version of rust-coreutils.

https://discourse.ubuntu.com/t/ubuntu-26-04-1-lts-released/8...

13h agoHN ↗

This is what made me move away from Ubuntu. Use LTS and encounter issues with outdated packages? "Well duh, you're supposed to upgrade to interim releases if you need remotely up to date software". Use interim releases and encounter bugs? "Well duh, it's an interim release. Of course it's a buggy mess, nobody uses those"

Every Fedora release is intended to be solid and they come out twice a year.

9h agoHN ↗

I moved to Fedora from Ubuntu about a year ago for my laptop. My main motivation was not be defaulted to snap packages. I have had a great experience i.e it gets out of the way and it doesn't fall apart when I update stuff. I was worried about SELinux but find Fedoras defaults just fine and intuitive.

19h agoHN ↗

Yes, please. Linux distros is better with macos approach. And making appimage first class makes a lot of sense.

18h agoHN ↗

I'll avoid it at this point anyway. The Rust coreutils is another reason for that. Snap, monetizing updates, telemetry, enough is enough.

18h agoHN ↗

Yup. After almost 20 years, I have had enough of their crap. All of my new machines are getting Debian. Can’t wait until I am free of Ubuntu.

17h agoHN ↗

Appimages are bloated and unreliable. You can't guarantee that your app will run on any machine because it might depend on different system libraries.

Flatpak uses shared stable runtimes that are the same everywhere and don't take up space more than once. It also comes with a native update system and sandboxing. Snap is the same thing but worse.

16h agoHN ↗

Snap is the same thing but worse

IIRC Snap relies heavily on AppArmor for sandboxing, so on anything non-Ubuntu the sandboxing is non-existent.

16h agoHN ↗

My problem with flatpak is that the underlying runtime has a limited lifespan. I used the Sublime Text 3 flatpak for many years, and it was deprecated a few months ago because the runtime it was using was no longer supported. This caused people to update the flatpak to Sublime 4, which is good, but I only have a license for 3. In the end I just downloaded the binary for 3 from their website, and it still just worked. Flatpak still doesn't save you from bitrot.

16h agoHN ↗

AppImages do not work anywhere close to how macOSs .apps do, and even if they did the approach isn't correct for how things work on Linux.

17h agoHN ↗

I think ubuntu wants to kill desktop linux. No other explaination of why they push firefox inside snap, which then proceeds to constantly crash, when firefox used normally works completely fine.

I haven't tried chromium but I presume it's the same issue.

At work I'm forced to use ubuntu and I placed snapd on hold and added mozilla's own apt repository to my configuration to get firefox.

At least in the past few months the dbus crashes (been using systemd on debian for several years just fine, this never happened) that render the system unusable and un-rebootable have stopped… I guess when my company will decide to upgrade to 26.04 there will be more instability and problems.

16h agoHN ↗

Firefox installed as a snap feels sluggish to me. When I install a Ubuntu system, the first thing I do is to uninstall any snap and install the apt versions of things, possibly adding official PPAs or using Guix to install software.

14h agoHN ↗

why bother with ubuntu at all ? If you want ubuntu but without snap out of the box, Zorin is 1 option. Or if you also hate gnome, linux mint.

13h agoHN ↗

Indeed. Thought not in all cases I can decide what OS to use. An employer might prescribe which one to use. And any distro will be better than being forced to use Windows.

14h agoHN ↗

sandboxing a browser makes total sense. my firefox and chromium running as snaps never crashed a single time for as long as I can remember, and I use both every day, at the same time.

12h agoHN ↗

Both have performance issues when installed as snaps across my 24.04 and 26.04 machines.

8h agoHN ↗

I sandbox with firejail. There is no reason to use snaps. Also in firejail I never experienced a crash.

never crashed a single time

I'm very happy for you. How does that help the people who do encounter issues?

11h agoHN ↗

I haven't tried chromium but I presume it's the same issue

No issues with snap Chromium.

18h agoHN ↗

There is no reason for anyone on any distro to use snap.

It will die so just leave it alone.

1d agoHN ↗

yeah, this is a bug. And yes, it should be fixed. But I don't think it will affect many users, I mean who has a 32000 -evels deep directory on their system?

1d agoHN ↗

That way of thinking just means it'll never be fixed

1d agoHN ↗

Nah, people should (and do) fix small issues as well as big issues. Lying about the scale of issues and calling them "big" when they aren't just leads to no ability to prioritize or evaluate.

Incidentally someone submitted a PR for this issue about 3 hours before the first comment about it in this thread - https://github.com/uutils/coreutils/pull/14554 (and 2 hours before this link was submitted to HN)

1d agoHN ↗

"The Linux philosophy is 'Laugh in the face of danger'. Oops. Wrong One. 'Do it yourself'. Yes, that's it." Linus Torvalds

1d agoHN ↗

The problem there is that this is exactly the class of bug that does not exist in GNU coreutils because of philosophy of that project. Non-existence of such bugs proves that the impementation is not copied from AT&T code.

16h agoHN ↗

It's complicated to do it yourself when upstream won't accept your code.

1d agoHN ↗

What approach would you suggest for priorisation of tickets?

1d agoHN ↗

Ideally there should have been no tickets at all if all that's happening is a program being ported to another language.

1d agoHN ↗

This isn't a port - it's a re-implementation without any use of the original source.

That's also not all that's happening. It's also making improvements like better internalization support, better error messages, and a small handful of other extensions.

1d agoHN ↗

I have had to tell them repeatedly to stop copying tests verbatim, including the original comments from GNU coreutils. So I doubt this is true, which is frustrating.

1d agoHN ↗

What programmer or programming language can't iterate a loop more than 32000 times?!

1d agoHN ↗

It's a stack overflow which means it's using recursion and for historical reasons that don't make sense any more, stacks are teeny tiny on 64-bit Linux - apparently only 8 MB on Linux! I'm not sure why they don't raise it to something reasonable like 4 GB. I guess because they want consistency with 32-bit? Maybe we can finally change it if/when they phase out support for 32-bit Linux. Apparently it might not be that far away:

https://lwn.net/Articles/1035727/

1d agoHN ↗

OIC. Rust doesn't guarantee optimizing tail recursion. How unfortunate for a language that's getting widespread adoption.

1d agoHN ↗

For what it's worth there's reasonably active [1] work on implementing opt-in guaranteed tail calls - but it's not particularly fast going. LLVM (the backend rust uses) needs better support for musttail (e.g. some architectures just don't support it [2]).

[1] https://github.com/rust-lang/rust/issues/112788

[2] https://github.com/rust-lang/rust/issues/153827

By-default guaranteed tail calls really isn't rust's style, because it means subtle changes (introducing a destructor, re-ordering code, etc) can change semantics without you realizing it. If you want to guarantee that a call can't allocate a new stack frame you should have to say it.

1d agoHN ↗

Not so familiar with this area, but isn't the existing behavior of implicitly creating new stacks more of a problem than implicit tail-call elimination? Seems the latter is a kind of compiler-level optimization, of which there are already many (I think) that change the semantics internally but guarantee the outward behavior stays the same.

But I can understand the preference for an explicit opt-in, to make clear that it is enforced and not assumed.

20h agoHN ↗

because it means subtle changes (introducing a destructor, re-ordering code, etc) can change semantics without you realizing it.

No, it won't change semantics - if you say @musttail or similar, it will simply fail to compile if you, say, introduce a destructor - the semantics will not subtly change.

1d agoHN ↗

Do any widely used languages guarantee tail call optimization? It's a pretty niche feature.

1d agoHN ↗

Scala, ocaml, racket, clojure, zig.

For recursion only kotlin.

(For most of these only with syntax specifying it)

10h agoHN ↗

How interesting. I'd seen LISP(y) implementations like Scheme guarantee tail-call since recursion is a very common technique in that language family. But I didn't know Zig supported it.

https://ziglang.org/documentation/master/#call

They have an @call built-in that guarantees: always/never tail, as well as always/never inline. That's neat, I can see how that would be useful in various situations.

9h agoHN ↗

Depends on how widely we consider Scheme and Raket adoption in CS curriculum.

14h agoHN ↗

I don't think that's related? The bug alluded to looks something like

    function rm(node) {
        for (const child of ls(node))
            rm(child);
        unlink(node);
    }

and no amount of tail call optimization will save you here, because this isn't tail recursion. Of course you could rewrite it using an explicit stack + tail recursion, but then you might as well be using a while loop.

19h agoHN ↗

8MB is the default per-thread stack size from glibc, also seems to be the default "ulimit" from pam or the kernel, I'm not sure. So for the main/default thread (or if not using threads) the process can use setrlimit() and for threads it can use pthread_attr_setstacksize() to get bigger stacks if it knows it may need them.

8MB is pretty huge though; musl libc is famous for defaulting to much smaller per-thread stack size of 128KB (to avoid over-committing lots of memory when there are many threads - the main dev is really principled/opinionated on this topic, but again there are a few ways for applications to explicitly size their stacks as large as they need). Linux kernel threads get a bit less than 16KB!

9h agoHN ↗

8MB is huge compared to the stacks we used to have when address spaces were 32-bit, but it's tiny compared to how much memory we can actually make use of now. The only real argument I can think of for having such a small stack is that large stack usage is often indicative of an infinite recursion bug and it catches them earlier.

But I don't really buy that for the same reason most programming languages don't limit loops to 8 million iterations (or whatever) by default - it would make catching infinite loop bugs easier!

I say most, because I know of at least one language that did do that - QuakeC! It made lots of sense in that context though.

1d agoHN ↗

When triaging an issue you have to prioritise. Do you fix a problem that affects 2-3 people or one that may affect thousands?

17h agoHN ↗

The point is that such bugs shouldn't exist in the first place.

Using recursion on unbounded inputs on a programming language that doesn't support that (which are most) is an extremely classical mistake that really should be known to all programmers, especially those of low level languages that care about safety.

Every time you call something recursively you should be thinking "how deep is this?".

10h agoHN ↗

The point is that such bugs shouldn't exist in the first place.

That's true of every bug, but you don't have infinite time or manpower, so how do you prioritise?

16h agoHN ↗

By that logic, why even spend effort migrating from a known-working implementation to one which is known to have outstanding bugs that there isn't enough bandwidth to fix?

10h agoHN ↗

Hard to say, but there are legitimate reasons. One of which being they think Rust is growing while C is a shrinking language. Other could be safety (yes, yes the audit did surface bugs). Or even that having a single lib work seamlessly on Windows/Linux/MacOS/Redux/Web.

16h agoHN ↗

It's less about the specific issue and more indicative of bad/insufficient test coverage

12h agoHN ↗

But I don't think it will affect many users, I mean who has a 32000 -evels deep directory on their system?

When the GNU coreutils version doesn't have this bug and thus affects zero users, why should I bother with the Rust version?

8h agoHN ↗

AI agent needs , rust memory safety , wasm , parralel task

10h agoHN ↗

from a ground-up rewrite, in a memory safe language i expect at the very least

- A meaningful error

- not a segfault

1d agoHN ↗

I mean, that should work... but you can see why that would be considered low priority right?

18h agoHN ↗

Wow! Memory safety and such... Reminds me when a friend of mine wrote in IRC long time ago: "Hmm, tail just segfaulted." When I asked "Are you on Hurd?" he just replied "Yes."

16h agoHN ↗

to enable GPL free embedded Ubuntu, field tested on all platforms (because it happens to be the default).

16h agoHN ↗

Hi, this is not a one bug.when the change app flags not working or not happening. I was measured with bsd and busybox.

15h agoHN ↗

And that’s why i keep ubuntu far from my computers…

14h agoHN ↗

I tried switching a buildroot based CI server to the 26.04

One Makefile statement triggered a bug in rust ln:

  src/%:
      @ln -sfn $(DIR)/foo src

In parallel build, we would get random failure:

  ln: Already exists

Rewrote that Makefile to work-around it, and ended up with the same kind of bugs with parallel $(INSTALL) -D ...

Tried latest ubuntu 26.10 which supposedly fixes a lot of TOCTOU races in rust coreutils, but no better.

Gave up and switched back to original coreutils.

14h agoHN ↗

It's entirely aisine and makes me avoid Ubuntu every time it is possible. And it is repeated offence, Ubuntu always tried to push the envelope in worst place and way possible

13h agoHN ↗

But this is totally not a memory ownership bug! It's some other kind of bug!

13h agoHN ↗

While I supported that idea of Rust coreutils, this your experiment showed me how bad it is. My results are totally different, but not what I expected (edited out long strings of "a/a/a" for brevity). I wouldn't call it stable...

  root@71a8c5a6c5e3:/# mkdir -p $(yes a/ | head -n $((32 * 1024)) | tr -d '\n')
  mkdir: File name too long
  root@71a8c5a6c5e3:/# gnumkdir -p $(yes a/ | head -n $((32 * 1024)) | tr -d '\n')
  gnumkdir: cannot create directory 'a/a/a/.../a/a': File name too long
  root@71a8c5a6c5e3:/# gnumkdir -p $(yes a/ | head -n $((3 * 1024)) | tr -d '\n')
  root@71a8c5a6c5e3:/# rm -rf a
  rm: cannot remove 'a/a/a/.../a/a/a': Directory not empty
  root@71a8c5a6c5e3:/# gnurm -rf a
  root@71a8c5a6c5e3:/# rm -rf a
  root@71a8c5a6c5e3:/#

And then they plan to move to a new Rust-based NTP. No comment...

12h agoHN ↗

I wouldn’t judge the ntpd-rs move from this. Have been running it for 9 months or so with a nts pool in ntp server mode on my pi5. Been rock solid.

12h agoHN ↗

Ubuntu is free. But Canonical is for profit. In these cases "if you are not paying for the product, you are the product" applies.

Ubuntu users will test this. Once the problems are ironed out, other distros will follow.

11h agoHN ↗

It is Year of the Linux Desktop, not Year of the Linux Cli.

1d agoHN ↗

You can use equivs to create a dummy coreutils-from-uutils package, as mentioned in the responses to that report.

It is frustrating that Canonical has no interest in fixing it, though. It makes it hard to take their claims seriously that you can still use GNU coreutils if you want.

16h agoHN ↗

You're specifically frustrated about unbounded stack recursion exhausting the stack, triggered by multiple thousands of directories? It doesn't sound like this is about multi-thousand-deep directory structures, it sounds like it's about something else.

Because even diving into it, I would agree with a prioritisation decision that puts this bug down the bottom of a priority list.

12h agoHN ↗

This isn't the first issue with uutils.

Canonical is just rushing the switch because they want to get rid of software with GPLv3 license, not because there is any technical merit for doing so.

12h agoHN ↗

If they want the default to be non-GPLv3 Rust-based that's fine, but some of us don't care (and want the same behaviour everywhere, like on RH-based systems we may also have) and they should leave the GNU as an option. Potentially both could be installed at the same time (it's what update-alternatives is for after all).

8h agoHN ↗

That would work, but they also don't want everybody to switch to the better alternative and nullify their effort.

12h agoHN ↗

That's a better thing to discuss, and I'd expect there to be better bugs to talk about to go with it. Stack exhaustion in an unrealistic environment should be fixed, but a "stop everything" bug it ain't.

1d agoHN ↗

For now you can list dependent packages manually in apt-get install: https://packages.ubuntu.com/resolute/build-essential

But it's clear that Ubuntu will remove coreutils, genuine sudo and other tools from the future versions. It's the direction, it's ideological and thus nor merit nor our feedback will change anything here.

1d agoHN ↗

nah

i was referring to their counterfeit sudo emulator written in rust. It's called "sudo-rs" afair.

1d agoHN ↗

Was there something wrong with how they are currently written or do they just want the badge that says they converted to Rust?

20h agoHN ↗

License. GNU is copyleft and the new thing is permissive.

We might see a fracture open slowly. For me, even AGPL is not enough

19h agoHN ↗

Once they have a more permissive license, cui bono?

17h agoHN ↗

Businesses.

There is a reason all FOSS OS alternatives for embedded systems like Zephyr, NuttX, FreeRTOS, IDF, Arduino,... are not GPL based, while Google has purged Android and ChromeOS from it, with the Linux kernel being the only GPL piece left.

8h agoHN ↗

Arduino,... are not GPL based

Arduino is "just" repacked gcc in a nutshell, so it is GPL-based.

7h agoHN ↗

I was only thinking about the software, yes. Also a lot of the "Arduino" libraries are not really owned by Arduino, even if they like to attach themself to it, so while it is true what they write about different licenses of the libraries, this what not what I considered to be part of Arduino itself. I was only thinking of the buildtools they release. While these are board specific, these are often "just" a fork of gcc, board-specific linker/image builders, a flasher and the Arduino-build system. Only the latter is what they actually created (arguable not even that: https://arduinohistory.github.io/).

18h agoHN ↗

Neither. They basically see Rust as the future. They want to be able to attract young contributors and to hire young employees who are excited about Rust and who want the safety features. Bear in mind, the average age of the Linux developer is increasing. They also see technical benefits in Rust. And they are increasing test coverage of both the Rust tools and the tools written in C, IIRC.

My source is this interview with the VP of Engineering at Canonical on this topic: https://corrode.dev/podcast/s05e05-canonical/

16h agoHN ↗

In reality, I think it much more about taking more control over parts of the ecosystem - the license change is part of it, but also getting rid of the old stubborn communities and maintainers.

15h agoHN ↗

Interestingly enough, young developers have no issues writing C or C++ when it comes to game development, Pebble, Arduino or ESP-32 coding.

13h agoHN ↗

Seriously doubt it, given that there is enough FOSS on those domains as well.

15h agoHN ↗

Canonical hasn't contributed anything to GNU coreutils in the time since the switch was announced, just to be clear.

1d agoHN ↗

The reason for existence of uutils is ideological, not technical. Thus code quality is of no use for the objective.

1d agoHN ↗

I’m a huge proponent of Rust and generally lean a lot closer to the RIIR mentality than most, but this effort seems to be such a waste of effort and resources.

There have been a dozen CVEs reported against all of coreutils in the past twenty years. The most recent audit of uutils-coreutils turned up forty-four CVEs.

By all appearances they’re replacing battle-tested and fundamental tooling which hasn’t been a problem with extremely amateurish Rust. The threading highlighted in the linked post above seems pretty egregious.

1d agoHN ↗

Same here. Love Rust. Hate rust rewrites.

16h agoHN ↗

The worst thing about rust are the people using it.

16h agoHN ↗

My impression is that go developers moved to rust.

16h agoHN ↗

I doubt it, as Rust approach to language design is the antithesis of Go's culture.

I would appreciate Go much more otherwise.

16h agoHN ↗

Can vouch for the sentiment, hence why regardless of the ranting, I am quite supportive of whatever helps to improve C and C++ security story.

Also for Rust based rewrites, they could start by bootstraping Rust compiler itself, dependent on C++ to start it.

They don't do it, because even though LLVM and GCC are written in C++, a pure Rust compiler would not scale to the same level of contributions, and existing capabilities.

14h agoHN ↗

I think this is more about the licence, the Rust rewrite just makes it easier to swallow/gain contributors.

5h agoHN ↗

Yes, these proclamations of Rust devs that 'the future belongs to us', aren't getting any new fans for the language. Here's my rebuttal:

YOU have proclaimed the language to be as fast as C while being safe. YOU need to prove it. Think of this as an OPPORTUNITY to PROVE that Rust can walk the walk, and you can make Rust coreutils as fast as the C one. Think hard about how you can model low level Linux constructs safely. Fix your libs. Fix the compiler. This is the yardstick you need to meet. You are making free software, and the thing about it is users are free to choose otherwise. YOU need to prove that Rust is just as fast and lightweight as C, and once you do, we'll be happy to adopt.

Right now, dear Rust devs, what you are doing is the same as AI companies are doing - you're trying to usurp power based on extremely nebulous conjured threats. Nobody likes being threatened.

23h agoHN ↗

I bet you don't know the reason for existence

11h agoHN ↗

The reason for existence of uutils is ideological, not technical.

which ideology? Are people saying that there's an ideology of pushing rust for things without concern for quality? Sincere question, because I'm seeing that on this thread and I wasn't aware that that was a thing beyond the "re-write it in Rust" meme.

6h agoHN ↗

With the motivation of then being able to use it in closed or non-GPL products down the line?

11h agoHN ↗

Are people saying that there's an ideology of pushing rust for things without concern for quality?

Yes, there is. There are people who genuinely think quality does not matter as log as it is written in Rust as Rust is memory safe.

9h agoHN ↗

There are people who genuinely think quality does not matter as log as it is written in Rust as Rust is memory safe.

Is this hyperbolic? Such people are in leadership places?

10h agoHN ↗

The original authors of uutils do not particularly care about licensing, and the Rust ecosystem defaults to MIT/Apache2. So they chose that.

Many people have decided that this decision supposedly specifically about licensing ideology.

You can make up your mind about which of the two you believe.

See also, for Ubuntu's take on this: https://news.ycombinator.com/item?id=49707948

6h agoHN ↗

As I have told the authors privately, I find it quite difficult to take their claim that they "don't care about licensing" seriously. 13/14 of the projects under uutils are relicensing GNU or GPL'd software. The other one, shadow-rs, is totally vibe-coded, and the README mistakenly says the original shadow is GNU software under the GPL, which is neither true. If 14/14 are relicensing, or in that one case, what is thought to be relicensing, the simple explanation is that it is an explicit goal of the project.

1d agoHN ↗

last I looked[1] (which was a few years ago)

You weren't kidding: it was exactly 4 years ago ("September 13, 2022").

10h agoHN ↗

Neat. I touched this code about 8 months later to avoid the per-block elapsed() call: https://github.com/uutils/coreutils/commit/cf7b90bbe7cb87099...

Mirrored the way I implemented status=progress in FreeBSD dd, though there the flag was set by a SIGALRM timer: https://freshbsd.org/freebsd/src/commit/4767c42c1146459eb751...

It would appear GNU dd 9.9 still does a call for every block. Low-hanging fruit if anyone fancies it:

     dd if=/dev/zero of=/dev/null count=100000000 status=progress
    51200000000 bytes transferred in 18.644004 secs (2746191200 bytes/sec)

     target/release/dd if=/dev/zero of=/dev/null count=100000000 status=progress
    51200000000 bytes (51 GB, 48 GiB) copied, 20.8772 s, 2.5 GB/s

     gdd if=/dev/zero of=/dev/null count=100000000 status=progress
    51200000000 bytes (51 GB, 48 GiB) copied, 23.6744 s, 2.2 GB/s
19h agoHN ↗

Hmm, this doesn’t make sense. You simply don’t replace utilities with many decades of maturity and that “just work” with something that is not as mature. It will open all users of the distro to all sorts of subtle and not so subtle bugs. I for one don’t want to find myself staring at a mysterious segfault when I want to build the latest version of nodejs or flash a microcontroller. It’s such a pity; I have used Ubuntu for close to 23 years.

19h agoHN ↗

then install the other tool. no one is holding a gun to your head. it isn't windows.

18h agoHN ↗

Like how one can easily not use snap on Ubuntu? /s

18h agoHN ↗

Everything online reminds of when Ubuntu switched to dash for init scripts or something. Good times.

18h agoHN ↗

So what is the way forward for Linux to have sandboxi g as strong as Android? Appimage everything? I know it's possible now hacking together things, but I mean by default and integrated.

16h agoHN ↗

Maybe we could develop trustworthy free-software applications again, instead of trying to establish a commercial apps ecosystem on top of Linux?

16h agoHN ↗

Amutable. Building an immutable and image based system which even the installer can't modify, a-la macOS.

One systemd patch at a time.

8h agoHN ↗

This is actually already required to be supported by complying to the FHS.

9h agoHN ↗

Note that the sandbox also relies on the fact that most userspace is managed, the Android team is very clear on what they see as supported use cases for the NDK.

16h agoHN ↗

I don't understand - I thought sudo-rs was supposed to be a drop-in replacement? If it implements a subset of features how can this be the case?

10h agoHN ↗

Its not that if they have advertised themselves as a drop-in replacement or not. What made me bummed that cannonical used it as drop-in replacement and it did break some of my installation scripts.

10h agoHN ↗

the uutils project bills themselves as a drop-in replacement for coreutils. sudo-rs does not bill itself as a drop-in replacement for sudo

17h agoHN ↗

Can’t wait for the whole Rust rewrite of Linux!

17h agoHN ↗

Whether you like Rust or not, it's questionable as to why Canonical would push this so much and do it in such a cavalier way.

Will this really make coreutils more secure? I doubt it, if anything there will be a river of new bugs.

So, again, why are they pushing Rust so much? Having Microsoft make Rust a 'Tier-1' language also doesn't bode well.

16h agoHN ↗

Canonical has been pushing its own agenda for ages, how many examples do you need?

Microsoft making Rust tier 1 is great, it means probably one day we get a VS proper support instead of VSCode only.

If you head off to Microsoft official blogs, you will find out that Microsoft already has tier 1 support for Java (ironically), Python and Go, besides the usual .NET languages and C++.

5h agoHN ↗

Why does 'Ubuntu defaultism' still exist in the Linux world? Them replacing packages with shitty unworkable broken snap substitutes that can break the system when updating, and have a habit of reinstalling themselves...

14h agoHN ↗

It removes a GPLv3 dependency that might stop some companies from adopting Ubuntu Core.

11h agoHN ↗

Even more reason not to use it. Its clear that user freedom is under greater threat than it ever has been.

14h agoHN ↗

> Will this really make coreutils more secure?

In the long run yes. Sure, many logic bugs happen in Rust programs as well, but memory safety bugs are another level of hell. At least many classes of exploits will mostly be impossible. Also, Rust program failures tend to be more predictable. For example, in C/C++, if you do out of bound writes in an array or writes in a freed memory block, the behavior is undefined. The program might crash, the memory might be silently corrupted, or nothing might happen at all. In a normal (non unsafe) Rust code these kinds of issues are either prevented by static checks or become explicit runtime panics.

While the migration could be done more gradually, 26.10 is not an LTS release and is not considered stabe enough. The next LTS is 28.04, so I hope there is 1.5+ years for things to stabilize.

10h agoHN ↗

new C++ STL standard makes it no more undefined.

10h agoHN ↗

In theory yes, but it requires enough discipline and knowledge. A language that makes it harder to write bad code still has an advantage over a language that doesn't care about bad code.

7h agoHN ↗

Can you point to any outstanding, unfixable, memory safety bugs in the coreutils that justify such a rewrite? This is a cynical license issue, not a safety issue. I think there are much more severe security risks which come from behavior divergence of replacement tooling than memory safety bugs from 40 year old widely used/tested software.

16h agoHN ↗

Other distros are based of ununtu. Will the all ship with crippled coreutils from now on?

16h agoHN ↗

Linux Mint mentioned on their blog that they would be using the Rust versions.

16h agoHN ↗

People still use ubuntu when Debian and Mint exist?

16h agoHN ↗

The power of marketing…

Ubuntu does offer some certifications but only for paying customers, so everyone else should really steer clear.

16h agoHN ↗

Yes, proprietary hardware support out of the box, and pre-installed option by the few OEMs that sell GNU/Linux computers.

14h agoHN ↗

My nvidia GPU worked just fine. Debian has non-free repo you know...

14h agoHN ↗

I know how well it has worked in practice since the Walnut Creek CDROMs were a thing.

12h agoHN ↗

Nowadays the non-free-firmware repo is active by default, so the normal official debian image actually works.

It used to be the case that the normal download from the homepage was often useless because it didn't support most networking hardware, but this is no longer the case now.

12h agoHN ↗

How long ago was that? I tried Debian about 15-20 years ago and I don’t recall encountering that issue.

(The issue I do remember encountering was random kernel panics that I didn’t have with Ubuntu on the same machine.)

10h agoHN ↗

as soon as wifi became a widespread thing, you had to add the required package to the installer. It stopped being an issue with bookworm

7h agoHN ↗

Got to love this website :D Downvoted for completely true information with no ideological spin :D :D :D

12h agoHN ↗

Why would I switch off of Ubuntu? It's what came with my system.

12h agoHN ↗

Debian packages are ancient, unless you use "testing", which will be broken. That being said, Ubuntu is horrible too. The problem comes when you have to use proprietary software made by incompetent vendors, and that only works in Ubuntu.

12h agoHN ↗

Ubuntu is basically a packages imported/synced from debian (I think they mostly cherry pick unstable) + ubuntu specific stuff.

Debian Testing is pretty much what many Debian users use on a daily basis. They pretty much invented the notion of rolling releases. Debian stable is of course not cut that often. Ubuntu has a higher frequency of updates. But still, their LTS releases are spaced two years apart. 26.10 follows the recent LTS 26.04 release, so that gives them a good 1.5 years to work on stabilizing this. I've been using Ubuntu server LTS releases for the last ten years or so with generally no major issues. There are always some minor headaches between updates but generally nothing that worries me.

The main criticism here seems to be that these packages need a bit more work or are still lacking certain important features. Getting them out in a non LTS release like this is how they get packages to be ready for LTS releases. If you need LTS now, 26.04 is what you should be using. By 28.04, this should be rock solid.

For me what's risky here is deviating from what other distros are doing. Including Debian. Ubuntu has a history of being opinionated not everything they push through being adopted with great enthusiasm (e.g. Snap). You could make the point here that waiting for Debian to pick this up would be nicer. But you could also make the point that waiting for that is a very slow process.

10h agoHN ↗

Debian packages are ancient

ever used backports? no need to go to sid. Flatpack/Appimage/Compile from source for the rest (on my debian machine it's just kicad that is not installed from APT, well and the couple of softwares that don't do deb)

Firmwares, that's another story, i have fedora on the laptop for that.

The problem comes when you have to use proprietary software made by incompetent vendors, and that only works in Ubuntu If i want to do FPGA development, either ubuntu or a distro old enough to package JDK 11 (sigh) and X. not XWayland. Debian 11 was the last one to have JDK 11 i think (talk about ancient..)

Needless to say FPGA is done on the windows machine these days.

11h agoHN ↗

Mint is downstream from Ubuntu still afaik. They had/have LMDE as an escape hatch, maybe they should pull the ripcord (to mix metaphors.)

Need a wider variety of people protecting Debian anyway, governance there is getting weird.

16h agoHN ↗

If you ask their motivation? "We want to make them safer"

They worked pretty fine for decades, now, who needs these rewrites? Not saying it's useless, but in practice, what benefits did this bring?

16h agoHN ↗

it's GPL free. which is good for embedded, the business side of it. like cars.

4h agoHN ↗

and deliberately so, as it would be infinitely hard to upgrade the kernel license.

alas, only GPL-3 gives the right to repair and modify the TV or car or refrigerator you own...

15h agoHN ↗

Good for car manufacturers, not necessarily for cars or their owners. As a car owner I quite like manufacturers to be forced to produce source code.

12h agoHN ↗

Car manufacturers really really hate GPLv3 and the requirement that users need to be able to change the code.

They claim it is for compliance but it's well known that user modifications to cars are no longer the responsibility of the car company. I think it's more on principle than any real legal concern.

4h agoHN ↗

yes, exactly, that's the fliplside of it. the business loves GPL free embedded, gpl-3 was created to protect our freedom, the right to repair and modify, as far as GPL components are concerned. it was created as response to Tivo, who locked in their embedded system (a TV iirc).

the trend to give software mit or bsd licenses instead ead of GPL is concerning.

15h agoHN ↗

"Stronger" is absolute bullshit. No data race prevention. No intra-object protection. Mandatory GC, and 5x the compute cost. Nothing like a statically safe language.

15h agoHN ↗

It's coreutils, there shouldn't be any threads to be data racing.

15h agoHN ↗

Haven't threads been one of the reason some core util got faster?

15h agoHN ↗

Only GNU sort uses threads. There is still some room for improvement there, if anyone wants to take a shot at it. :)

8h agoHN ↗

I think I saw the Rust based implementations sometimes used a separate thread for background tasks like statistics reporting. Not much additional in the way of "directly" using threads, but I wonder how many could actually be any faster with direct threading.

15h agoHN ↗

Ubuntu continues on it's quixotic mission to kill Linux...

15h agoHN ↗

I would be very curious about a bit more concrete and substential criticism what is bad (or good) about how the both versions, that goes beyond general arguments like:

  Just because it is Rust, it is not safe!  
  
  It worked before, don't replace it!  
  
  etc.  
  

Not that these are not valid points of criticism, but in my opinion if we have two core utils we can (and should) pick the better one after careful continous evaluation. And if the old one is the better one on the day of the release, so be it. Having two competing solutions can have benefits for everybody looking for the best core utils they can get in the long run.

I had to reimplement and reverse engineer old tech myself as part of my dayjob and had those engineers seen my results it probably would have improved their work as well, since I usually found oddities that they probably did not intend to be that way. This means my work on their work could be seen as another pair of eyeballs, bullet-proofing their original work, instead of seeing me as a threat. That additional pair of eyeballs is crucial to open source software.

This is why it is sad that too much about this whole discussion feels like yet another culture war, heated on the stove of social media figures looking to convert heat into ad revenue.

Which is why I would love to have more concrete points of technical criticism of specific bits maybe even to specific lines in the code or specific reproducable behavior.

If we go the culture-war route nobody wins, if we discuss both solutions on their merits, we all can win.

14h agoHN ↗

since I usually found oddities that they probably did not intend to be that way.

Or it could be you don't have the context like they did. Maybe some hardware bug/quirk that happens on some exotic machine that you don't have.

14h agoHN ↗

I think a lot of the actual issues they're encountering are that the underlying POSIX APIs have a lot of sharp edges which the older versions of the tools have had enough time to work around, while the newer ones are generally running into the same rakes that have been there for decades. It takes a fair amount of time for those to be found and dealt with (though it also takes use, so it's a bit chicken-and-egg).

8h agoHN ↗

we can (and should) pick the better one after careful continous evaluation

The current complaint is that they pick the worse one after at the current evaluation.

13h agoHN ↗

how helpful is it for it to be transitioned to rust, how does it help?

13h agoHN ↗

if the argument is "but bugs!" then that's a nothing burger. Your old code is more battle-tested, but that doesn't inherently make it better. I wish more companies thought like this.

12h agoHN ↗

It may not inherently make it better (for some meanings of "better") but it certainly makes it more secure and more stable. Those are attributes which I would value very highly in coreutils.

12h agoHN ↗

We already had a problem with sudo-rs not handling all the options that previous sudo did. I am quite surprised sudo-rs is now the default even.

12h agoHN ↗

They could just compile the core utils with fil C and call it a day.

11h agoHN ↗

They should do like Solaris did and offer multiple different core tools in different paths, until they're up to par at least. It's not that complex of a workaround.

I don't use Ubuntu but this is huge, it's just as big as when FreeBSD switched to all BSD licensed user tools, I remember having to learn how tar worked again.

11h agoHN ↗

Manny comments I agree with - it's a mistake, it's a reason to leave the distro...

I'd like to point out that Ubuntu/Canonical is now seemingly philosophically separate from the origins of GNU and Linux. If you're curious, read "Hackers" by Stephen Levy. They've lost the plot, so to speak, about the core spirit of open software and hardware, which is what gave the projects life in the first place. A philosophical understanding and unity between many, many top notch independent developers.

Another note is how AI contributions to such libraries and programs is going to have an unknown effect on quality. It's almost like there's a business case to rip all the good FOSS written by humans out of the hands of github and apt, and curate all the best source code to ensure it remains in circulation, and extant copies are available that are not washed out by loose standards WRT AI contribs. Or if not a business case, perhaps a reasonable reaction and a good personal vendetta.

11h agoHN ↗

Next step, make them subtly incompatible with gnutils. Then make them a Ubuntu dependency, then a systemd/Gnome dependency. Then take Ubuntu closed source. Success, suckers!

11h agoHN ↗

ProTip: You can switch back to Gnu coreutils on 26.04 with:

apt install coreutils-from-gnu coreutils-from-uutils- --allow-remove-essential

And pin it so an upgrade doesn't flip it back with:

printf 'Package: coreutils-from-uutils\nPin: release a=*\nPin-Priority: -10\n' \ | sudo tee /etc/apt/preferences.d/uutils > /dev/null

10h agoHN ↗

Just curious, why the 'sudo tee {file} > /dev/null'?

10h agoHN ↗

it writes to the file with elevated priviledges and doesn't write it back to the terminal, effectively a 'sudo sh -c '{cmd} > {file}''.

sudo tee is a common way to work around priviledge restrictions in shell pipes (you can't easily 'sudo' a pipe), if /secure was 0600 and owned by root:

"sudo echo "test" > /secure" or "sudo printf '' > /secure", would not work because your user's shell process can't write to /secure. However, "echo 'test' | sudo tee /secure" works because the elevated 'sudo tee' can write to the file.

11h agoHN ↗

Beware that rust coreutils on 26.04 currently has really bad performance with larger block sizes. Ganeti uses "dd bs=1M" as part of a disc image transfer pipeline, and with 26.04 performance dropped from ~350MB/sec to 30MB/sec, with the dd command CPU-bounded.

The issue seems to be that it is operating on partial buffers and then having to copy remainder of that 1M buffer around as part is consumed. Coreutils 0.11 solves that but 26.04 is at v0.8.

I've always used "bs=32k" because decades ago I did some testing and found that seemed to be large enough that it reduced the overhead while not being so large that it caused other problems, one of the most noticeable being scheduler issues where performance went into the toilet, especially on SD or USB thumb drives. Using this also seems to work better with rust coreutils dd.

10h agoHN ↗

Why are we still using dd?

Seriously, it's a weird obtuse command. Weird syntax that doesn't match anything else, and the block size shouldn't be needed 99% of the time. A modern tool should figure out a good value on its own, either by interrogating the devices at both ends, or by benchmarking, or both.

10h agoHN ↗

I don’t know of a better tool that operates on raw blocks, maybe there is one.

`dd` is a real power user command, I’d prefer that it isn’t doing “intelligent” things, especially not by default.

10h agoHN ↗

this works great but in my experience sometimes you should add

  && sync

not sure why it's necessary only sometimes!

9h agoHN ↗

The kernel has a cache used for block devices.

If you want to be more targeted:

    blockdev --flushbufs /dev/sda
9h agoHN ↗

This isn't portable though, it's a GNU-specific "smart" things. Elsewhere, this overwrites the target device file.

9h agoHN ↗

Redirection doesn't overwrite device files, so

  cat foo.img > /dev/sda

works and should be portable. No control over the buffer size, though.

8h agoHN ↗

How exactly is cp not portable?

Whatever behaviour you’re describing is not how POSIX mandates cp to work. In fact you can do this with busybox too.

cp will open("/dev/sda", O_WRONLY | O_TRUNC) and simply start writing to that file descriptor.

8h agoHN ↗

How about bmaptool? It can work on sparse images.

In general, I don't see the point in manually specifying block sizes most of the time. What I want nearly always the maximum performance, and that should be possible to derive from the hardware, and/or benchmarking.

What about uses like say, skipping data? seek= and skip= are in block sizes, that may not be ideal for performance.

A smart tool should be able to write in 1 MB blocks and yet still skip 512 bytes.

5h agoHN ↗

How can a command which was explicitly designed to do nothing but read and write disk become CPU bound?

11h agoHN ↗

Meanwhile I just booted stagex on AWS without any C code at all other than the kernel and libc.

In a dev branch we now have rust ssh, dhcp, init, job management, etc. Rust all the things. Very soon will be able to swap the kernel for Asterinas and drop the last couple libc dependencies to have a complete rust OS that is Linux binary compatible.

I wonder how many other distros will rustmax.

10h agoHN ↗

I had no idea they were doing this; good for them!

1. What fraction of the core OS can be switched over? Can they oxidize systemd?

2. Are other distros going to switch over (e.g. Debian, which I think of as the ur-distro)?

10h agoHN ↗

I had a go at making an Ubuntu package recently - and to setup a PPA for it. That was a nightmare from hell that I gave up on (from ambiguous documentation, to 100s of how-tos that don't quite work for my case to making a package build in their system). To me it seems odd that coreutils is worth footling with when other problems seem to stand out to me.

9h agoHN ↗

I'm struggling to see the upside of replacing working coreutils when the replacement still has bugs that the old implementation doesn't. Rust being safer is nice, but that doesn't help much if the new rm segfaults

8h agoHN ↗

How can you undo that. Is `sudo apt install coreutils` enough?

4h agoHN ↗

One thing that was sneaky was that how the rust coreutils are laid out invalidated a bunch of AppArmor.

3h agoHN ↗

I wonder about the dependency graphs of all these replacement utilities.

The vast majority of Rust projects I've seen pull in hundreds, sometimes even thousands, of external projects. If Ubuntu's rusty tools do the same, any memory safety gained would come with a greatly increased supply chain risk.

Doesn't attack surface matter?