He's also put up a blog post about the incident. Apparently it's back up under Google's "Project Shield":

https://news.ycombinator.com/item?id=12575047

https://krebsonsecurity.com/2016/09/the-democratization-of-c...

You may be thinking of this discussion, "KrebsOnSecurity is now up and hosted on Google Cloud":

https://news.ycombinator.com/item?id=12574428

Something very weird is going on - krebsonsecurity.com is resolving to 127.0.0.1 . Could this be an attempt by someone's DNS servers to make the machines in the original attacking botnet DoS themselves?

I'm seeing the same thing. IIRC it was a mitigation measure by Akamai, perhaps to prevent new bots from joining the attack.

From the post:

I asked Akamai to redirect my site to 127.0.0.1 — effectively relegating all traffic destined for KrebsOnSecurity.com into a giant black hole.

Since Akamai was going to drop the "shields" on the site, instead of smashing the hosting provider with the attack, DNS was pointed at localhost.

You still have the "old" (1 day old) DNS records. Try to flush your DNS cache.

He mentions:

"There is every indication that this attack was launched with the help of a botnet that has enslaved a large number of hacked so-called “Internet of Things,” (IoT) devices — mainly routers, IP cameras and digital video recorders (DVRs) that are exposed to the Internet and protected with weak or hard-coded passwords."

How was the source being compromised IoT ascertained? The only way I could imagine being able to determine that is by looking at the vendor bits on the MAC addresses of the source. But being that IoT devices are generally on a LAN on with some RFC 1918 address you wouldn't have that information. You wouldn't even have the MAC address of the default gateway that routed it.

Can anyone comment on this?

Are DDoS attacks really a problem for journalists getting out information to the public, or are they more so just a problem for journalists who want to distribute content via their own website? Wanting to run a website is reasonable, as it enables journalists to make money on ads as well, but does the inability to run your own website truly hamper free speech?

This seems more like an architecture problem to me, not with regards to the Internet, but with regards to how articles are distributed: by contacting a server who responds with the article. If I really wanted to get some information out, I would upload it to: Google Drive, Dropbox, Amazon S3 and any other free/cheap hosting service I know, and spread the links out on Twitter, Facebook, HN, Reddit, etc. Would it really be possible for any attacker to take down all these services, thus preventing the information from getting out? Or is this more about distributing articles via a web app?

To be protected against DDoS it sounds like you need to be hosted by Google, CloudFlare, or Akamai. Yet these companies are so influential and critical to the Internet that journalists need to feel that they are free to criticize them.

AFAIK Google Drive, Dropbox, Amazon S3 etc. will drop you in a second with a "we're not getting paid enough to deal with this" error message if you bring a DDoS down on them.

This is such an important point. And it is exactly why, when we launched Project Galileo, CloudFlare's initiative to protect politically or artistically important work online, we decided it was critical that CloudFlare wasn't the one deciding what was "politically or artistically important." Instead we rely on the input of civil society organizations like the EFF, CDT, ACLU, Access, etc. If one of the partner organizations says something meets the criteria then we have committed to protecting it, for free and no questions asked.

https://www.cloudflare.com/galileo/

We offered to protect Brian's site under Galileo for free. Had he taken us up on our offer, which remains open, I would hope he would continue to be as critical of CloudFlare as he always has been.

And I hope we've established some credibility in not abusing the position of trust we occupy. For instance, when we protected Spamhaus from a large DDoS attack years ago we specifically made it clear we'd never ask them to treat us any differently than any other organization they monitor. And we haven't. And, to this day, Spamhaus remains one of our biggest critics. And they remain a CloudFlare customer.

Here's a talk I gave last year at Blackhat about the risks of ideas being suppressed on an Internet that is increasingly controlled by a small handful of providers:

https://youtu.be/V-Pj0lrr168

It's something we worry about all the time and I'm glad more people are beginning to discuss the risks it poses.

Does Project Galileo cover political expression you consider problematic though? It's easy to support free speech with which you agree. The real test is whether you support it when it's reprehensible

Yes. There are lots of things that I personally believe are incredibly abhorrent that use our network. I'm not proud of them, but I am proud that we don't censor them.

It seems to me that a vast majority of the for-profit DDoS attack sites (https://www.google.com/#q=ddos+booter) use Cloudflare to protect the component of their operations that take the payments to attack people like Brian Krebs, including the one he wrote about that triggered this entire thing (http://krebsonsecurity.com/tag/cloudflare/).

Forget "state sponsored actors", people executing these attacks are just as likely teenagers with a spare $20 that can use these DDoS attack services to execute a serious DDoS attack in minutes, just for the hell of it.

The point Brian is trying to make in this article is that DDoS attackers have become the true censors of the web. By protecting their ability to profit from DDoS attacks, are you protecting their "free speech rights", or are you instead protecting the real censors of consequence here?

I know you take action on malware and phishing attacks being propagated from your service. A lot of us out here in the NOC world struggling to keep the internet running (and now starting to fail at it) would really appreciate it if you added "DDoS attack sites" to that list.

Yes, you can see Brian's critique of us here:

https://www.youtube.com/watch?v=wW5vJyI_HcU

Skip to minute 19:35. Then skip to the Q&A at minute 45:00 to hear my response.

I'm glad to hear about your concern about "the risks of ideas being suppressed on an Internet that is increasingly controlled by a small handful of providers". I share the same concerns. But I think we differ on the best way to improve this problem.

Your approach is to try to avoid taking down any content proxied behind a single consolidated service, which is controlled by a single organization and is managed under ASNs and IP addresses assigned to you and under your control.

The approach I prefer is to try to improve the problem by decentralizing control of autonomous systems - putting more ASNs, IP blocks and SSL terminators into the hands of independent operators, which makes it harder for governments to single out organizations for things like, for example, mass scale wiretapping via FISA court orders. ASNs are also previously where legal precedent generally accepted that autonomous service providers exist for purposes of handling legal issues, and are the spot where one's strong control over their "Terms of Service" generally begins (though the IP transit provider will usually set a few anti-network-abuse policies (https://he.net/tos.html), including DDoS related ones, realizing that protecting speech has to be balanced with maintaining the health of the internet).

The point I want to make is that the problem with adding "DDoS-for-hire" sites to your list of protected speech is that it directly harms the latter approach of improving decentralization and diversity of ownership in a way that no other service that has existed has ever done before. By making it so that those independent groups require an enormous amount of routing equipment and bandwidth in order to run their own services without risk of DDoS attacks, or being forced to hide their autonomous systems behind another autonomous system (like yours), I strongly believe that not only is your organization directly contributing to the consolidation problem on the net, but that your organization, by enabling these attackers, may even be the leading cause of it.

I have no problem with your anti-censorship policy. I don't think anyone in here does. I would even defend your right to proxy a terrorist web site. But even IP transit providers make exceptions related to DDoS for the health of the internet itself. If it comes down to a choice between protecting DDoS-for-hire sites and protecting the internet itself, which one is the right choice?

The particulars matter, but I don't think you are under any ethical obligation to host 'incredibly abhorrent' content.

While I realize that having an expansive policy regarding acceptable content is laudible what is the argument for being expansive enough to include 'incredibly abhorrent' content?

Is that the 'real test'? I think this is an example where the use of the term 'free speech' confuses the discussion.

Free speech can mean 'limited interference by government' (i.e. U.S. First Amendment rationale) and then there is another meaning, 'hands-off editorial policy'.

The two things are related but are not at all the same and I often see the rationale for one being applied to the other. In this case you are suggesting that a non-governmental actor should have a hands-off editorial policy with regard to 'reprehensible content'. To me this is an attempt to apply a 1st Amendment rationale to a private actor, and it doesn't make sense.

I have no problem at all with private entities crafting their own editorial/business policies such that they don't facilitate or participate in enabling 'reprehensible' content/activities. Down thread someone asked if 'openly racist white supremacist content' would be hosted. I hope not and I would not think less of a hosting company that refused to host that content.

It is a mistake to insist that private entities must engage in the same hands-off behavior regarding content and free-speech that we rightly expect of the government.

When your views are very radical or nonconformist, conservative policies would choose to reject it. Why would a company risk reputation loss for no real gain?

But this argument is the very cause of censorship. If there's a policy of non editorial interference, the problem won't occur, and the conservative company have an argument to fall back on: "it's our policy not to hinder free speech".

The decentralized nature of the web is critical to it's power for free speech. The whole point is that you shouldn't have to be dependent on a handful of media giants in order to publish.

I'm not saying free speech isn't important, I'm only saying that perhaps it's not reasonable to expect that distributing information, that is highly damaging to certain parties, can be done free of charge.

The web exponentially decreases the cost of distributing information, but can we reasonably expect it to be zero, always, for any type of information?

Historically, free speech has meant that you can say whatever you want without fear of violence. It has never been synonymous with the right to have your opinions made available to everyone, free of charge.

I think free speech is immensely important, which is why I think it we shouldn't confuse it with the ability to cheaply serve damaging information from a website with 100% uptime.

This is really where I think p2p things like torrents can be a big help. There are obvious drawbacks such as verifying your getting the original version, for example. But if we give up the idea that the creator's website should be the gateway to that information, we have the methods to work around ddos attacks.

A torrent with one million public keys of the most prominent journalists wouldn't be big (32 MB if we use Ed25519), and would allow them to host their content from torrents with few seeders, without fear of being over-crowded by malicious nodes with wrong data. Of course, we'd have to make sure that this particular public key-torrent is not taken over either, but it's a lot easier to secure a single torrent than to secure the torrents containing all articles of all journalists.

krebsonsecurity.com basically works as Brian Krebs' public key: any information you get from that domain via HTTPS is considered signed by Brian Krebs. But it constitutes a fairly crude PKI system, where the public key is tied to a domain that simultaneously has the job of distributing the signed information. The solution requires a separation of public key and information distribution: information must not be tied to a location, and the location of the public key should differ from that of the signed information.

All in all, I would say that (D)DoS is a problem of the transport protocol, not of the internet. Distributing information of high negative value to certain parties requires a different protocol than serving cat pictures does, which is why the BitTorrent protocol appeared in the first place: to counter the takedown of information (copyrighted content) whose publication is deemed of negative value to certain parties (copyright holders).

Democracy isn't separate groups of individuals having —here— total power to take a website, datacentre, even CDN offline. What's actually happened is the consumerisation of weapons of mass destruction.

Glamourising stuff like this isn't useful. Everybody involved is doing something wrong. We should be doing more at network level to remove botnets by removing (reporting then blocking) infected computers and servers. Continuing to ignore them isn't working.

BCP38 is designed to filter such spoofed traffic, so that it never even traverses the network of an ISP that’s adopted the anti-spoofing measures. However, there are non-trivial economic reasons that many ISPs fail to adopt this best practice.

So, it costs too much to run clean internet pipes.

As the internet is a major part of the economy, as well as access to government (as well as government access to surveillance), it's probably time to regulate ISPs and related players for healthy operation, like water utilities.

No No No. There are probably ~100K of ISPs, many of them in judicially-weak countries. This will never work. ISPs are not the problem. Its fundamental oversight in routing architecture of internet.

BCP38 is Best Current Practice. Not a protocol requirement. Once it becomes a requirement this will be solved in a week.

The 5 RIRs[1] are the non-profit organizations that allocates IPs and regulates ASNs. I dont know how but we (or the big internet boys) should petition them to force ASNs to fix their routers.

[1]: https://en.wikipedia.org/wiki/Regional_Internet_registry

No No No. There are probably ~100K of ISPs,

Good point. I was thinking in a US-centric way.

Still, I'd like my ISPs in the US to be the internet equivalent of lead-free water.