Hacker News

Top stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. Laya the open source version of Jev(convaiinnovations.com ↗)
    35comments
  2. Human brain is two separate organs, Stanford Medicine-led research finds(stanford.edu ↗)
    147comments
  3. AI-generated posters don’t have to be horrible(john.hartnup.uk ↗)
    301comments
  4. “The Secret Life of Circuits” is here(coredump.cx ↗)
    31comments
  5. Android 17 is the first since 3.x to add new APIs without releasing to the AOSP(grapheneos.social ↗)
    501comments
  6. GPT-6 Astra Solves a WWI German Radio Cipher(prinzai.com ↗)
    104comments
  7. San Francisco Onion Futures Company(onionfutures.com ↗)
    88comments
  8. If math is more than proof, we need to better celebrate the rest of it(terrytao.wordpress.com ↗)
    140comments
  9. Communication by means of modulated Johnson noise(pnas.org ↗)
    12comments
  10. From Stonemasons to Carpenters(thelastsoftwareengineer.substack.com ↗)
    3comments
  11. Black Holes or Black Hole Stars? Astronomers Spar over 'Little Red Dots'(quantamagazine.org ↗)
    discuss
  12. Cloudflare Quick Tunnels(cloudflare.com ↗)
    294comments
  13. How to Write with an LLM(sockpuppet.org ↗)
    353comments
  14. You can run Git on object storage if you re-make packfiles(tigrisdata.com ↗)
    21comments
  15. SDCC – Small Device C Compiler(sourceforge.net ↗)
    20comments
  16. Saving another 100TB of RAM(cloudflare.com ↗)
    86comments
  17. Ray Ozzie and the Optimism of Being Early(reproof.app ↗)
    2comments
  18. Science Is Open Software(jepedersen.dk ↗)
    45comments
  19. How OpenAI Used Its Own LLMs to Design Its Jalapeño Chip(ieee.org ↗)
    105comments
  20. Why building a Rust LSP is hard(rust-glancer.github.io ↗)
    42comments
  21. NASA-IBM Lunar Foundation open-Source Geospatial AI Model(usra.edu ↗)
    5comments
  22. Ctenophores: Wonders of Biology(quantamagazine.org ↗)
    6comments
  23. The first new cat species discovered in 100 years(nationalgeographic.com ↗)
    113comments
  24. OpenJev(openjev.com ↗)
    273comments
  25. Goroutine Leak Profiles(go.dev ↗)
    6comments
  26. Show HN: I wrote a custom assembler for CHIP-8 in C++(github.com/tackx ↗)
    4comments
  27. Show HN: Cactus Needle 3: 8-29MB automation models can match DeepSeek V4 Flash(cactuscompute.com ↗)
    89comments
  28. Photon-Emission-Guided Laser Fault Injection Enables RP2350 Secure Debug(ledger.com ↗)
    76comments
  29. Veronese's Dogs(publicdomainreview.org ↗)
    2comments
  30. Warez: The Infrastructure and Aesthetics of Piracy (2021)(archive.org ↗)
    94comments

YouTube-dl is now part of GitHub/dmca.git

1098 pointsby 5y agogithub.com
315 comments
5y agoHN ↗

if you have the dmca repo on your computer, you can checkout this PR via git fetch upstream pull/8142/head:pr-8142&&git checkout pr-8142

Should work even if they blackhole the pr.

5y agoHN ↗

There’s no need to create that pr-8142 branch, which will otherwise hang around indefinitely which is most commonly not what you want:

  git fetch upstream pull/8142/head
  git checkout FETCH_HEAD
5y agoHN ↗

Isn't it more like the following?:

  git clone https://github.com/github/dmca.git
  git fetch origin pull/8142/head
  git checkout FETCH_HEAD
5y agoHN ↗

I was just modifying the parent comment, which assumes an existing repository.

Since we’re fiddling with things in this way, if you were just trying to get a copy of the contents, this’ll do that about most efficiently:

  git init
  git fetch --depth=1 https://github.com/github/dmca pull/8142/head
  git checkout FETCH_HEAD

(I don’t think you can git-clone an arbitrary ref, only a branch.)

5y agoHN ↗

Maybe this pull request is being censored/shadowbanned right now. Opening the page takes tens of seconds and returns "Unicorn! This page is taking too long to load. Sorry about that. Please try refreshing and contact us if the problem persists.". However, PR #8142 is indeed listed in the list of open PRs at https://github.com/github/dmca/pulls?q=is%3Aopen+is%3Apr .

5y agoHN ↗

I saw the unicorn when using firefox, but when I switched to chromium, the PR opened fine

5y agoHN ↗

This just loaded fine for me in Firefox. I'd give them the benefit of the doubt for this one, after all this PR contains 10k commits and 120 comments, and then quite a lot of approvals.

5y agoHN ↗

Heh, I didn't expect to get much attention for this. I thought it would be funny to push a merge commit between the 2 repo's latest commits. As a result, the git history is accessible from the dmca repo if you know the commit hashes. Since I didn't rebase, all the commit hashes were preserved with signatures. Another fun discovery is that deleting my fork of github/dmca didn't affect the PR like I thought it would, so it seems a mirror of youtube-dl's commits are stuck in the ether until GH deletes my PR and garbage collects the repo.

5y agoHN ↗

This is such a great hack. I approved the PR, naturally.

5y agoHN ↗

Note that a hack is not a fix.

All of you, write to your representatives about that if you care. In EU when they were going to put some similar laws we all organized and wrote massively to the parliament and they backed down. It is a lot of effort but it works.

5y agoHN ↗

And what should we ask for?

There is stuff to complain about with the DMCA, but the core process is reasonable.

Someone claims copyright infringement by a user, and the website takes the content down.

The user claims no copyright infringement, the website restores the content.

The website is immune from liability, the alleged copyright owner can settle things in court with the user if they want to.

5y agoHN ↗

The problem is that there is no penalty for fraudulently issuing claims.

5y agoHN ↗

Other than it being a felony in the US to issue a false claim with a jail time of up to 5 years aye

5y agoHN ↗

You should ask for immunity for tools that could potentially be used to infringe copyright, but that are not actually infringing copyright.

If guns don't kill people, people kill people, then certainly congress can accept that software doesn't pirate copyrighted works, people pirate copyrighted works.

5y agoHN ↗

I get the analogy, but guns are typically purposed for lethality.

Software is not typically purposed for piracy.

Maybe "trying to hit someone with your car"? Not sure.

5y agoHN ↗

It's a perfect analogy because it is so extreme. The powers that be have already accepted that way of thinking (because guns are not illegal) and it's therefore even less of a stretch to apply the same concept to software tools.

5y agoHN ↗

Actually I found the statement "guns don't kill people, people kill people" very oxymoronic.

Sure one might argue that if you have the intent to kill, it's not necessary for one to use a gun, you have alternatives such as grenades, knives, chainsaw or even your bare hand if it's lethal enough. This is how you derive that "the gun is not evil, it's the people who are" statement.

But guns, under the category of firearms (not only guns, what about rocker launchers?), are almost-certainly designated to kill, and what is the top priority of firearm? Aim to be the most efficient killing machine.

So if you use a gun, it's not necessary that you are going to kill people, but it is very likely that you are imposing a threat to do so, regardless of if you're attacking/defending.

Therefore, trying to apply the gun analogy to current state of youtube-dl is an injustice to youtube-dl, as you compared an intrinsically evil entity to another.

5y agoHN ↗

There is nothing intrinsically evil about a gun. You might as well say that a knife, pen or any other inanimate object is intrinsically evil. Also, there is nothing intrinsically evil about defending yourself.

5y agoHN ↗

Oh, but in most cases there is something intrinsically evil about killing to defend yourself.

Like whenever you're not facing a murderous psychopath.

It's a tragedy when two people who have a gun feel the need to kill the other, over nothing more than the fear that the other might have and use one too. Even if one was breaking into the house of the other.

If you're a healthy human being you don't want to kill the intruder, you want to be safe. Neither does the intruder want to kill you, they want to get away with your stuff.

Two people not wanting to kill, being forced to kill simply by the presence, or even just the possible presence of a gun.

If you can't see the intrinsic evil in that, then I guess you must really think lightly about killing people.

5y agoHN ↗

You missed the relevant part of the DMCA for this takedown, which makes bypassing "anti-circumvention' measures a crime. That section has caused nothing but problems.

5y agoHN ↗

There is stuff to complain about with the DMCA, but the core process is reasonable.

it absolutely is not in any way reasonable.

you must take down the content without question and then, after filing a counter-notice wait 10-14 days minimum before it can be restored [1]:

"After a counter notice has been received, a service provider must wait 10-14 days before they can reactivate the claimed infringing content."

frivolous complaints can completely cripple a business with little risk to the supposed claimant.

https://odinlaw.com/what-is-a-dmca-counter-notice/

5y agoHN ↗

That is, to be fair, an aspect that could be improved on.

However, how do you do this?

For example, perhaps a large-business exemption where they are required to follow through with legal proceedings if a claimant files a counter-notice (so they can't do the whole claim, counter-claim filed, they don't follow up, like with PopcornTime, usually because the DMCA was bogus).

But then this encourages further litigation, so it discourages people taking the risk to file a counter-claim. But unless they follow through with legal action, nobody can assess if the initial notice was "fraudulent". It's a real thorny problem.

5y agoHN ↗

There are many possible solutions, e.g.

- A company that files a fraudulent request loses DMCA rights (that way, it doesn't have to be proven repeatedly, just once)

- Liability for false takedowns w/ punitive damages, criminal liability with actual enforcement for malicious attempts or even negligence. Potentially a deposit requirement once a false claim has been made.

5y agoHN ↗

Those are good ideas, but the first one should have been:

- Nothing at all happens until a unbiased court issues an injunction.

In other words, the process that was in place before the DMCA was passed.

5y agoHN ↗

For one, you could ask for due process, or the right to defend yourself before the takedown is executed.

Right now, DMCA is an accusation AND a sentence bundled into one. There's no review of its validity, you're instant guilt unless proven wealthy.

5y agoHN ↗

But what part of it is copyrighted? URL? It does not contain copyrighted text, audio, video.

Information is on the plain sight, it is like banning base64. Any general purpose computing should be taken down as well. Browsers has DRM, as I know youtube-dl can't download Netflix, Youtube Premium etc.

5y agoHN ↗

For one I’d like there to be some punishment for repeated abuse of DMCA. GitHub policies state that repeat offenders can get their accounts suspended/deleted. Why can’t repeat offenders (RIAA) get banned from the system at least? Some increasing back off after a rejected claim was posted? Anything that would make it un-economical to just spam the system with notices wherever you like it because there is no downside to it.

5y agoHN ↗

I wonder if anyone has written something to find and independently assess the validity of these bulk false DMCA take downs.

Honestly, I'm guessing a ambitious law firm could actually make a good class action suit against these offenders.

Seems like broad, real damages could be justifiably demonstrated.

5y agoHN ↗

If only we could retool SCO for a force-for-good?

Weren't there environmental laws that a private party could sue an offender over and would get a portion of the federal fines?

Seems like a free-market solution that the right would get behind. :)

5y agoHN ↗

Reform copyright. It was based on the assumption that taxing copy production is a reasonnable way to fund creation. It was an incredibly good system in the days of the press where making copies requires heavy capital investment.

It is hilariously wrong nowadays when everybody own a copy-making machine in each pocket.

5y agoHN ↗

It was an incredibly good system in the days of the press where making copies requires heavy capital investment.

It was never a good system, but it was certainly less obviously broken and destructive to society then than it is today.

5y agoHN ↗

Fuck no, they didn't back down. Hundreds of thousands marched across Germany, in Munich where a friend of mine organized it was one of the largest rallies in recent histories - and all for vain, we got the upload filter crap regardless of all the promises.

5y agoHN ↗

What? Pretty much every EU member ratified the same WIPO treaties and so have almost identical laws to the DMCA.

5y agoHN ↗

I don't understand what's going on here. Can you explain?

5y agoHN ↗

I might not be able to explain well, but from what I understand about how github works, when you fork someone else's repo, github only stores 1 tree but you have your own set of tags / branches. This led to an issue that was probably fixed where if you set a repo to private, anyone who had a clone could guess commit hashes from their fork's remote. Another interesting thing about git is that you can have 2 root commits (the Linux kernel has 4 root commits iirc).

Because of these 2 "features", when I clone dmca and run `git pull some_ytdl_git_mirror master --allow-unrelated-histories`, I end up with a giant source tree that consists of both repos joined by a merge commit. Because no rebasing happened, no history was changed and it can be pushed without force permissions. Now that all the youtube-dl commits are in the same tree as the dmca repo, you can access them regardless of what fork you've cloned via `git fetch origin <hash>`.

I hope that makes sense?

5y agoHN ↗

It is a security issue if the presence of a commit or tree in a repo is supposed to be enough to get GitHub to nuke the repo, as this then allows malicious users to convince GitHub to nuke any repo they like, but GitHub can instead deal with this more sensibly and not make it a security issue.

5y agoHN ↗

Seems to me like you could ddos a repo this way, though I guess that would be true of any pr spamming?

5y agoHN ↗

It could indeed be a security issue. A few options:

- Make a PR to a project that changes e.g. one of the dependencies to typosquatted alternatives. Disguise the commit message as something trivial. Post it to HN with a GH link to the upstream project's repo at your commit.

- Make a PR to a project that adds malicious code, suggest a change to a distro package's source repo to use your commit. Unless the maintainers know about this GitHub behavior, that'll look much more trivial than it actually is.

5y agoHN ↗

Nice comment. I'm sipping coffee and much to my shame i thought this was going to be some meta joke about screwing with some sort of master list of DMCA'd repos on Github or something. Sipping coffee, reading comments, chillin.. then read yours, and almost spit it out at how much funnier this is than i thought it was.

I re-opened the link and actually used my eyeballs, and yup.. it's the damn Youtube-dl library on the /dmca repo, bahaha. I almost whooshed the joke entirely, so thanks :)

5y agoHN ↗

Another fun discovery is that deleting my fork of github/dmca didn't affect the PR like I thought it would

Making the pr will put the branch in the target repo under pull/<number>/head

the commit will forever be referenced

5y agoHN ↗

If you have a clone of the dmca repo, run:

    git config --add remote.origin.fetch 'refs/pull/*:refs/remotes/pull/*'
    git fetch origin

You'll now have all of the PR refs in "remote" `pull/<number>/head` branches.

    git log pull/8142/head
    git log 416da574e
5y agoHN ↗

Just curious, why is this possible with an unmerged PR? Just a weird setup on GitHub's end?

5y agoHN ↗

It's due to how git works. In order for git tools to compare and otherwise work with two commits, both commits need to be in the same repo.

If "forking" a repo on github really cloned it in their infrastructure, they'd require far more data. So all forks of a github repo point to the same repo, only with different branches.

Note that git clone only clones the actually present branches of the upstream you point it to, but on the backend, all branches of all forks are present.

5y agoHN ↗

This isn’t simply because of how Git works. You can configure Git to look in multiple places for repo objects. For whatever reason, the GitHub devs either didn’t know this, or they didn’t want to implement their forking and pull request systems this way.

As someone else mentioned, this may be an intentional design to make it simpler to implement pulling down remote PRs from the destination repo.

5y agoHN ↗

You can configure Git to look in multiple places for repo objects.

What do you mean by multiple places for repo objects? Do you mean multiple remotes? The remotes are fully inside your local database if you run commands like git pull or git remote update, they are just not in your checkout. Commands like git show <commit hash> work on commit hashes in those remotes as well, even if it's not in one of your local branches.

Or do you mean configuring git to use multiple .git/objects directories? I haven't heard of that feature, can you give a link?

5y agoHN ↗

The feature’s called alternates. You can use it on-the-fly without modifying any repos by using the GIT_ALTERNATE_OBJECT_DIRECTORIES environment variable.

If you want the effect permanently, there’s the .git/objects/info/alternates file. For HTTP remotes, there’s apparently a .git/objects/info/http-alternates file as well (no idea how that works though). I’m assuming these files allow multiple alternates as the environment variable does.

5y agoHN ↗

I'm pretty sure GitHub does use alternates in the same way that that GitLab does:

https://docs.gitlab.com/ee/development/git_object_deduplicat...

I vaguely recall seeing @peff comment about this on HN years ago but I can't find that comment now. Here's a GitLab employee claiming GitHub uses alternates:

https://news.ycombinator.com/item?id=22179208

The thing is, that both the dmca repo and its forks must have alternates files to the same underlying common repo, otherwise the PR ref in the dmca repo wouldn't be able to see the merge commit pushed to the fork. Pushing the merge must have duplicated all the youtube-dl commits into the common repo used by both the dmca repo and its forks because youtube-dl and dmca would have different common repos.

5y agoHN ↗

There's a lot of reasons it's possible, but the one that sticks out is that the repo owner needs to be able to modify the commit before the PR is merged. AFAIK, the way that's done is by incorporating the remote repo's commit history into the destination repo underneath a pr-specific branch, which naturally brings all of the commits themselves into the repo's git database.

5y agoHN ↗

Follow up question, are these commits or pr-specific branch accessible in target repo's `git` (not GitHub)?

5y agoHN ↗

Yes.

You can get it with: git fetch <remote> refs/pull/<pr>/head

My git config has the alias:

  pr = !f() { git fetch $1 refs/pull/$2/head:pr/$1/$2; } ; f

which will create a local branch corresponding to the provide PR. This is useful for evaluating large PRs that would be difficult to fully evaluate with just the online UI.

5y agoHN ↗

I think it's because GitHub wants to allow repo maintainers to merge in PRs without them having to add separate remotes themselves, ie `git remote add` isn't required to `git merge`.

This basically means that any content can be injected into anyone's GH repo (since PRs can't be turned off), but really only in terms of being able to view it on the GitHub website. To give an example, pull 437 on torvalds/linux[0] hasn't been merged in, but if you go to the commit hash in the browser, suddenly main/init.c has the relevant changes and commit that condense the file into one line[1].

This very well could be abused - imagine framing (or just 'canceling') someone with [insert illegal content here] by PRing their repo with a commit with a forged author[2] then linking people to their repo with the commit tree showing the illegal content.

0: https://github.com/torvalds/linux/pull/437

1: https://github.com/torvalds/linux/blob/2793ae1df012c7c3f13ea...

2: https://stackoverflow.com/a/60900120/3878893

5y agoHN ↗

yuck, yet another reason to get people to do commit signing - and enforce it by github not attributing unsigned commits.

5y agoHN ↗

Does commit signing really solve this? I believe you can restrict branches to only allow signed commits, but since these commits are not in any branch on that repository it looks like that wouldn't change anything. Correct me if I'm wrong, though.

5y agoHN ↗

That yes, but at least the github/gitlab/... UI could refuse to link unsigned comments to the userpage belonging to the email in the commit.

5y agoHN ↗

It is very useful that commits become part of the target repository as soon as a PR is created. This allows people reviewing the PR to checkout it on their local machines without needed to add the source repository as an additional remote.

5y agoHN ↗

The end result will be GitHub taking down this repo and possibly blocking PRs. Congratulations on making life difficult for other people.

5y agoHN ↗

Congratulations on making life difficult for other people.

Tell that to the RIAA...

It's funny to see the Streisand Effect happen with this one.

5y agoHN ↗

US copyright law has teeth for stuff like this.

If the RIAA goes after the OP for statutory damages, he's basically fucked for life. And they love to make examples of people. Did everybody forget Kazaa and Limewire?

5y agoHN ↗

Not remotely on the same level.

Kazaa and Limewire were moneymaking companies with fairly undefensible behavior from a legal perspective. This is an individual using a website the way it’s supposed to be used, for documentation purposes. A judge would “expeditiously” send the RIAA packing with a large bill for defendant’s legal fees.

5y agoHN ↗

Right, it's not the same level. Kazaa and Limewire faced theoretical liabilities in the billions.

That doesn't mean that the programmers of youtube-dl, or those who choose to engage in spreading the program, can't be held liable for much lower levels of damages which are still financially ruinous for an individual even if they're small on an absolute basis.

I've been on the other side of an RIAA lawsuit, and their lawyers are aggressive. They offer a carrot settlement, but if that settlement is declined they will beat you with a stick and offer no mercy.

5y agoHN ↗

They could call the U.S. attorney and go after the OP with federal felony charges.

5y agoHN ↗

In a 10 second glance at closed PRs, it doesn't seem like they ever merge any from the public.

5y agoHN ↗

I suspect that many would consider this to be a win, although I doubt this will happen.

5y agoHN ↗

If GitHub ever makes it possible for public repos to disable PRs, I think many regular users will be interested :) It's a quite old feature request: https://github.com/dear-github/dear-github/issues/84

It's been somewhat alleviated recently by the "archive" feature, though it would still be nice to have in cases where the repo is still being developed but doesn't want external contributions.

5y agoHN ↗

The people who are responsible for this SHOULD have their lives made as difficult as possible.

5y agoHN ↗

Would closing the PR be enough to remove it, or does it actually have to be deleted? I didn't think PRs could be deleted, only closed.

5y agoHN ↗

I don't think so, if you look at the other closed PRs, you can find some where the owner also deleted their fork like I did. Despite that you can still access the commits they wanted to merge.

5y agoHN ↗

Closing will not be enough. Even deleting the fork that made the PR will not be enough. (The PR remains open and the commit URLs automatically get updated to point to the parent repo, just like the URL that was submitted.)

Users can't delete PRs but GitHub can. They do it for PRs reported as spam, etc.

Regardless, what's needed here is not just deleting the PR (and the fork) but also doing a GC (as Stephen304 said), which too is something only GitHub can do.

5y agoHN ↗

This is hilarious, well done.

I realized something while :+1:-ing your PR: I was thinking about how digg deleted my account over posting the AACS key, I really couldn't care less if Microsoft deleted my account over it.

Very interesting considering that even just 2 years ago I never would have done this for fear of my account being deleted. All of my work and personal projects are moved to gitlab (the CI/Kubernetes/etc integration are just too good to pass up).

I know a sample size of 1 has an effectively 100% error rate, but, I think Microsoft is losing mindshare with GitHub. Stuff like this doesn't help. I could see a small company like GitLab needing to toe the DMCA line, but, Microsoft has the deep pockets and could have built some major community will here by handling this better. Unfortunate that they didn't.

Anyway, fun hack, I wonder how long it will last, or will they merge it? It must be the most approved PR in GitHub history at this point!

5y agoHN ↗

Haha thanks, yeah I do wonder whether my account may be impacted. Best case they just delete the PR and garbage collect the repo. Worst case I get the final push to use gitlab.

5y agoHN ↗

I know a sample size of 1 has an effectively 100% error rate, but, I think Microsoft is losing mindshare with GitHub. Stuff like this doesn't help. I could see a small company like GitLab needing to toe the DMCA line, but, Microsoft has the deep pockets and could have built some major community will here by handling this better. Unfortunate that they didn't.

If MS didn't comply with the DMCA takedown notice, then the RIAA could go to court and get an injunction to force it down. Depending on how spiteful the RIAA and the judge are feeling, the injunction could be worded to take down the entirety of GitHub over a single repository. And the impact of actions like these is to make it more likely that such an expansive injunction is sought or granted.

5y agoHN ↗

RIAA taking down all of GitHub would instantly pit them against all of Microsoft, and make every developer who already hates their guts to pick up the pitchforks and march. They won't try doing it.

5y agoHN ↗

And as much as RIAA is mostly a slimey pit of lawyers, they would stand no chance again msft's goblin hoard of attorneys.

5y agoHN ↗

More attorneys does not convince judges more. The RIAA has some merit, therefore they can preliminary injunction github to remove the repo. If github doesn't comply then they receive sanctions. That's simply how it works.

5y agoHN ↗

The other commenters here have argued pretty convincingly that the RIAA has no merit at all. Microsoft should have done the same reading of the letter and determined that this is a hill they have to fight on, in order to operate Github effectively.

5y agoHN ↗

I doubt they'd fear the PR backlash. They didn't fear it before SOPA, and even when SOPA was defeated, it was largely because the backlash was driven by efforts by sites like Wikipedia, Facebook, and Google advertising counter-SOPA messaging, and that drives far more traffic than sites like GitHub.

5y agoHN ↗

Taking down GitHub would instantly make millions of developers at thousands of companies unable to do their work.

5y agoHN ↗

I am well aware of that. But RIAA likely doesn't care one iota about that damage. The injunction they'd write would be along the lines of:

"It's necessary that the entirety of GitHub be shut down until this case is decided. As noted here, they have persistently failed to adhere to our DMCA take-down notices, and continue to knowingly host content that circumvents our copyright protection schemes. Furthermore, it is not sufficient to just remove this content, because it has been and will be repeatedly readded, and GitHub has taken no action to remove these extra copies. We are likely to succeed on our merits because <blah>. We are irreparably harmed because <blah>."

That doesn't mean they'd necessarily win on a broad injunction, but they can still push for one (see Apple v Epic for a recent example). And stunts like this one make it more likely that a judge might agree that a broad injunction is necessary instead of a narrow one.

5y agoHN ↗

If we cannot shut down criminal banks because they are too big to fail. Then we certainly cannot shut down Github.

5y agoHN ↗

Only for a few days, critically.

GitHub may be the single source of truth, but it’s not the only copy of the data.

5y agoHN ↗

It will take far more than "a few days" to change GitHub-based workflows. Data loss is not the only way to lose productivity.

5y agoHN ↗

Interestingly, my country (Turkey) did ban github (along with google drive, microsoft onedrive etc.) back in 2016. However they reopened it within hours (18 hours to be exact), because systems all over the country were failing. One of the driving reasons was that ATMs stopped working. Appearently they were downloading some updates from github to function.

Stupidity has no limits.

For more info: https://en.m.wikipedia.org/wiki/Censorship_of_GitHub

5y agoHN ↗

Any diligent company that relies on GitHub so heavily will have a service-level agreement in their contract, which will include compensation for a major outage.

Otherwise they're getting GitHub's best effort, which is exactly what they've paid for.

5y agoHN ↗

RIAA taking down all of GitHub would instantly pit them against all of Microsoft

microsoft isn't gonna fight the good fight. There's no reward (to them) for doing so, and there's only a cost. It'd be a stupid business decision.

What is more correct is to lobby legislation changes to copyright. Repeal the DMCA, or change copyright law to such that you cannot abuse it this way. And this lobbying is the civil responsibility of everyone, not just microsoft.

5y agoHN ↗

No company would fight the good fight for the same reasons. This can only be fixed by changing the law. Not to mention find and persecute the parties who were paid directly or indirectly to pass this legislation. RIAA lobbyists (and all other corporate lobbyists) don't lobby in the sense of arguing for something. They use stick and carrot techniques against legsitlators. It's practically raketeering.

5y agoHN ↗

More importantly GitHub could lose the status of safe haven and could be held liable for all repositories.

5y agoHN ↗

What was submitted was not a DMCA notice, Microsoft was not legally obligated to comply with it.

From what I know, DMCA notice requires the identification of claimed copyrighted content and this document does no such thing.

5y agoHN ↗

I think Microsoft is losing mindshare with GitHub.

You're not wrong. Sure, the cloudflare browser checks and antibot pages on gitlab are aggravating, but there are a litany of documented reasons people are walking away from Microsofts latest acquisition. maybe the biggest one is the ICE contract they ardently refused to back out of.

https://en.wikipedia.org/wiki/GitHub#Controversies

Its also pretty obvious MS doesnt check any of these DMCA claims, and just rubber stamps the commits with an insulting and sterile "Process DMCA request" commit msg.

gitea and github both host splendidly inside kubernetes or standalone.

5y agoHN ↗

Well I've been guessing that github was going to get killed off and rolled into of azure devops at some point.

As for the ICE contract, do you have any idea how much money the U.S. government pays to microsoft, of course they aren't going to back out of a contract. if they did, you can bet an emergency board meeting would be held, and who ever made that call would be axed and the contract reinstated, the JEDI cloud storage contract alone is worth $1 billion a year. not to mentions the 25+ million plus OS lisc. and office 365 contracts, and the GCC contracts.

It's very possible that microsoft as a corporation doesn't even deal with github DMCA until they become a PR issue like this one. Github processed DMCA noticed before they were acquired, and their staff likely still is. Not like that is a hot button issues to convert and integrate in the grand scheme of things.

Just food for thought.

5y agoHN ↗

I think you are right, except your first sentence. Azure DevOps will be the one which will be reoriented to GitHub, not the other way around.

Azure Repos and Pipelines are basically duplication in GitHub world. But Azure DevOps issue tracker is superior to GitHubs (or GitLabs but not Jira).

5y agoHN ↗

Actually I suppose Skype over lynx is a good example counter to my own point, who knows?

Naming a brand after a concept is an asshole thing to do, sure it puts your product in the search results for anyone googling devops, but it makes looking for anything related to the product painful, so I'm all for another name change.

5y agoHN ↗

Fair. But Skype rendered itself irrelevant in the years because of this BS ;)

But I agree. Never underestimate politics vs. reality. Oh 2020.

5y agoHN ↗

gitea and github both host splendidly

Do you mean GitLab?

5y agoHN ↗

Microsoft is losing the good will they've worked so hard to rebuild.

Microsoft employees, managers, Satya: do you see what you're doing? I love the direction you've taken over the past five years, but bowing to the RIAA and attempting to disrupt an innocuous tool are horrible decisions. It's a chilling note, and everyone involved in tech can hear it.

Are you telling us Github is not a safe place to develop software anymore? Because I'll believe it and go elsewhere.

Siding with the RIAA and bringing engineers' Github accounts into compliance will tell us who your real customers and allies are.

Don't side with regressive legal trolls that bring zero benefit to the world.

5y agoHN ↗

IANAL, but as far as I recall, a site receiving a DMCA notice must immediately remove the stated content. The person who put the content up may then file a counter-notice, which, if uncontested may then be followed by reinstating the content. If contested, the process moves into the courtroom.

5y agoHN ↗

Correct. A company cannot not comply with a dmca takedown. When the law was written, the supposed safeguard against copyright holders filing tons of frivolous claims is that a counter claim can be pretty serious. Of course history has shown that this didn't work out as planned.

5y agoHN ↗

A company is under no obligation to comply with an invalid notice. Wikipedia ignores invalid DMCA requests all the time.

It is risky though, as the company opens itself up to a lot of liability if its wrong.

5y agoHN ↗

wikipedia has the advantage that they can deploy a banner informing people about stuff in an instant. From some googling, back in 2015 Wikipedia had half a billion monthly users - that is massive reachout capability.

Anyone daring to put up a fight with Wikipedia risks being flattened by outrage.

5y agoHN ↗

What was sent was not a DMCA notice in the standard sense; I encourage you to read it. It’s designed to look like one, but lacks critical elements (such as identifying an infringing URL).

The infringement described in their notice is hypothetical, not an actual instance of infringement, which is one of the required things in a DMCA notice.

GitHub can indeed leave the repo up, as this notice is insufficient to trigger the part of the DMCA that forces them to remove it.

More info from Parker Higgins in a tweet thread:

https://twitter.com/xor/status/1319755776043384838

5y agoHN ↗

That's pretty much it though.

In all honesty, we need a GH alternative hosted outside the US, in any place where absurd laws like DMCA don't exist.

5y agoHN ↗

What we really need is a decentralised git forge using something like ActivityPub. We cannot keep relying on companies to host open content for us.

5y agoHN ↗

ActivityPub is federated like git is distributed. You can add several remotes from different servers (or peers in case of single user instances hosted at home)

Even though other sites like GitLab exist that GitHub remains a near-monopoly default doesn't bode well for attempting to migrate to a completely decentralized system as default. There are decentralized extensions of git (like git-ssb).

Addenda: Git is also not well suited for a lot of decentralization due to how branches are modeled. Patch-theory based systems like darcs and pijul would need more adoption before code repositories could be decentralized.

5y agoHN ↗

I understand that but there is a difference between just git and the forge, which is GitHub in this case. If I fork a project on GitHub it has a fork relationship on the platform itself. This makes it very easy to interact with the original project. However, without an actual GitHub account I can't contribute back to the project at all.

If I have for example my own Gitlab server I have the ability to clone a project from GitHub and maintain my fork on my server. However, to contribute back, I will still need to bring my changes back to GitHub first.

What a federated implementation of such a "git hosting/collaboration platform" would allow me to do would be to fork a project from another instance to my self-hosted instance. It would benefit every open-source project that would be willing to host their own instance. I could then easily contribute back into the main project without needing an account on their instance.

It would also make it much harder to take down a project with a DMCA like this because forks of it would exist across instances, meaning claims would have to be sent to each maintainer of these instances. In this case, they were simply able to list all of the forks on GitHub and because GitHub is one website, all of them were taken down, seemingly without any further inspection wether the claim covers these forks as well.

I realise that this is difficult to implement but I think mastodon is a great example of how such federation can work in practice.

5y agoHN ↗

This is not a DMCA notice; A DMCA notice requires the identification of claimed copyrighted content and this document does no such thing.

The document claims that youtube-dl is illegal for being able to download video and audio from YouTube but not for hosting copyrighted material in the repo or binary distributions. The RIAA is claiming youtube-dl is "circumventing DRM".

5y agoHN ↗

They do actually mention 3 specific copyrighted songs used as examples in the tests. Seems to me that was on oversight, and they should have only used open videos as tests in the repo. Similar to how Kodi can't use copyrighted material in app store screenshots or videos.

5y agoHN ↗

The tests are testing that youtube-dl can successfully see through three specific varieties of obfuscation as used by those videos. Testing open videos would not work, since Google doesn't obfuscate those in the same way. Uploading special videos with the right configuration wouldn't work, those particular obfuscation methods are only available to specific YouTube partners, not to the youtube-dl authors.

5y agoHN ↗

So why can't we crowdsource some Youtube partners that are willing to allow their copyright to be used, while still utilizing the obfuscation?

Or are we talking a sweetheart deal only available to specific parnters ?coughvevocough

5y agoHN ↗

No, youtube-dl is illegal for including code to decrypt youtube video request signatures, which are scrambled specifically on most music videos, which a german court ruled is an effective technological protection measure.

5y agoHN ↗

llegal for including code to decrypt youtube video request signatures

No it's not, in Switzerland for example it's legal to use tools to remove stuff like DRM, if you DONT redistribute the decrypted stuff.

What a German Court says is often not relevant outside germany.

5y agoHN ↗

It is.

The DMCA makes circumventing "effective" protection measures illegal. "Effective" is a term defined in law and basically means any hoop you have to jump through to get to copyrighted material, no matter how flawed or trivially bypassed. The restrictions in place to allow YouTube videos to be only downloaded through YouTube count.

Youtube-dl is absolutely illegal software.

5y agoHN ↗

Youtube-dl is absolutely illegal software.

Not in Italy

What US law says is often irrelevant outside of the US of A

5y agoHN ↗

You're getting down-voted because people don't agree with you, not because you're fundamentally wrong.

All the responses "not illegal in COUNTRY X"; how is this relevant? Is the RIAA using a law from <UTOPIA_COUNTRY> on a company based in <FANTASY_LAND>?

You can absolutely host this repo with a country & business that doesn't recognize or cooperate with US laws. Your choice is somewhat limited.

5y agoHN ↗

Regardless, not honoring a DMCA would mean GitHub is asserting that they think it's false and would need to defend their decision if RIAA were to sue them; it doesn't make sense to verify every single DMCA claim and increase liability by not honoring some.

5y agoHN ↗

THis is likely a consideration. From my decidely non-lawyer viewpoint the RIAA is using a terrible law, but still a law and they have grounds under this law for their claims. GH and MS have deep pockets and if they tried to initially fight this I'm confident they would settle. If you're the RIAA who would you rather go after - someone who will pay after a little bit of fighting, or a huge group who will immediately roll over but have nothing to give you?

5y agoHN ↗

DMCA covers "circumvention devices".

5y agoHN ↗

But the DMCA notice mechanism does not.

5y agoHN ↗

False in this case.

The 17 USC (2)(c)(1)(C) safe-harbour protections apply only to hosting of infringing works, and neither youtube-dl nor its test suites infringe on any RIAA or member copyrights as averred in RIAA's notice.

https://www.law.cornell.edu/uscode/text/17/512

The RIAA's letter does not claim infringement within the text of youtube-dl source or test suites, though it tries hard to appear so, but rather anti-circumvention of a "copyright protection mechanism", under §1201. That is also part of the DMCA, but falls outside the safe-harbour.

At best, youtube-dl's test suite may be infringing works when run, in which case infringement would accrue to the operator, presumably a tester or Github's CI/CD process. Even that argument is specious.

Given output is discarded, no permanent copy is retained, and the action is for research and development, and numerous Fair Use affirmative defence claims exist under §107, notably (1) and (4), test suite execution falls outside exclusive rights. Any one fair-use test is sufficient, or none at all. Test suite execution could be argued non-infinging under numerous theories, including reverse engineering, research, interoperability, all under §1201, or under general limitations on exclusive rights in §112, §117, or elsewhere.

This is where ... things get interesting....

- The "copyright protection scheme" in question, if it even is one, was written by and is provided by Google/Youtube, not the RIAA.

- It is not even clear to me the RIAA has standing to sue under §1203: "Any person injured by a violation of section 1201 or 1202 may bring a civil action in an appropriate United States district court for such violation." RIAA are not injured due to utilisation of a non-member's mechanism.

- Does not pass the 17 USC 1201 (a)(2)(B) test: "has only limited commercially significant purpose or use other than to circumvent a technological measure that effectively controls access to a work protected under this title".

- Yes, Microsoft / Github may have liability under 17 USC 1201 (a)(2), "offer to the public, provide, or otherwise traffic" the code, subject to the same test above. However there is no safe-harbour provision for such violations.

- Microsoft (owner of Github) is listed on the RIAA's members page. Neither Google LLC, its Youtube subsidiary, nor parent Alphabet Inc. are. The RIAA are threatening a member for a §1201 violation against a nonmember. That's ... weird. https://www.riaa.com/about-riaa/riaa-members/

- There's an exception in §1201(f)(2) "a person may develop and employ technological means to circumvent a technological measure, or to circumvent protection afforded by a technological measure, in order to enable the identification and analysis under paragraph (1), or for the purpose of enabling interoperability of an independently created computer program with other programs".

- Youtube-dl is executing code as a World Wide Web user agent, provided by Google/YouTube, and meant to be accessed and run by user agents in order to access YouTube content. That is, youtube-dl's operation is entirely within YouTube's technical design and intent.

- Any potential copyright infringement which might occur through use of youtube-dl is at the volition of users, not the software's authors, actions would properly be directed at such users for individual acts of infringement, and much of this is subject to the same and other defences listed above.

The remaining question is whether or not this claim should be contested. I argue that it should, on numerous grounds;

1. Though the claim is made under US law, similar anti-circ provisions exist in international law, which is highly standardised in large part thanks to the RIAA, MPAA (video), SIIA (software), WIPO, and other copyright monopoly cartels' special-interest deep-pockets lobbying. Offshore legal safe havens are limited and vulnerable. Defence within DMCA /anti-circ / WIPO / Berne regions is unfortunately necessary. Simply hosting the repository outside US jurisdiction is not sufficient, though a valid immediate response.

2. Such claims are specious at best, carry heavy chilling efects, may be entirely fraudulent, and should carry considerable risk. A countersuit agaist RIAA may help make this cartel, or others, think twice about repeating such attempts, as well as establish precedent agaist future such attemps.

3. The future of software, to which Microsoft claims to have harnessed its own wagon, is open, collaborative, Free Software. As such, the software and information services industry's interests diverge from those of regressive copyright maximalists.

TL;DR: This is not a 17 USC 512 infringement/safe-harbour, RIAA's standing is highly questionable, it is threatening a member for an averred nonmember's §1201 injury, any actual works duplication is not performed by youtube-dl's developers directly, nor is the work itself or its test suite an infringement of RIAA / members copyrights, and numerous defences exist for routine use or incidental transmission or copies made by others. Further, youtube-dl, digital and information liberties groups, Microsoft, and Google/Youtube should fight the RIAA's claim.

5y agoHN ↗

Haha! This is absurd:

Microsoft (owner of Github) is listed on the RIAA's members page. Neither Google LLC, its Youtube subsidiary, nor parent Alphabet Inc. are. The RIAA are threatening a member for a §1201 violation against a nonmember. That's ... weird. https://www.riaa.com/about-riaa/riaa-members/

5y agoHN ↗

That ... was an interesting realisation.

5y agoHN ↗

Youtube-dl is executing code as a World Wide Web user agent, provided by Google/YouTube [...]

I'm guessing that's a typo, and this was actually meant to say the following?

Youtube-dl is executing code as a World Wide Web user agent, accessing a service provided by Google/YouTube [...]

5y agoHN ↗

No, the code is provided for the purpose enabled by ytdl.

I'll try to clarify that elsewhere:

Youtube-dl is executing code provided by Google/YouTube, for Wold Wide Web user agents, as a World Wide Web user agent, and meant to be accessed _and run_ by user agents in order to access YouTube content. That is, youtube-dl's operation is entirely within YouTube's technical design and intent.

5y agoHN ↗

The law says “expeditiously”, not immediately. This gives a degree of flexibility to judge the basic elements of the claim, which they clearly did not do here (as others have pointed out, this does not look like a valid request).

5y agoHN ↗

notice must immediately

No, at most-- they lose a safe harbour if the notice was well formed and properly delivered, and they don't follow the procedure.

But the vast majority of notices are not well formed or properly delivered.

And loss of the safe harbour isn't particularly important if the complaint is bogus to begin with.

Sure, it does mean a slightly increased risk of legal costs-- though anyone can sue github at any time regardless-- but ultimately those sorts of risks are business decisions that have to be weighed against other business costs and benefits.

Github has historically been pretty unusual in its degree of following the DMCA takedown requirements, a lot of other places are a LOT more willing to ignore apparently spurious DMCA complaints than Github has been. I had hoped that this would change with the Microsoft acquisition, because maybe before their position was just that they couldn't afford any legal fights... but it doesn't seem to have been.

5y agoHN ↗

They don't want to end up in jail. It's a felony to traffic in circumvention devices under the DMCA. YouTube's obfuscation methods count as "effective" copyright protection per the law.

GitHub never was a safe place to develop illegal software. For example, you could expect them to take down hacking tools lickety-split.

5y agoHN ↗

GitHub is not a safe place to develop software that has an association with piracy, nor would any centralized service.

5y agoHN ↗

Yeah, there's a difference between Microsoft saying "We love open source now" and Microsoft saying "fuck the police, IP law needs to be rebuilt from the ground up anyway".

The idea that Microsoft should lose some of the goodwill it got doing the first for not doing the second is really naive.

5y agoHN ↗

No the line appears to be: "we love opensource, unless it messes with some BigCorps businessmodel, in which case a letter of nebulous legal fudge is enough to delete your repo without due process"

5y agoHN ↗

In the case of YouTube-dl they had test cases supporting downloads of DRM'd material. Specifically "Shake it Off" by taylor swift.

5y agoHN ↗

To the point. If it is illegal by the hosting country, good luck. And that can be whatever legalese imaginable.

But luckily git is decentralized.

5y agoHN ↗

I think there's more nuance to this. on one hand, they loose individual developer mind-share, but I'm sure that big corporation executives and governments are loving this kind of stuff...

5y agoHN ↗

Adhering to the law should be in every mindset. Stupid laws and wrong hosting country might be a different story

5y agoHN ↗

Why Microsoft? github.com is managed by GitHub, Inc. (that is owned my Microsoft). It is like complaining to Volkswagen if your Porsche gets broken.

5y agoHN ↗

why do you think this is MSFT's fault? Didn't github pre-acquisition always comply with DMCA takedown requests too?

Also, why shouldn't they? This really doesn't seem like the hill they should choose to die on, if they decide to go against the government they would have far more interesting things to fight for.

And this is one of the less defensible ones too, given they explicitly gave examples of infringing copyrights in the code.

EDIT: ah, but this isn't a proper takedown notice, as per https://twitter.com/xor/status/1319755776043384838

5y agoHN ↗

Why github/dmca? Why not e.g. tensorflow or numpy or some other package that people actually depend on?

5y agoHN ↗

And if GH deletes, and anyone else opens a new PR like you did, then those commits would remain until a second GH admin intervened, and so on?

5y agoHN ↗

So they need to DMCA the DMCA repository to get rid of it? Nice.

5y agoHN ↗

I hope they did counter claim? RIAA should get a strong kick for this.

5y agoHN ↗

The history of that github repo shows that counterclaims would be listed in that particular repo, along with the original DMCA request. There is no PR for a counterclaim for youtube-dl as of this comment.

5y agoHN ↗

That's not good then. There were some concerns before that the project wasn't active anymore, so I hope it's not a sign of maintainers deciding to pull the plug.

5y agoHN ↗

The claim was filed on Friday. It's been less than 48 hours, almost none of it during business hours. Filing a counterclaim is literally saying "see you in court," and given both that RIAA is known for being litigious and that youtube-dl's defense here is (to my reading of the law) merely decent and not slam-dunk, I would not want to take that step without seeking the advice of a lawyer first.

So even if a counterclaim were to be filed, I would not expect it to have been filed yet.

Edit: the most recent counterclaim I see filed was done on 2020-10-08 (https://github.com/github/dmca/blob/5dfed34cdb3774fcb10cb294...)... for a claim filed on 2020-09-16 (https://github.com/github/dmca/blob/951b7ba132fd6bafab2401a7...). That's almost a month later.

5y agoHN ↗

I'd also note that if anyone feels like duking it out with the RIAA for some reason (Why? Is your goal to spend as much money as possible or something?) you can always create your own youtube-dl equivalent and wait for a takedown notice of your own.

Now presumably GitHub won't let you push forbidden changesets, but since hashes are chained all you have to do is modify a single byte of the root and replay everything. (I have no idea if GitHub would ban you for a ToS violation or if they would just wait for the next DMCA takedown notice to show up.)

5y agoHN ↗

RIAA should get a strong kick for this.

Regardless of this particular case, the world would've been a saner place if copyright holders were held liable for erroneous claims.

5y agoHN ↗

Is it legal to file a DMCA claim when the motivation is retaliation? (Assuming that the person filing retaliatory DMCA claim can satisfy the good-faith requirement, that is.)

5y agoHN ↗

Nobody checks motivation. It is legal to file DMCA for anything. As it stands, the hosting providers don't even verify the validity, or the good-faith requirement, because they don't want to get in a fight that could cost them the safe harbor protection. So even invalid DMCA requests usually mean the content will be blocked for a couple of days and the accused party will have to lawyer up to put together a counter-claim.

5y agoHN ↗

The RIAA will have to create a takedown notice to takedown their takedown notice, invalidating the former takedown notice?

5y agoHN ↗

No, issuing a DMCA claim does not invalidate former claims. The system always works the way a rational human would expect.

5y agoHN ↗

"The system always works the way a rational human would expect."

We all wish, we all wish.

5y agoHN ↗

It works the way the law is designed to be interpreted and written. Unfortunately, it's written with the purpose of helping the RIAA enforce their will against the people's will.

So the only way to fight back is to do your civic duty - lobby against it, and/or lobby for a more modern set of copyright laws (and repeal the DMCA). But unfortunately, people don't care enough to force their representatives.

5y agoHN ↗

The system always works the way a rational human who has a vested interest in the claimaint

5y agoHN ↗

Cloned locally, was sad when the original repo was taken down.

Some things actually get worst when you try to prevent people from doing them, hopefully some people realize this.

Can someone remind me which music videos they did not want people to download please?

5y agoHN ↗

Fun fact: AACS keys are still actively being leaked to this day, e.g.

    0x09F911029D74E35BD84156C5635688C0 ; v1
    0x455FE10422CA29C4933F95052B792AB2 ; v3
    0xF190A1E8178D80643494394F8031D9C8 ; v4
    ; omit 60+ keys
    0x7A4F40D8696B7B159BE8176CC9EDB85C ; v66-68
5y agoHN ↗

Can someone remind me which music videos they did not want people to download please?

Have a look in your local version at extractors/youtube.py

5y agoHN ↗

Out of curiosity, If I were running my own git server can I delete a PR completely?

5y agoHN ↗

Pull requests aren't a part of git. They're a part of GitHub.

5y agoHN ↗

Git itself doesn't have a concept of pull requests; you are expected to just send a request for someone with access to the remote repository to do the pull themselves. Someone with access to the remote repository would need to take some action themselves before anything is actually downloaded to it.

Once the contents of the PR are in the remote repository, it is possible to completely delete them. First, you need to make them unreachable by any reference (which is to say, not in the history of any branch or tag). Then you can run the git garbage collector to actually delete the commits associated with the PR.

I don't think there is any way to tell the garbage collector to prune specific commits; so you will also loose any other orphan commits; but that probably isn't a problem.

5y agoHN ↗

Didn't work for me with the shorter commit hash, but it worked with the full hash 416da574ec0df3388f652e44f7fe71b1e3a4701f.

5y agoHN ↗

yeah my bad. When I tested I used the full hash and just wanted it to look concise, but didn't try the shortened one :/

5y agoHN ↗

`git fetch origin` failed for me

  fatal: Couldn't find remote ref 416da574ec

`git fetch origin pull/8142/head` worked (the ref became available).

5y agoHN ↗

I think the long term solution for this problem is the developers of open source software like the bit torrent client, youtube-dl and other similar software will have to host their code outside of the reach of DMCA regualation. That will usually mean something like Github like site hosted in Russia, China or some other bloc where DMCA does not apply.

Right now, lots of users in the US scientific community use Scihub or how millions of US students use libgen, millions of users of open source software will have to get used to a non US controlled domain to get access to their software. Also development of these software will be done in the shadows so as to avoid the reach of the DMCA.

5y agoHN ↗

I think the long term solution for this problem is the developers of open source software like the bit torrent client, youtube-dl and other similar software will have to host their code outside of the reach of DMCA regualation

I'm not sure about that. I think the real long term solution is to have a decentralized version of YouTube/video publishing platform that is resistant (invulnerable?) to censorship. I'm not saying that it's not difficult, or even impossible, but I would love to see more discussion regarding true web decentralization, not legal semantics.

5y agoHN ↗

LBRY.tv is a decentralized Youtube alternative. Another one is : bittube.tv

5y agoHN ↗

Zeronet [0] has implemented a decentralized website model, a Github alternative on there could be more resilient, though it does require additional client software to run. I believe the site owner can update their decentralized website with their cryptographic keys.

Perhaps WebTorrent [1] can be the basis for an in-browser implementation, along with service workers to stay cached and self-update without requiring a running host. Talk about serverless :^)

[0] https://zeronet.io/ [1] https://webtorrent.io/

5y agoHN ↗

Zeronet is very underrated, though I've never been able to exactly grok their high level architecture, for some reason.

5y agoHN ↗

Relying on other countries can't ever be a long term solution.

That pirate bay and scihub are still around, that their authors are walking around freely, is a miracle that should not be taken for granted.

We need to work on fixing these problems in our own countries. We need to talk about the freedoms we care about, put a good brand to those freedoms and win popular attention and enshrine those freedoms into law. And build a society that depends on those freedoms so much that rolling them back would be unthinkable.

That would be an actual long term solution. It is hard but if we all contribute, we can do it. Probably.

5y agoHN ↗

I agree in principle, but a much easier fix would be to host such code on a tor hidden service. That way the physical server can be located more or less wherever.

Then we just have to normalize the use of Tor so that banning it becomes unthinkable ...

5y agoHN ↗

In other words, instead of trying to change the laws, which is the whole idea of a democracy, just give up on laws altogether.

5y agoHN ↗

The vast majority of people don't give a shit about this, so the money being pumped by rights holders will win out.

5y agoHN ↗

That pirate bay and scihub are still around, that their authors are walking around freely

Let's not equate these sites. scihub gives people what they are likely already paid for. Academic publishing business is a fraud. https://www.youtube.com/watch?v=PriwCi6SzLo (recent video on the topic that I liked)

5y agoHN ↗

scihub gives people what they are likely already paid for

No, as long as the researcher was not bound by the grant to publish in the open and published in a journal/conference with a copyright, you do not have the legal right to get it, even if taxpayers funded the research.

It’s fucked that the law doesn’t stipulate open publications for taxpayer funded research, but that’s an issue with the law. Academic publishing isn’t a “fraud” in the normal definition.

5y agoHN ↗

You're countering what I perceive to be moral argument with a legal one, which would be a category error.

5y agoHN ↗

Yet whether the authors walk freely is entirely a legal issue, not a moral one.

5y agoHN ↗

"Peter Sunde, Fredrik Neij, Gottfrid Svartholm and Carl Lundström were all found guilty and sentenced to serve one year in prison and pay a fine of 30 million SEK". I wouldn't call it walk freely.

5y agoHN ↗

Yeah, Sweden doesn’t allow for zeroing debts due to legal judgements in personal bankruptcy, IIRC.

This means that they were effectively sentenced to lifelong debt slavery. This is another dark part of the Scandinavian model that most aren’t aware of. Same system in Norway.

5y agoHN ↗

I know a friend of one of those 4 mentioned and he is doing absolutely fine (money-wise at least)

5y agoHN ↗

Do you know any details? I had the distinct impression that these debts would never be discharged.

Are the authorities just not following up on using the legal framework to seize any of their earnings towards the debt?

5y agoHN ↗

Relying on other countries can't ever be a long term solution.

It is the only solution that can put any pressure on the US in a macro sense. The DMCA is a uniquely American creation, and it will remain in tact until the US starts losing intellectual capital to other countries. Such a thing is not likely to happen any time soon, but in a decade or two, the US will still be arguing which Larry owns the copyright to a header file, while China and others would have moved on to far more interesting challenges.

5y agoHN ↗

Hosting the git repository on ipfs might be a solution.

5y agoHN ↗

outside of the reach of DMCA regualation.

What's the latency to the Moon again? :)

5y agoHN ↗

2.5s is the minimum roundtrip. Add server and satellite hops and you get something closer to 3s minimum. Every time.

5y agoHN ↗

Thanks. Sounds like it'd be workable as a backup target then, but would probably suck being the primary place to grab source code.

That being said, maybe it would be ok as a primary location if there are more localised caches (eg lower response times) commonly available.

5y agoHN ↗

It's git - what do you need low-latency for? Download directories, trees, as the initial requests, then send a second request for the source code you want to download. Then the bottleneck is download speed instead of latency.

5y agoHN ↗

For just git, sure.

For a web application to present it (eg Gitea, GitLab, etc), then the lower latency would be helpful. ;)

5y agoHN ↗

Not a problem for Git or even PR workflow then.

5y agoHN ↗

It would not be an issue even in the Earth-Mars case, where the roundtrip latency is 20m-1h15m depending on the time.

5y agoHN ↗

Well, you probably wouldn't want to try using standard TCP connections with that. ;)

5y agoHN ↗

I wonder how this will work out in practice. Funny thing old pre-Internet protocols migh even work out of the box in this case. Interplanetary email & newsgroups! :-)

5y agoHN ↗

Nah, that won't work. China is a member of WTO and follows the TRIPS agreement. Therefore, I guess the RIAA will just go court in China, and they can still take down any repository which they'd like to. Lots of companies from the western country have won intellectual lawsuits in China.

Sites like sci-hub works in a way tricky manner. You can't expect an ordinary company which is in another country to do so, because they are still inside the framework of the international capitalism.

5y agoHN ↗

... is now part of ...

Can someone please explain what that means? Is the code not accessible anymore? Is it frozen? No commits allowed? What exactly are the implications here?

5y agoHN ↗

It's just someone creating a pull request to the dmca repository with the pull request containing the entirety of the youtube-dl repository (and its history). It's mostly a joke

5y agoHN ↗

Any idea what the future of ytdl will look like? Can they continue? Will the source code have to be rewritten?

5y agoHN ↗

It's a fun hack, but to those thinking about streisanding the source: The strength of ytdl and other downloaders isn't their source code, it's the extensive library of scrapers that are tailor-made for individual sites.

The devs have to constantly maintain and update those to keep working when a site changes its design.

So if the takedown manages to stop ongoing development on ytdl then even existing copies will become mostly useless pretty quickly.

5y agoHN ↗

Would it not be possible to move to some decentralized Github alternative?

5y agoHN ↗

The problem is finding a good alternative and getting everybody to move there.

5y agoHN ↗

“Everybody” is surely not a massive amount of people for youtube-dl. I mean, it’s hardly the Linux kernel... let’s remember that this is just about developers, distribution is a separate (arguably easier to solve) problem.

5y agoHN ↗

And even the Linux kernel does not use a centralized 3rd party service. They use only email.

Of course the server hosting LKML or in the end Linus' mailbox are single points of failures.

5y agoHN ↗

You can’t decentralise issues and pull-requests.

Edited: as pointed-out, Fossil supports decentralized issues (but not PRs). However, Fossil is a totally different system than Git.

5y agoHN ↗

It's amazing that no one has thought to do this yet considering the checkered history of GitHub's compliance with DMCA takedowns.

5y agoHN ↗

In the early 2010s, there were a whole bunch of distributed issue trackers for git. They all died out due to various problems, such as working across branches, polluting the commit history, extra commands to keep synced (including not getting retrieved with the initial clone), not having a web view for project managers/bug reporters, etc.

I think this was the most popular one: https://github.com/aaiyer/bugseverywhere

5y agoHN ↗

You mean something like... got? ;)

But I agree with the sibling posts, while decentralised change tracking is pretty much the original idea of git, all the project management stuff (issues, comments, membership/permissions, discoverability) are a lot harder to decentralize.

I also don't think the MPAA or whoever else would be very impressed by that if the end result is still illegal activity: If the developers are known, then they'd either have to pass on the project to someone else or risk liability, whether their project repo is centralised or not.

5y agoHN ↗

Just host a gitlab instance through TOR or something, bish bash bosh

5y agoHN ↗

GitLab through tor sounds slow...... (Six dots for six hops)

5y agoHN ↗

Tor uses 3 middle nodes, so it's only 6 hops if you count the round trip.

It's the latency that kills you, not sheer bandwidth - I can watch YouTube on Tor on a good day when Google doesn't block my exit.

More people should try Tor. It's easier than you think.

5y agoHN ↗

A hidden service uses 6 middle nodes, 3 for the server, 3 for the client.

5y agoHN ↗

Something like... git? Git is designed from the start to work for decentralized workflows, development could continue without too much issue by sending patches by email instead of pull requests by github.

5y agoHN ↗

The change is gone now, I literally watched it disappear. I really hope that youtube-dl can bounce back from this. I mean what's next, Kodi? NewPipe?

5y agoHN ↗

I think projects like Kodi, OSMC etc. are seasoned enough and extremely careful with how they show intent.

They only allow official add ons that are on the legal side of copyright. Same goes for official docs.

But you can see what happened to Exodus, Covenant, Popcorn, etc. If you are making a dent after enough time they catch up.

5y agoHN ↗

NewPipe is actively looking for a method of mirroring the code + (and more importantly for them) Github issues and PRs https://github.com/TeamNewPipe/NewPipe/issues/4619

Related suggestions have been https://github.com/MichaelMure/git-bug and https://github.com/google/git-appraise . The former (git-bug) allows decentralized issue management by storing the issues and conversations on separate git objects, while git-appraise allows the same but for code reviews and thus (I assume) pull/merge requests.

IMO, both very nice projects that open-source devs might want to investigate in order to be independent of their code hosting platforms. Or even better, contribute or donate for their continued development. The current dependence on hosted issue + PR management is revealing its weaknesses.

5y agoHN ↗

The internet is all fluffed up about the RIAA, people are calling things cancer, and calling things "retarded" in public comments. Don't forget the constant "well they should take down browsers, and Windows, and networking code!" retorts

It's like we've gone back to the mid '00s. With that vibe, https://youtu.be/SnLB8wysMbY

5y agoHN ↗

Thank you for sharing that video, made my day haha

5y agoHN ↗

We haven't gone back to the 2000s, it's always been like this. RIAA and copyright as a whole is and always has been a cancer on society---people may have just forgotten about it in recent times.

5y agoHN ↗

So if I understand this correctly it’s possible for anyone to make someone else liable for copyright or patent violations by creating a PR on their repo then arranging for them to get sued?

5y agoHN ↗

In the U.S., the DMCA's safe harbor would probably protect them if they took the content down and forwarded the notice to the poster. Not sure about patent law.

5y agoHN ↗

perthchat dot org has an interview with an old maintainer about the removal from github.

5y agoHN ↗

sorry, that's news dot perthchat dot org

5y agoHN ↗

What bothers me about DMCA the most is the lack of due process. In the US, one would think more than any place else you have the right to a lengthy trial before have a right stripped away.

Both political parties in the USA regularly chip away at our rights in the ever on going battle to capture more votes from extreme positions or 'bring the usa in line with international (read european) standards', in this case WIPO.

How this Christmas gift was ever given to the RIAA is mind blowing.

5y agoHN ↗

How this Christmas gift was ever given to the RIAA is mind blowing.

$$$.

I think this is a part of a bigger issue. 1st amendment protects citizens from government censorship. DMCA creates a loophole where the govt isn't deciding what to censor, they are merely enforcing compliance of what a corporation wants to censor, sidestepping any 1A defense.

This means ultimately either platforms arbitrate, or the receiving party has to sue, either way it's chilling.

5y agoHN ↗

In the US, one would think more than any place else you have the right to a lengthy trial before have a right stripped away.

No rights has been stripped away, you can still go the lengthy trial way if that's what you want to.

Respecting the DMCA is a way for the platform to avoid the lengthy trial process, because first, they don't care about your content, and second, because it's an incredibly expensive process.

The beauty in the DMCA system too is that you can file a counter claims, sadly not all platform make it easy to do so, but that just show how much they care about your content. I heard that Github allow to and that it's not too hard.

5y agoHN ↗

I still don't get this, though. Why DMCA-ed the entire project?

Isn't simply removing the offending parts on code sufficient?

5y agoHN ↗

The claim was that the program as a whole was in violation, as it could be used to "circumvent the technological protection measures" such as those used in YouTube. They're also claiming that for the other sites it can download from.

5y agoHN ↗

Crazy how people have forgotten that git is decentralized to begin with, and email is even federated. Not sure what the implications of kernel style development would be with the DMCA going after them but I'm sure we'll find a solution.

5y agoHN ↗

Copyright is an attack on property rights...

Suddenly, what other people might have done similarly, restricts what you can do with your rightfully owned property.

Can someone explain why government -granted monopolies on human cultural output is a good idea?

5y agoHN ↗

I think is valid as long as it protects the right of people creating (now) digital goods, to be payed for if they created that value.

But i think the law is to harsh and actually can even destroy that piece from existing for being too severe over the copies of that work.

For movies or music for instance, something like 3 year period of copyright ownership would be fine.

People would still pay for first access to the piece, while it would be much more likely to find a copy after lets say, 100 years somewhere.

5y agoHN ↗

For movies or music for instance, something like 3 year period of copyright ownership would be fine.

Great line of thinking. But I think the idea of earning income from a creative work throughout one's life also has value.

A compromise is to retain the existing copyright periods (after which works go to the public domain),but after 5-10 years of creation, works would become free for non commercial distribution. So Netflix would still have to pay for movies in their catalog. But me torrenting it from people freely sharing it and playing it on VLC would be legal.

5y agoHN ↗

Great line of thinking. But I think the idea of earning income from a creative work throughout one's life also has value.

I agree with you, at least in parts. I was addressing only the issue of copyright with digital copies, where people watch. play or listen free of charge after a given period.

But still after the artist, crew, studio or company cashed from their success, they could still make copyright grants to people that want to reproduce their content.

For instance, the free extension would only cover private listening, viewing or playing. But if you want to play the movie in your theater and make some bucks out of it, them you would have to pay for the copyright with the 'extended period rule'.

If you are musician and want to sing the song in your show, you would have to pay for copyright.

The logic here goes to anyone that might sell others people labor while getting it for free. This should be protected by the copyright law, more or less the way it is now.

But for private consumption, just giving enough time that would not be reasonable to just "wait for when its free" for people that otherwise would be buying is enough.

If your kids want to watch the new Avengers movies that cost just 10 bucks, who would wait 3 years for such a small value?

The problem is the whole industry is still stuck in the 20th century where products were all physical goods.

The digital realm and copies are here to stay, they are fighting against the tide, and one day they will wake up that its a lost battle.

A compromise is to retain the existing copyright periods (after which works go to the public domain),but after 5-10 years of creation, works would become free for non commercial distribution. So Netflix would still have to pay for movies in their catalog. But me torrenting it from people freely sharing it and playing it on VLC would be legal.

Yes, that's basically it. But 10 years is too much and unnecessary. Within 3 to 4 years anything stop being fresh. People that buy things when they are fresh are no longer interested, and its enough time to make it if your piece had a bad first launch, but by virtue started to catch-up and make some bucks to the creators.

The key is to define a period of time where the piece might stop trending until very few people pay for them. Analitics might help to get a reasonable period for each media.

5y agoHN ↗

This seems a lot more reasonable than having a cartel comprising three record companies literally owning human culture!

5y agoHN ↗

The beauty of git is that YouTube-dl is backed up on all of the contributors’ machines, and they can easily push to a new head server.

Removing it from GitHub doesn’t kill it. Just moves it off of the most popular platform.

5y agoHN ↗

Cloned and forked. Can we also get this on tardigrade.io etc please?

5y agoHN ↗

I am donating my popular repos and deleting my account. Fuck GitHub and fuck Microsoft. I'll stop using VSCode, too.

5y agoHN ↗

Have you ever known Microsoft to aquire something similar to their own product, dump their product name and go with the acquisitions branding?