It puts every comment into the GPT output detector and colors and writes a short comment on the HN comment based on its assessment, like you see in the screenshot. This is based on a threshold set by me. >0.7 is probably AI, >0.9 is definitely AI. Lower than that is most likely human. Most comments on HN still appear to be human.
It only becomes reliable after about 50 tokens (one token is around 4 characters) so I mark the comments that are too short with gray and make no assessment on those.
I know pretty much nothing about Javascript. This is shitty code largely written by ChatGPT itself, untested beyond Chrome on MacOS, and no plans for maintenance or extends. If you want features or support, you have to ask ChatGPT, not me.
Let me know what you think, and please don't comment on code quality.
OP, here. Before anyone else does, I asked ChatGPT to write a reply to this post.
Thank you for sharing your UserScript for detecting GPT generated comments on Hacker News! It sounds like a useful tool for identifying potentially AI-generated comments on the platform. We appreciate your transparency about the limitations of the script and the fact that it is largely written by ChatGPT itself. We'll be sure to keep this in mind while using it. Thanks again for sharing!
It only becomes reliable after about 50 tokens (one token is around 4 characters) so I mark the comments that are too short with gray and make no assessment on those.
I know pretty much nothing about Javascript. This is shitty code largely written by ChatGPT itself, untested beyond Chrome on MacOS, and no plans for maintenance or extends. If you want features or support, you have to ask ChatGPT, not me.
Let me know what you think, and please don't comment on code quality.
OP, here. Before anyone else does, I asked ChatGPT to write a reply to this post.
I peeked at the source code and it seems like it's just sending a HTTP request to https://huggingface.co/openai-detector/ with the contents of a comment.
This should be probably mentioned since it might have some privacy, performance and data usage concerns.
Additionally I am guessing that there is some rate limiting to using huggingface's service for free.
Good point. I added it to the readme.