So open source development should be more like job-hunting and hiring, where humans feed AI-generated resumes into AI resume filters which supposedly choose reasonable candidates to be considered by other humans? That sounds... not good.
I'm part of that small but (hopefully) growing percentage, because Common Crawl is a deeply dishonest front for AI data scraping. Quoting Wikipedia:
"""
In November 2025, an investigation by technology journalist Alex Reisner for The Atlantic revealed that Common Crawl lied when it claimed it respected paywalls in its scraping and requests from publishers to have their content removed from its databases. It included misleading results in the public search function on its website that showed no entries for websites that had requested their archives be removed, when in fact those sites were still included in its scrapes used by AI companies.
"""
My site is CC-BY-NC-SA, i.e. non-commercial and with attribution, and Common Crawl took a dubious position on whether fair use makes that irrelevant. They can burn.
Hopefully my site is no longer part of Common Crawl. I'm not interested in participating in your project, block CCBot in robots.txt, and have requested deletion of my data via your form.
Did you see our reply? Edit: by which I mean, we sent you an email that explains what we did and how to verify it. Did you not receive an email reply? If not, please contact us again.
Also, if your site has CC-BY-NC-SA markings, we have preserved them.
"We have initiated the process to remove your content from the Common Crawl Dataset. This is a multi-step process, involving first a nocrawl directive, followed by removal of the URLs from the primary index files, and finally removal of the content from the deep archive. We will advise when the process is complete." Received April 2024. I have not been advised. Please advise.
From my basic experience editing Wikipedia I'm not sure you should edit the page of your own project. Maybe add a discussion for it instead? Or perhaps I'm mistaken.
Don't be sad! NetNewsWire has been my newsreader for well over a decade, and I only consider "upgrading" out of idle curiosity, because the version I have now does what I want, and does it well. The version treadmill is a machine producing only sadness.
Thanks for confirming this! I read the speculation, and traveled fairly close to Dankova. Actually climbing it is a serious land expedition from the nearest international airport.
We used to have an endless supply of new search engines, so "SEO" was not viable. Then Google got a monopoly on search, DoubleClick reverse-acquired Google, and here we are.
Become a plutocrat, or be useful to plutocrats. I don't have the moral flexibility for the former, but plutes tend to care about their images, legacies, and mewling broods. A clever person can find a way to be the latter.
I spend most work days with robot dev software (claude code). If Copilot had a similar ability to do useful work with meaningful oversight I wouldn't mind spending time with it. Sadly it does not
That's different: you're using bots to create software that someone finds useful, so you're entirely on the producer end.
People using Copilot 365 are on both ends, both producing and being inundated with generated content. Sure, they can crank out 10x as many emails and slides, but they also have to deal with 10x as many incoming from their coworkers. They can of course use a bot for that, but then they're back where they started, but with errors.
This is my guess for the demand side: most people will drift away as the novelty wears off and they don't find it useful in their daily lives. It's more a "fading point" than a "breaking point."
From the investment/speculation side: something will go dramatically against the narrative. OpenAI's attempted "liquidity event" of an IPO looks like WeWork as investors get a look at the numbers, Oracle implodes in a mountain of debt, NVidia cuts back on vendor financing and some major public players (e.g. Coreweave) die in a fire. This one will be a "breaking point."
Do we? Spewing features like explosive diarrhea is not something I want.
reply