“We believe in an open internet… as long as you use these specific services.”
This really sucks. So we’re looking at a future where search engines are like streaming services now. “Hmmm now which search engine was <insert website here> on?”
That’s why I use a SearXng instance. Why bother searching for something on 1 instance when you could search for it on 5 and then correlate the results.
Does this mean the Internet Archive will no longer be archiving reddit posts? That’s how I’ve tried viewing most since I deleted my accounts.
I honestly do not think Internet Archive even should be archiving such behemoths like Reddit or Twitter. Only thing it should keep would be currently dead sites.
Even worse when people are accessing these posts through Archive even when there is a live copy. A lot of storage and bandwidth wasted.
Archives are ideal for identifying sneaky behavior like that. You never know when an admin might have the ability to delete or edit something without anyone noticing.
If you use Bing, DuckDuckGo, Mojeek, Qwant or any other alternative search engine that doesn’t rely on Google’s indexing and search Reddit by using “site:reddit.com,” you will not see any results from the last week. DuckDuckGo is currently turning up seven links when searching Reddit, but provides no data on where the links go or why, instead only saying that “We would like to show you a description here but the site won’t allow us.” Older results will still show up, but these search engines are no longer able to “crawl” Reddit, meaning that Google is the only search engine that will turn up results from Reddit going forward.
Can anyone confirm this? I typically use DDG, and I tried verifying this, but i’m not sure what to search on reddit that would exclusively bring up results from the past week. Seems like most of the time I’m reading posts from a year ago or more anyway, so it’s hard to see the effect immediately.
I don’t have a ton of knowledge in this area, but this seems like it should run afoul of antitrust regulations?
Given lawmakers that understand how the internet works, I think it would be. To me this isn’t any different than a handful of years back when ISPs were throttling websites to give an advantage to the certain ones that paid them to work faster.
That was my first thought too. Yet another reason to vote for Dems this November - only one party actually gives a shit about enforcing antitrust regulations!
are you absolutely positive the democrats give a shit about antitrust regulations? Biden did actively strike break.
Who should be regulated, Google or Reddit? Reddit updated there robots.txt to disallow everything. As it’s their site, I guess it’s also their right to determine that. They then made a deal with Google, which I guess is also not abusing a dominant position by Google, as Reddit could have made a deal with anyone.
Are we looking at a future where we need a search engine to tell us which search engine to use for your queries?
I think we’re looking at a future where Google ensures we don’t ever have to worry about making such a choice.
It’s a bit of a dilemma reading their policy:
We believe in the open internet and in keeping Reddit publicly accessible to foster human learning (…) Unfortunately, we see more and more entities using unauthorized access (…) especially with the rise of use cases like generative AI. This sort of misuse of public data has become more prominent as more and more platforms close themselves off from the open internet.
We still believe in an open internet, but we do not believe that third parties have a right to misuse public content just because it’s public.Being a open/public platform, but still wanting to protect user’s content from being used for AI could be a good thing, and I guess also what many fediverse users would want for this platform. Making a distinction between AI and search indexing could indeed be difficult. But then making content deals with Google for search indexing and AI training is a bit hypocrite.
We still believe in an open internet, but we do not believe that third parties have a right to misuse public content just because it’s public.
You need to pay us for the right to misuse our site’s data!
It’s not a big deal… for now, because most of the time when I limit DDG results I ask for 1 year back (for solutions that are sort of recent but not ancient).
I would never limit results to just the last week, and typically posts that are that fresh won’t have enough accumulated knowledge so even if they pop up on the results they’re not really useful.
Again, that’s just my experience. I’m curious if others have similar ones.
In 51 weeks, the decreasing usefulness of that search drops to zero. This is not about now; it’s about the future.
True but It will become a bigger deal every passing day that is the problem.
I also wonder if search engine’s will delist results after a period of time. If the site is blocking them. After all you don’t want your top results to just be 404s all of the time.
Unless it’s 404 Media!
