mastodon-blocklists/README.md

97 lines
6.1 KiB
Markdown
Raw Normal View History

2023-01-13 09:45:29 +01:00
# Oliphant.Social Shared Blocklist Files
2022-12-03 18:14:31 +01:00
2023-01-13 09:45:29 +01:00
New and improved thanks to the excellent [Fediblockhole](https://github.com/eigenmagic/fediblockhole).
2023-01-13 07:22:35 +01:00
2023-01-13 20:10:33 +01:00
For more information, please check out my blog [Oliphant Social Curated Blocklists](https://writer.oliphant.social/oliphant/the-oliphant-social-blocklist) page.
2023-01-13 09:45:29 +01:00
## How are Unified Blocklists Built
2023-01-13 10:50:22 +01:00
I, ([Oliphant@oliphant.social](https://oliphant.social/@oliphant)), curate a list of trusted sources, including my own server. These can be public or private lists, but a server can opt-in to being one of the Trusted Sources. So long as they aren't already a defederated server and are trusted by others on the Trusted Sources list, they become a member and provide either their public list, or a `read:blocks` api key for Oliphant.Social to use.
2023-01-13 09:45:29 +01:00
Everything is checked against Mastodon.Social and Mastodon.Online, as the 'flagship servers' we might as well give them a vote as well in defederation of the final unified list. (at least for now.) Hopefully Gargron won't mind too much me pulling from their public api of defederation to represent the voice of the Mastodon Server Covenant from a pretty canonical source.
2023-01-13 20:09:24 +01:00
Note that some servers use obfuscation, which blocks imports from being included in the final unified lists.
2023-01-13 20:37:28 +01:00
It's worth noting that although I try on my server to remove and unban servers that are dead and no longer active, not all the sources do the same so there may be some bloat in the unified lists that comes from dead servers.
2023-01-13 20:09:24 +01:00
2023-01-13 09:45:29 +01:00
## How Is My List Built
Read my [Guidlines for Defederation](https://writer.oliphant.social/oliphant/guidelines-for-defederation). That's how you end up on my list. Some of it comes from ancestral sources. Some of it is very subjective and may even be wrong and I will revisit the list. Make an issue above if you think you're on this list in error and I may remove it.
## Advantages of being a Trusted Source
For one, you can point people to your own list for import when they start their own server. Because all of the sources are involved in the "Fedi Council" here, no one needs to accept *my* opinionated list alone anymore. I am but one voice among trusted sources, but we take the most lenient judgment (Silence vs Suspend, and None/Reject Media over Silence) when creating the final `_unified_blocklist.csv`.
None of the Trusted Sources are going to end up in the final unified mergelist, for obvious reasons. We'll leave defederations of my trusted sources (myself included) up to your own individual discretion.
### Trusted Sources:
2023-01-13 23:42:09 +01:00
#### Tier 0
Tier0 is base-level moderation, expected on the flagship servers and as part of the Mastodon Server Covenant.
2023-01-13 23:43:28 +01:00
1. Mastodon.social
1. Mastodon.online
2023-01-13 23:42:09 +01:00
#### Tier 1
Tier1 are servers that block somewhat aggressively (like mine).
2023-01-13 23:43:28 +01:00
1. Oliphant.Social
1. Union.Place
2023-01-15 07:42:16 +01:00
1. Sunny.Garden
2023-01-13 23:42:09 +01:00
#### Tier 2
Tier2 are servers that block *very* aggressively.
2023-01-13 23:43:28 +01:00
1. Mastodon.Art
1. Toot.Wales
1. Artisan.Chat
2023-01-14 04:46:26 +01:00
#### Tier 3
Tier 3 servers *do not mess around*.
1. Rage.love
2023-01-13 17:30:05 +01:00
### Obfuscate Sucks for Trusted Servers
If you want to use Mastodon.social's blocklist, their obfuscate setting has made any domain with asterisks in it unimportable. None of the Oliphant.Social domains are obfuscated for that reason. If you're a Trusted Source, you're better off not obfuscating your blocked domains.
2023-01-13 09:45:29 +01:00
### The Algorithm:
2023-01-13 17:30:05 +01:00
All the trusted sources in Tier0 and Tier1 are pulled and updated regularly as a dry run, which generates the files (see Fediblockhole link above) and creates the `_unified_min_blocklist.csv` file. This file can be imported and is a merge of all of the trusted sources combined.
This **FediBlockHole** config file is set to use the `min` setting when it comes to creating the final merge file. This means that where there is a conflict between trusted sources, the *least* severe setting wins.
2023-01-13 09:45:29 +01:00
2023-01-14 04:47:11 +01:00
The `_unified_max_blocklist.csv` includes Tier0-3 Trusted Sources and chooses the *most* restrictive option.
2023-01-13 09:45:29 +01:00
2023-01-15 07:42:16 +01:00
This Max blocklist also includes the RapidBlock list recommendations.
2023-01-15 22:39:44 +01:00
### The Allowlist
Or the "safe list." Anyone that appears in the __allowlist.csv above will *not* be included in any of the unified blocklist files. This is primarily to ensure that no one who is part of our Fedi Council gets accidentally recommended as a block--even *if* members of the Fedi Council end up defederating each other in the future, this is just some protection against that.
Also, if you're using one of these lists in an automated fashion and want to be sure you don't show up in the results, either, please let me know.
2023-01-15 23:08:05 +01:00
Note that if you're writing your own custom local process, you should absolutely check if your server is in the defederation list, anyway, to prevent you from loading that entry and defederating yourself, which is a real pain and probably requires server access to fix.
Mastodon should also have built-in protection from defederating yourself, but that is another story.
2023-01-15 22:39:44 +01:00
2023-01-13 23:43:28 +01:00
### How Oliphant.Social decisions affect these lists
2023-01-13 20:43:41 +01:00
2023-01-14 18:27:01 +01:00
I want to be transparent about this. Yes, I do have some impact on the Tier1, 2 and 3 combined lists.
2023-01-13 20:43:41 +01:00
2023-01-13 23:44:19 +01:00
Under the most-lenient policy, if I dropped a Suspension to Silence or even None+RejectMedia, I could affect the overall "min" and tier1 and tier2 lists as well.
2023-01-13 20:43:41 +01:00
Of course, it would have no bearing on the max file, but if I was to Suspend a commonly-silenced domain, the *max* policy would apply the most restrictive to the *max* file, and my Suspend could thus weight everyone else's Silence to a Suspend in that file.
That's why the algorithm is transparent, and why you have a choice of what you want to download, and I'm very up front about my own subjective choices on my server.
2023-01-13 20:44:48 +01:00
But it does also mean if you get off my blocklist, you might get off the merge lists entirely, too, for those sites uniquely defederated by me.
2023-01-13 20:43:41 +01:00
I'm showing all my work here, you see the source files from various servers that drive the resulting merge files, and can easily discuss among yourselves what this means.
2023-01-13 20:44:48 +01:00
See me if you want to get off the Oliphant.Social blocklist, or if you have recommendations or nominations of other Trusted Sources. Those opt-ins need to come from the server admin.