68a71c6a99
* Add Applebot definition Adds Apple's search indexing bot, and allowlists it by default. Allowlisted by default because it is equivalent to Googlebot/Bingbot. Remove Applebot from `ai-robots-txt.yaml` for the same reasons. Remove `Applebot-Extended` from `ai-robots-txt.yaml` as it has no effect. * chore: spelling Signed-off-by: Xe Iaso <me@xeiaso.net> --------- Signed-off-by: Xe Iaso <me@xeiaso.net> Co-authored-by: Xe Iaso <me@xeiaso.net>
248 lines
1.9 KiB
Text
248 lines
1.9 KiB
Text
acs
|
|
aeacus
|
|
Aibrew
|
|
alrest
|
|
amazonbot
|
|
anthro
|
|
anubis
|
|
anubistest
|
|
Applebot
|
|
archlinux
|
|
badregexes
|
|
berr
|
|
bingbot
|
|
Bitcoin
|
|
blogging
|
|
Bluesky
|
|
blueskybot
|
|
boi
|
|
botnet
|
|
BPort
|
|
broked
|
|
cachebuster
|
|
Caddyfile
|
|
caninetools
|
|
Cardyb
|
|
celchecker
|
|
CELPHASE
|
|
certresolver
|
|
CGNAT
|
|
cgr
|
|
chainguard
|
|
chall
|
|
challengemozilla
|
|
checkpath
|
|
checkresult
|
|
chen
|
|
chibi
|
|
cidranger
|
|
ckie
|
|
cloudflare
|
|
confd
|
|
containerbuild
|
|
coreutils
|
|
CRDs
|
|
crt
|
|
daemonizing
|
|
DDOS
|
|
Debian
|
|
debrpm
|
|
decaymap
|
|
decompiling
|
|
discordapp
|
|
discordbot
|
|
distros
|
|
dnf
|
|
dnsbl
|
|
dnserr
|
|
dracula
|
|
dronebl
|
|
droneblresponse
|
|
duckduckbot
|
|
eerror
|
|
ellenjoe
|
|
enbyware
|
|
everyones
|
|
evilbot
|
|
evilsite
|
|
expressionorlist
|
|
extldflags
|
|
facebookgo
|
|
fastcgi
|
|
fediverse
|
|
finfos
|
|
flagenv
|
|
Fordola
|
|
forgejo
|
|
fsys
|
|
fullchain
|
|
Galvus
|
|
gha
|
|
gitea
|
|
goland
|
|
gomod
|
|
goodbot
|
|
googlebot
|
|
govulncheck
|
|
GPG
|
|
grw
|
|
Hashcash
|
|
hashrate
|
|
headermap
|
|
healthcheck
|
|
hec
|
|
hmc
|
|
hostable
|
|
htmx
|
|
httpdebug
|
|
hypertext
|
|
iat
|
|
ifm
|
|
inp
|
|
iss
|
|
isset
|
|
ivh
|
|
Jenomis
|
|
JGit
|
|
journalctl
|
|
jshelter
|
|
JWTs
|
|
kagi
|
|
kagibot
|
|
keikaku
|
|
keypair
|
|
KHTML
|
|
kinda
|
|
KUBECONFIG
|
|
lcj
|
|
ldflags
|
|
letsencrypt
|
|
Lexentale
|
|
lgbt
|
|
licend
|
|
licstart
|
|
lightpanda
|
|
LIMSA
|
|
Linting
|
|
linuxbrew
|
|
LLU
|
|
loadbalancer
|
|
lol
|
|
LOMINSA
|
|
maintainership
|
|
malware
|
|
mcr
|
|
memes
|
|
metrix
|
|
mimi
|
|
minica
|
|
Mojeek
|
|
mojeekbot
|
|
mozilla
|
|
nbf
|
|
nginx
|
|
nobots
|
|
NONINFRINGEMENT
|
|
nosleep
|
|
ogtags
|
|
onionservice
|
|
openrc
|
|
pag
|
|
parseable
|
|
passthrough
|
|
Patreon
|
|
pgrep
|
|
phrik
|
|
pidfile
|
|
pids
|
|
pipefail
|
|
pki
|
|
podkova
|
|
podman
|
|
prebaked
|
|
privkey
|
|
promauto
|
|
promhttp
|
|
pwcmd
|
|
pwuser
|
|
qualys
|
|
qwant
|
|
qwantbot
|
|
rac
|
|
rcvar
|
|
redir
|
|
redirectscheme
|
|
relayd
|
|
reputational
|
|
reqmeta
|
|
risc
|
|
ruleset
|
|
runlevels
|
|
RUnlock
|
|
sas
|
|
sasl
|
|
Scumm
|
|
searx
|
|
sebest
|
|
secretplans
|
|
selfsigned
|
|
setsebool
|
|
shellcheck
|
|
sitemap
|
|
sls
|
|
sni
|
|
Sourceware
|
|
Spambot
|
|
sparkline
|
|
srv
|
|
stackoverflow
|
|
startprecmd
|
|
stoppostcmd
|
|
subgrid
|
|
subr
|
|
subrequest
|
|
SVCNAME
|
|
tagline
|
|
tarballs
|
|
techaro
|
|
techarohq
|
|
templ
|
|
templruntime
|
|
testarea
|
|
torproject
|
|
traefik
|
|
unixhttpd
|
|
unmarshal
|
|
uvx
|
|
Varis
|
|
vendored
|
|
vhosts
|
|
videotest
|
|
waitloop
|
|
weblate
|
|
webmaster
|
|
webpage
|
|
websecure
|
|
websites
|
|
wordpress
|
|
Workaround
|
|
workdir
|
|
xcaddy
|
|
Xeact
|
|
xeiaso
|
|
xeserv
|
|
xesite
|
|
xess
|
|
xff
|
|
XForwarded
|
|
XNG
|
|
XReal
|
|
yae
|
|
YAMLTo
|
|
yeet
|
|
yeetfile
|
|
yourdomain
|
|
yoursite
|
|
Zenos
|
|
zizmor
|
|
zos
|