* fix(default-config): block Huawei Cloud Closes #978 Huawei Cloud has been egregious about its scraping. All attempts to contact their abuse team have failed. If you work for Huawei Cloud, please raise this issue internally and get the scraping to just stop. * chore: spelling Signed-off-by: Xe Iaso <me@xeiaso.net> --------- Signed-off-by: Xe Iaso <me@xeiaso.net>
5 lines
228 B
YAML
5 lines
228 B
YAML
- import: (data)/bots/cloudflare-workers.yaml
|
|
- import: (data)/bots/headless-browsers.yaml
|
|
- import: (data)/bots/us-ai-scraper.yaml
|
|
- import: (data)/bots/custom-async-http-client.yaml
|
|
- import: (data)/crawlers/huawei-cloud.yaml
|