feat: update botPolicies for DuckDuckGo web crawler (#250)

- updates botPolicies with ips from the website
- adds the updated information to the `CHANGELOG.md` file

Signed-off-by: Xe Iaso <me@xeiaso.net>
Co-authored-by: Xe Iaso <me@xeiaso.net>
This commit is contained in:
Maher 2025-04-11 22:13:38 -04:00 committed by GitHub
parent 40d7b2ec55
commit 81307bcb5c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 278 additions and 1 deletions

View file

@ -11,6 +11,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
## [Unreleased]
- Whitelisted [DuckDuckBot](https://duckduckgo.com/duckduckgo-help-pages/results/duckduckbot/) in botPolicies
- Improvements to build scripts to make them less independent of the build host
## v1.16.0