sophie/nuke
1
0
Fork 0
Code Packages 1 Activity Actions

fix(robots2policy): handle multiple user agents under one block (#925)

Browse source
This commit is contained in:
Jason Cameron 2025-09-06 22:35:19 -04:00 • committed by GitHub
parent 87c2f1e0e6
commit 82099d9e05
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 208 additions and 58 deletions
Download patch file Download diff file Expand all files Collapse all files

6
cmd/robots2policy/testdata/blacklist.yaml vendored
View file

@ -25,6 +25,6 @@
- action: CHALLENGE
expression:
all:
- userAgent.contains("Googlebot")
- path.startsWith("/search")
name: robots-txt-policy-disallow-7
- userAgent.contains("Googlebot")
- path.startsWith("/search")
name: robots-txt-policy-disallow-7