No description
Find a file
Jason Cameron 4184b42282
feat(og): Foward host header (#370)
* feat(ogtags): enhance target URL handling for OGTagCache, support Unix sockets

Closes: #323 #319
Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* docs: update CHANGELOG.md to include Opengraph passthrough support for Unix sockets

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* docs: update CHANGELOG.md to include Opengraph passthrough support for Unix sockets

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* feat(ogtags): add option to consider host in Open Graph tag cache key

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* feat(ogtags): add option to consider host in OG tag cache key

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* test(ogtags): enhance tests for OGTagCache with host consideration scenarios

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* refactor(ogtags): extract constants for HTTP timeout and max content length

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* refactor(ogtags): restore fetchHTMLDocument method for cache key generation

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* refactor(ogtags): replace maxContentLength field with constant and ensure HTTP scheme is set correctly

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

* fix(fetch): add proxy headers

Signed-off-by: Jason Cameron <git@jasoncameron.dev>

---------

Signed-off-by: Jason Cameron <git@jasoncameron.dev>
2025-04-29 08:20:04 -04:00
.github build(deps): bump the github-actions group with 4 updates (#387) 2025-04-28 01:40:38 +00:00
cmd feat(og): Foward host header (#370) 2025-04-29 08:20:04 -04:00
data Bump AI-robots.txt rules to version 1.29 (#383) 2025-04-27 20:52:08 -04:00
decaymap Add periodic cleanup job for DecayMap (#8) (#158) 2025-03-29 23:24:06 -04:00
docs feat(og): Foward host header (#370) 2025-04-29 08:20:04 -04:00
internal feat(og): Foward host header (#370) 2025-04-29 08:20:04 -04:00
lib feat(og): Foward host header (#370) 2025-04-29 08:20:04 -04:00
run Create Anubis FreeBSD rc.d script (#274) 2025-04-15 12:05:13 +00:00
test Add check endpoint which can be used with nginx' auth_request function (#266) 2025-04-25 17:38:02 +00:00
var initial import from /x/ monorepo 2025-03-17 19:33:07 -04:00
web Bump AI-robots.txt rules to version 1.29 (#383) 2025-04-27 20:52:08 -04:00
xess feat: add support for a base prefix (#294) 2025-04-25 14:39:38 -04:00
.air.toml feat: Add Open Graph tag support (#195) 2025-04-06 20:02:12 -04:00
.gitattributes Debug tool for benchmarking proof-of-work algorithms (#155) 2025-03-29 23:38:12 -04:00
.gitignore docs: fix edit me links and configuration subcategory (#238) 2025-04-07 17:28:29 -04:00
.ko.yaml Try using ko to build images 2025-03-19 09:10:29 -04:00
anubis.go feat: add support for a base prefix (#294) 2025-04-25 14:39:38 -04:00
Brewfile all: do not commit generated JS/CSS to source control (#148) 2025-03-28 14:55:25 -04:00
go.mod refactor(lib): Split up anubis.go into some smaller files. (#379) 2025-04-27 13:36:39 +00:00
go.sum refactor(lib): Split up anubis.go into some smaller files. (#379) 2025-04-27 13:36:39 +00:00
LICENSE initial import from /x/ monorepo 2025-03-17 19:33:07 -04:00
Makefile dev: Improvements to build scripts (#232) 2025-04-11 22:00:48 -04:00
package-lock.json build(deps-dev): bump esbuild from 0.25.2 to 0.25.3 in the npm group (#388) 2025-04-27 22:01:37 -04:00
package.json build(deps-dev): bump esbuild from 0.25.2 to 0.25.3 in the npm group (#388) 2025-04-27 22:01:37 -04:00
README.md README: Fix broken link to policy definition docs. (#380) 2025-04-27 13:33:41 +00:00
VERSION v1.17.0: Asahi sas Brutus 2025-04-27 15:16:25 -04:00
yeetfile.js feat: add support for a base prefix (#294) 2025-04-25 14:39:38 -04:00

Anubis

A smiling chibi dark-skinned anthro jackal with brown hair and tall ears looking victorious with a thumbs-up

enbyware GitHub Issues or Pull Requests by label GitHub go.mod Go version language count repo size

Sponsors

Anubis is brought to you by sponsors and donors like:

Distrust

Overview

Anubis weighs the soul of your connection using a proof-of-work challenge in order to protect upstream resources from scraper bots.

This program is designed to help protect the small internet from the endless storm of requests that flood in from AI companies. Anubis is as lightweight as possible to ensure that everyone can afford to protect the communities closest to them.

Anubis is a bit of a nuclear response. This will result in your website being blocked from smaller scrapers and may inhibit "good bots" like the Internet Archive. You can configure bot policy definitions to explicitly allowlist them and we are working on a curated set of "known good" bots to allow for a compromise between discoverability and uptime.

In most cases, you should not need this and can probably get by using Cloudflare to protect a given origin. However, for circumstances where you can't or won't use Cloudflare, Anubis is there for you.

If you want to try this out, connect to anubis.techaro.lol.

Support

If you run into any issues running Anubis, please open an issue. Please include all the information I would need to diagnose your issue.

For live chat, please join the Patreon and ask in the Patron discord in the channel #anubis.

Star History

Star History Chart

Packaging Status

Packaging status

Contributors

Made with contrib.rocks.