Perplexity has some proper documentation available for their crawlers, with published IP addresses: https://docs.perplexity.ai/guides/bots. Signed-off-by: Timon de Groot <timon.degroot@team.blue> |
||
|---|---|---|
| .. | ||
| ai-block-aggressive.yaml | ||
| ai-block-moderate.yaml | ||
| ai-block-permissive.yaml | ||
| default-config.yaml | ||
| messengers-preview.yaml | ||
| README.md | ||
meta policies
Contains policies that exclusively reference policies in multiple other data folders.
Akin to "stances" that the administrator can take, with reference to various topics, such as AI/LLM systems.