Quantcast
Channel: DEVONtechnologies Community - Latest posts
Viewing all articles
Browse latest Browse all 17442

Most sites not searched with code "Disallowed"

$
0
0

I’m running my first DEVONAgent search in a while, and noticed I am getting almost no results for simple queries that should return tons. When I look at the log, almost every site DA tries to access returns “Disallowed.” WikiPedia, Github, Medium, all are returning disallowed. Is this something where nobody wants their site indexed by AI, and DEVONAgent is just getting caught up in it? Is there any way around this? Anyone else having this issue?


Viewing all articles
Browse latest Browse all 17442

Trending Articles