Just about once a day something Juniper Networks has been playing with comes and asks for a page or two and goes away. Never asks for robots.txt or anything like that so no clue if it's a crawler or what.
18.104.22.168Perhaps it goes away when the user agent is blocked and it gets the "go away you're bothering me" page, but it will come back again and again and has been doing so for months.
If anyone from Juniper wants to comment on what in the hell your "security lab" is doing, perhaps I'll let it pass thru if it's a worthy cause. However, considering they aren't even bright enough to change the default user agent, forget that last thought, we'll just keep blocking it.