forked from Lainports/opnsense-ports
Taken from: https://github.com/freebsd/freebsd-ports.git Commit id: 5070672073b68be364139bc6b3a89100bd17d331
4 lines
161 B
Text
4 lines
161 B
Text
HTML::RobotsMETA is a simple HTML::Parser subclass
|
|
that extracts robots exclusion information from meta tags.
|
|
|
|
WWW: http://search.cpan.org/dist/HTML-RobotsMETA/
|