opnsense-ports/www/p5-HTML-RobotsMETA/pkg-descr
Franco Fichtner 8fd0623a7c */*: sync with upstream
Taken from: HardenedBSD
2018-05-28 08:06:42 +02:00

4 lines
161 B
Text

HTML::RobotsMETA is a simple HTML::Parser subclass
that extracts robots exclusion information from meta tags.
WWW: https://metacpan.org/release/HTML-RobotsMETA