Projects/Lanvalia

Lanvalia is a small Web Crawler for research purposes.

User Agents

• Lanvalia/* (+http://soultcer.net/lanvalia/; Ruby/1.8.*)
• Mozilla/5.0 (compatible; Lanvalia; +http://soultcer.net/lanvalia) Gecko

Blocking

Lanvalia obeys the robots.txt exlusion standard to a certain point. Exclusion only works if you explicitly mention the name Lanvalia and exclude it from the root directory of your website.

Example robots.txt entry

User-Agent: Lanvalia

Disallow: /

Problems

If the bot is misbehaving, please contact me (don't forget to include access log or at least time, IP address and URL).