PHP Classes

File: www/robots.txt

Recommend this page to a friend!
  Classes of Fernando Val   Springy   www/robots.txt   Download  
File: www/robots.txt
Role: Documentation
Content type: text/plain
Description: Documentation
Class: Springy
Microframework for Web application development
Author: By
Last change:
Date: 8 years ago
Size: 147 bytes
 

Contents

Class file image Download
User-agent: * #Request-rate: 10/5 # maximum rate is 10 pages every 5 seconds #Crawl-delay: 0.1 # 100ms entre uma pagina e outra