# +-------------------------------------------------------------------------+
# |                           BIBLIOTECAS.UTL.PT                            |
# +-------------------------------------------------------------------------+
# | This is the ROBOTS.TXT file for BIBLIOTECAS.UTL.PT                      |
# | This is meant for web robots (crawlers) only.                           |
# | If you are reading this, this is probably not what you are looking for. |
# | Please go to http://BIBLIOTECAS.UTL.PT instead.                         |
# | We welcome your visit.                                                  |
# | If you need assistance, please look in the contacts page on the site.   |
# | Thank you.                                                              |
# | (C) 2013, ULisboa.PT                                                    |
# +-------------------------------------------------------------------------+
# | This site is continually monitored by ULisboa.PT                        |
# +-------------------------------------------------------------------------+
# | Version history:                                                        |
# | * 2013-08-01 - Andy - Created ROBOTS.TXT                                |
# +-------------------------------------------------------------------------+


User-agent: Baiduspider
Disallow: /

User-agent: *
Crawl-delay: 120           # seconds of interval between requests
Request-rate: 1/120        # 1 request every 120 seconds