## take out specific bot ##
User-agent: mj12bot
User-agent: magpie-crawler
User-agent: ezooms
User-agent: hopperbot
User-agent: HuaweiSymantecSpider
User-agent: shopwiki
User-agent: procogbot
User-agent: mlbot
User-agent: EMail Exractor
User-agent: Python-urllib
User-agent: Apache-HttpClient
Disallow: /

## general ##
User-agent: *
Disallow: /SmartPoll/
Disallow: /cgi-bin/
Disallow: /printer/
Disallow: /js/
Disallow: /Scripts/
Disallow: /styles/

Sitemap: http://www.smarttravelasia.com/sitemap.xml