Tutorial: How to Create Robots.txt File

A user tutorial is available at serpwings pyrobotstxt tutorial page