Tutorial: How to Create Robots.txt File¶

A user tutorial is available at serpwings pyrobotstxt tutorial page