pyrobotstx feature image

pyrobotstxt - A Python Package for robots.txt Files

pyrobotstxt package can be used to (systematically) generate robots.txt files. Moreover, this package comes in handy for creating and including ASCII images in robots.txt files.

In future releases, it would be possible to parse, analyze and manipulate robots.txt file generated using any software (not limited to pyrobotstxt)

Whats in pyrobotstxt?

We believe in monolithic software development and created this tiny package that does its job without any bloat. It is useful for

  • Createing robots.txt File
  • Parsing a robots.txt File [in progress]
  • Analyzing robots.txt File [in progress]

How to Use pyrobotstxt?

You can follow our basic user tutorial on how to use this library.

If you are a developer or want to test latest version of pyrobotstxt, you might find information on our developers section useful.

About Us

SERP Wings is a digital organization which develops software solutions to Boosting SERP Performance Though Opensource Tools.

seowings is an opensource project to write, develop and promote tools for Data Sciences and Digital Marketing.