AIOSEO Blog

WordPress Tutorials, Tips, and Resources to Help Grow Your Business

wordpress-multisite

New Robots.txt module with Multisite Network support

Updated on Written By: author image Steve Mortiboy
author image Steve Mortiboy
Steve has over 25 years of project management and service delivery experience. He started his career in defense communications before moving to the British Ministry of Defence where he worked for the British Army. For the past 15 years, Steve has worked in IT, managing large projects and enterprise clients. Recently he has worked with entrepreneurs and small businesses helping them to meet the needs of their growing client base. A recent immigrant from England, he brings some international flavor to the team.
See Full Bio
Reviewed By: Ben Rojas
reviewer image Ben Rojas
Ben Rojas is an expert WordPress developer and the President of All in One SEO (AIOSEO). With a robust foundation in the IT sector spanning over 25 years, Ben has developed a profound expertise in technology and digital landscapes.
See Full Bio
LinkedIn

Missed the release notes for All in One SEO Pack v2.7? Then you may not be aware that we've completely overhauled the Robots.txt module.  Here's what's new!

Prior to All in One SEO Pack v2.7, the robots.txt file was output as a physical file on your web server.  However, WordPress creates a dynamic virtual robots.txt file, which is always preferred over a physical file.  The overhaul of the Robots.txt module meant that we could remove support for physical files entirely and instead use the dynamic virtual file that WordPress creates.  This has two benefits:

  1. Rules that are added to the robots.txt file are stored in the database.
  2. The default rules created by WordPress are used by All in One SEO Pack.

In addition to switching from a physical file to a virtual file, we also overhauled the user interface.  We kept the easy-to-use rule builder and added a table that displays your custom rules.

Adding a rule to your robots.txt

The new Robots.txt module now also supports WordPress Multisite Networks.  There's a new Robots.txt Editor in the Network Admin panel that enables Network Administrators to set global rules.  These global rules are used by all sites in the network and cannot be overridden at site level.

Robots.txt Editor in Network Admin

The new Robots.txt module is a big improvement for both site administrators and network administrators of large multisite installations.  It continues our commitment to deliver the best possible SEO tools to you so you can effectively manage your own SEO.

If you'd like to learn more, then we highly recommend you to check out our documentation on the new Robots.txt module and Network Admin Robots.txt Editor:

Disclosure: Our content is reader-supported. This means if you click on some of our links, then we may earn a commission. We only recommend products that we believe will add value to our readers.

author avatar
Steve Mortiboy
Steve has over 25 years of project management and service delivery experience. He started his career in defense communications before moving to the British Ministry of Defence where he worked for the British Army. For the past 15 years, Steve has worked in IT, managing large projects and enterprise clients. Recently he has worked with entrepreneurs and small businesses helping them to meet the needs of their growing client base. A recent immigrant from England, he brings some international flavor to the team.
See Full Bio
SEO WordPress
social network icon

Add a Comment

We're glad you have chosen to leave a comment. Please keep in mind that all comments are moderated according to our privacy policy, and all links are nofollow. Do NOT use keywords in the name field. Let's have a personal and meaningful conversation.

12 comments on “New Robots.txt module with Multisite Network support”

  1. Is this new txt robot only suitable for All in One SEO Pack, can it be used for other seo plugins like yoast seo or platinum seo pack

    Reply

    1. It is literally a part of AIOSEOP, so I wouldn’t recommend using it at the same time as another SEO plugin. Also, you should be aware that “Platinum SEO Pack” is nothing more than a rip/fork of All in One SEO Pack from 8 or 9 years ago and hasn’t been updated in many many years. I’m a bit curious where you even discovered it?

      Reply

  4. I’m working on SEO for my site currently and I’m thinking I may have to try out this All-In-One SEO plugin.

    Reply

  5. All in One SEO plugin always best for me. Because this plugin have multiple features for easily manage your SEO work in one place.

    Thank you for the post!

    Reply

  6. What about this one ?

    User-Agent: *
    Allow: /?display=wide
    Allow: /wp-content/uploads/
    Disallow: /wp-content/plugins/
    Disallow: /readme.html
    Disallow: /refer/

    Reply