👉 👉 DOWNLOAD AIOSEO HERE: [ Ссылка ]
Are you looking to create and edit a robots.txt file on your WordPress website? This video will walk you through the steps to do just that.
To get started editing your robots.txt file, click on Tools in the All in One SEO menu, and then click on the Robots.txt Editor tab.
AIOSEO will then generate a dynamic robots.txt file. Its content is stored in your WordPress database and can be viewed in your web browser as we’ll show you in a bit.
Once you’ve entered the Robots.txt Editor, you need to Enable Custom Robots.txt.
Click on the button so it turns blue.
You’ll then see the Robots.txt Preview section at the bottom of the screen, which shows the WordPress default rules that you can overwrite with your own.
The default rules tell robots not to crawl your core WordPress files (admin pages). It’s also recommended to not crawl plugins and themes. They don’t include any relevant content and are unnecessary for search engines to crawl.
Now, let’s move on to how you can add your own rules using the rule builder.
Adding Rules Using the Rule Builder.
The rule builder is used to add your own custom rules for what pages the robots should crawl or not.
For instance, if you’d like to add a rule that blocks all robots from a temp directory (meaning a temporary folder on for example a hard drive), you can use the rule builder to do this.
To add a custom rule, simply enter the User Agent (for example Googlebot crawler) in the User Agent field. Or you can use the * symbol that will make your rule apply to all user agents (robots).
Next, select either Allow or Disallow to allow or block the User Agent.
After you’ve decided what bots to allow or disallow, you need to enter the directory path or filename in the Directory Path field.
Once this is done, you can go ahead and click the Save Changes button in the right bottom corner of the page. And if you want to add more rules, you can click the Add Rule button and repeat the steps above.
Don’t forget to save your changes when you’re done.
Anyway, when you’ve saved your new rules, they’ll appear in the Robots.txt Preview section.
To view your robots.txt file, you simply click on the Open Robots.txt button.
Now, let’s take a look at how you can edit your rules next. To edit your rules, you can just change the details in the rule builder and click on the Save Changes button.
It’s very easy! And so is deleting rules like we’ll show you next. To delete a rule, simply click the trash can icon to the right of the rule. It's simple as that!
All in One SEO is the best WordPress SEO plugin that allows you to easily optimize your WordPress website for search engines and social media platforms.
Grab Your Copy Of All In One SEO Here:
=================================
[ Ссылка ]
=================================
Timestamps:
00:00 - Intro
00:15 - The Robots.txt Editor
00:47 - Enabling Customs Robots.txt file
01:01 - Add Rules
01:38 - Edit Rules
02:09 - Delete Rules
02:33 - Preview robots.txt file
02:45 - Outro
=================================
You can read more information on how to create and edit a robots.txt file in WordPress here:
[ Ссылка ]
=================================
Please subscribe to this channel for more WordPress SEO tutorials:
[ Ссылка ]
