Explaining about Robots text

Robots text

A robots.txt file tells search engine crawlers which URLs the crawler can access on your site. This is used mainly to avoid overloading your site with requests; it is not a mechanism for keeping a web page out of Google. To keep a web page out of Google, block indexing with noindex or password-protect the page.

A robots.txt file is used primarily to manage crawler traffic to your site, and usually to keep a file off Google, depending on the file type:

The best robots.txt for Blogger depends on your specific goals and preferences. However, here are some common approaches:

Allow all crawling:

User-agent: *
Allow: /

This allows all search engines to crawl all pages on your Blogger blog.

Disallow specific directories:

User-agent: *
Disallow: /search
Disallow: /20*
Disallow: /feeds

This prevents search engines from crawling pages in the "search", "20*", and "feeds" directories.

Allow only HTML pages:

User-agent: *
Disallow: /
Allow: /*.html

This allows search engines to crawl only pages with a ".html" extension.

Completely block crawling:

User-agent: *
Disallow: /

This prevents all search engines from crawling any pages on your Blogger blog.

Additional considerations:

If you have a specific page or directory that you want to exclude from search engine indexing, you can add a "Disallow" rule for that page or directory.
If you have a sitemap, you can include the URL of your sitemap in your robots.txt file to help search engines find and index your content more efficiently.
You can use a tool like Google Search Console to test your robots.txt file and see how it is affecting your website's visibility in search results.

Ultimately, the best robots.txt for your Blogger blog will depend on your specific needs and goals. Experiment with different configurations to find the one that works best for you.

User-agent: *

Disallow: /search*

Disallow: /20*

Disallow: /feeds*

Allow: /*.html

The provided robots.txt file instructs search engines to:

Disallow crawling pages that start with "/search", "/20", and "/feeds".
Allow crawling pages that end with ".html".
Allow crawling all other pages.

This means that search engines will likely index pages on your website that have a ".html" extension, but they will avoid pages that start with "/search", "/20", or "/feeds".

If you want to prevent search engines from crawling any pages on your website, you can simply remove the "Allow: /*.html" line.

therefor this will be best

User-agent: Mediapartners-Google

Disallow:

User-agent: *

Disallow: /search*

Disallow: /20*

Disallow: /feeds*

Allow: /*.html

Sitemap: https://yoursite.blogspot.com/sitemap.xml

Sitemap: https://yoursite.blogspot.com/sitemap-pages.xml

Comments

Word to PDF Convertor

A Word document may be easily converted to a PDF file However, what happens if you need to convert a ton of Word files into PDFs? It will take a long time to open every file by hand and save it to PDF. You may quickly and easily convert large amounts of Word to PDF with the help of this method. And without utilizing any outside tools either. Ms. Word is all you need. Copy the following code into Notepad or Notepad++, then save the file as "PDF.js" in a folder var obj = new ActiveXObject("Scripting.FileSystemObject"); var docPath = WScript.Arguments(0); docPath = obj.GetAbsolutePathName(docPath); var pdfPath = docPath.replace(/\.doc[^.]*$/, ".pdf"); var objWord = null; try { objWord = new ActiveXObject("Word.Application"); objWord.Visible = false; var objDoc = objWord.Documents.Open(docPath); var format = 17; objDoc.SaveAs(pdfPath, format); objDoc.Close(); WScript.Echo("Saving '" + docPath + "'

BACKUPPC INSTALLATION AND CONFIGURATIONS

BACKUPPC INSTALLATION AND CONFIGURATIONS BackupPC is a backup solution that can be configured to back up remote Linux and Windows systems. It can use a variety of different protocols and has a flexible scheduler to coordinate full and incremental backups. I have installed this on ubutnu 14.04 LTS and its running fine for me for a long time since the installation Open a terminal and enter the following commands: sudo apt-get update sudo apt-get install backuppc During the installation, you will be asked what kind of mail server configuration is needed. We can select the "Local only" option, because we will not be configuring internet-aware mail ???????? Postfix Configuration ????????? ? General type of mail configuration: ? ? ? ? No configuration ? ? Internet Site ? ? Internet wi

Flash For EVONY 2021

Flash is now officially dead. with this way you can still use Flash. if you have any problem while installing or working on this please feel free to contact me to help you first we have to go to pale moon https://www.palemoon.org/ Download and install PaleMoon then lets go to adobe archive page https://web.archive.org/web/20200630185339/https://helpx.adobe.com/flash-player/kb/archived-flash-player-versions.html go to bottom of the page until you find the Flash Player archives this site is little bit slower than others Download this version,after May it is not working (Released 5/12/2020) Flash Player 32.0.0.371 (425 MB) https://web.archive.org/web/20200630185339/https://fpdownload.macromedia.com/pub/flashplayer/installers/archive/fp_32.0.0.371_archive.zip Unzip the archive and install the flash player for windows, Goto control panel and find the flash adon there Click on never check for updates then open your c drive and search where adobe is get installed. in here i am usi

pc support

Search This Blog