Search Engines

Webmaster Tools: Feature Request for Bulk Deletion of URLs

Most webmasters use Google Webmaster Tools (GWT) to submit their URLs to Google. Yahoo had a similar product – Site Explorer and Microsoft too has one. GWT by far is the best and is far ahead of the so-called competitors.

GWT gives a good insight into what Google sees in your site. They have a module for deletion of URLs (individual pages, directories and entire site). And Google deletes them within 24 hours.

You can submit URLs in bulk by submitting your sitemap but don’t have any means to delete multiple URLs in one shot 🙁 Very painful.

GWT gives a very good report of the dead URLs (404). All they had to do was to allow the webmaster to select the URLs in that report (checkbox) and hit a “Delete Now” submit button. That’s it. I am sure every webmaster would welcome that feature.

Deleting Via Robots.txt

Yes, one can delete URLs through robots.txt but I have found it more useful to block search engines from crawling those listed URLs. It takes forever to remove the URLs from Google’s index (via robots.txt route) and you don’t receive any sort of confirmation after the URLs are deleted.

BG Mahesh

Internet application ideator and implementor. Been there and done that since early 1990s. I like to present data to the common man in the simplest manner on the internet.

Recent Posts

How DIGIPIN Can Gain Mass Adoption in India

In India, addresses have always been quirky — full of old door numbers, floating landmarks,…

1 month ago

September 2 observed as Account Aggregator Foundation Day

The RBI announced the AA Master Directions on 2nd September 2016, and under the leadership of Shri…

2 months ago

From Entropy to Negentropy: The Transformative Power of Open Finance- Part I

We live in a world awash with digital transformation, and yet filled with painful and…

2 years ago

Brand recall of the WiFi logo in India is very strong

It is a well-known fact that branding plays a significant role in the success of…

2 years ago

Fixing the Visa application process with Consent Managers

Lately I have been coming across the frustrations faced in the visa application process. Earlier,…

3 years ago

How India can solve the Challenges in Digital Advertising starting in 2023

India has the second-largest online population. The rapid Internet access and mobile proliferation is the…

3 years ago