English
  • English
  • हिन्दी
  • বাংলা
  • తెలుగు
  • தமிழ்
  • ಕನ್ನಡ
  • मराठी
  • മലയാളം
  • ଓଡିଆ
  • ગુજરાતી
  • ਪੰਜਾਬੀ
  • অসমীয়া
  • اردو

What is Search Engine Crawling and Indexing ?

If you are a blogger or a Digital Marketer you might have heard these words Crawling and Indexing.If you are a beginner then better you read it carefully.

As a digital marketing consultant  i have seen many people struggling with this question even after spending a significant amount of time in the industry.

Well we all are going to get the answer.

If you are a blogger or a Digital Marketer you might have heard these words Crawling and Indexing.

If you are a beginner then better you read it carefully.

This is the first thing you should understand in order to learn SEO. It will give you a clear Picture of how Search Engines work.

Crawling and Indexing Digital Marketing Consultant Amit Dadhich

What is Crawling?

Google's Spider/Crawlers (A kind of Software Google uses like Googlebot ) visit web pages to find the information. These crawlers will crawl all webpages and follow links on those pages. They go to each follow link like we do in order to gather the information and they bring data to Google's server about those webpages.

Crawling begins with the past crawls and the sitemap given by web masters or website owners in the past. That is why we need to submit the site maps.

These Google Crawlers pay more attention to new sites, new web pages, changes in existing sites, follow links and dead links.

However we can stop crawlers from crawling some web content and pages by modifying Robots.txt file.


What is Indexing?

When we say Google Indexing, it means that Google Organizes Information what it has gathered from crawling the web pages. Depending upon Meta Tags, Titles, Keywords, Index and no-index status in Robots.txt file Google adds webpages into search results. Goolge index includes information about words and their locations. When you search something Google fetches information from this organized library.


It is the Basic information you should have while start learning SEO or Digital Marketing to get an idea how should you think while learning or adding meta tags to any website.

The advanced knowledge about Google Crawling and Indexing and Robots.txt file will be shared in one of my upcoming blogs.

My next blog post will be How to Learn SEO in 2017?

It will be a post guiding you about best practices in order to learn white hat seo in 2017.

This is a YourStory community post, written by one of our readers.The images and content in this post belong to their respective owners. If you feel that any content posted here is a violation of your copyright, please write to us at mystory@yourstory.com and we will take it down. There has been no commercial exchange by YourStory for the publication of this article.

Stories by amit dadhich