This is a user generated content for MyStory, a YourStory initiative to enable its community to contribute and have their voices heard. The views and writings here reflect that of the author and not of YourStory.

What is Search Engine Crawling and Indexing ?

If you are a blogger or a Digital Marketer you might have heard these words Crawling and Indexing.If you are a beginner then better you read it carefully.

amit dadhich 5 Stories

Tuesday October 03, 2017,

2 min Read

As a digital marketing consultant i have seen many people struggling with this question even after spending a significant amount of time in the industry.

Well we all are going to get the answer.

If you are a blogger or a Digital Marketer you might have heard these words Crawling and Indexing.

If you are a beginner then better you read it carefully.

This is the first thing you should understand in order to learn SEO. It will give you a clear Picture of how Search Engines work.

undefined

What is Crawling?

Google's Spider/Crawlers (A kind of Software Google uses like Googlebot ) visit web pages to find the information. These crawlers will crawl all webpages and follow links on those pages. They go to each follow link like we do in order to gather the information and they bring data to Google's server about those webpages.

Crawling begins with the past crawls and the sitemap given by web masters or website owners in the past. That is why we need to submit the site maps.

These Google Crawlers pay more attention to new sites, new web pages, changes in existing sites, follow links and dead links.

However we can stop crawlers from crawling some web content and pages by modifying Robots.txt file.

undefined

What is Indexing?

When we say Google Indexing, it means that Google Organizes Information what it has gathered from crawling the web pages. Depending upon Meta Tags, Titles, Keywords, Index and no-index status in Robots.txt file Google adds webpages into search results. Goolge index includes information about words and their locations. When you search something Google fetches information from this organized library.

undefined

It is the Basic information you should have while start learning SEO or Digital Marketing to get an idea how should you think while learning or adding meta tags to any website.

The advanced knowledge about Google Crawling and Indexing and Robots.txt file will be shared in one of my upcoming blogs.

My next blog post will be How to Learn SEO in 2017?

It will be a post guiding you about best practices in order to learn white hat seo in 2017.