MatrixAdapt | Logiciel de gestion d'Entreprise, Création et référencement des sites web

Suppose you want to buy somthing online or you need to get some information from internet related any topic you want, then what will you do ? You will deffinetily go to search engine and try to find related information.

Now think you got all information from world wide web through the search engine but did you think how search enginge put all desired search in front of your eyes. read the following article to know this.

Search engines consist of five discrete software components:


Spider : A search engine program that downloads webpages.
Spider, also called a robot or a crawler, is actually the only program that will follow, or "crawls", links to the Internet, grabbing the content of sites, and adding it to the search engine indexes.

The spiders can follow links from one page to another and from one place to another. This is the main reason why links to your site (inbound links) is so important. Links to your site from other Web sites provide search engines more "food" to chew. The more times they find links to your site, the more times they'll stop and visit. Google is based in particular on its spiders index their lists to create enormous.

Spiders find Web pages by following links to other Web pages, but you can also send web pages directly from a search engine or directory, and ask them to visit the spider. In fact, it's a good idea to send manually edited directories like Yahoo, and usually spiders from other search engines (like Google) to find and add it to the database. It may be useful to submit your URL directly to the different search engines, as well, but Spider-based engines usually pick up on the site, regardless of whether you have sent the search engine.

Crawler : A wandering spider that automatically follows links found on pages.
Component of search engine that gather listings by automatically “crawling” the web. A search engine’s crawler (also called a spider or robot), follows links to web pages. It makes copies of the web pages found and stores these in the search engine’s index.

Indexer : A blender like program that dissects webpages that are downloaded by spiders.
An indexer rips apart a page into it's various components and analyze them. Entities such as, titles, headings, links, text, constructs, bold, italic, and other style portions of a page are ripped apart and analyzed.

The database : A warehouse of the pages downloaded and processed.
The database is the storage medium for all the data a search engine downloads and analyzes. This can require huge amounts of storage space.

Search engine results engine : Digs search results out of the database.

Ah, the heart of the beast. It is the results engine's job to decide what pages matches a users search. This is the portion of a search engine you interact with when you perform a search. It is also the one part we are concerned with here.

When a user types in a keyword and does a search, the search engine decides what to match for results under varying criteria. The means with which it decides is called an algorithm. You may hear search engine optimization (SEO) professionals discuss "algos" from time to time and this is what they are referring too.

-->
-->

Configure mobile sites so that they can be indexed accurately:

It seems the world is going mobile, with many people using mobile phones on a daily basis, and a large user base searching on Google’s mobile search page. However, as a webmaster, running a mobile site and tapping into the mobile search audience isn't easy. Mobile sites not only use a different format from normal desktop sites, but the management methods and expertise required are also quite different. This results in a variety of new challenges. While many mobile sites were designed with mobile viewing in mind, they weren’t designed to be search friendly.


Here are troubleshooting tips to help ensure that your site is properly crawled and indexed:

If your web site doesn't show up in the results of a Google mobile search even using the site: operator, it may be that your site has one or both of the following issues:

1. Googlebot may not be able to find your site
Googlebot must crawl your site before it can be included in our search index. If you just created the site, we may not yet be aware of it. If that's the case, create a Mobile Sitemap and submit it to Google to inform us of the site’s existence. A Mobile Sitemap can be submitted using Google Webmaster Tools, just like a standard Sitemap.


2. Googlebot may not be able to access your site
Some mobile sites refuse access to anything but mobile phones, making it impossible for Googlebot to access the site, and therefore making the site unsearchable. Our crawler for mobile sites is "Googlebot-Mobile". If you'd like your site crawled, please allow any User-agent including "Googlebot-Mobile" to access your site (). You should also be aware that Google may change its User-agent information at any time without notice, so we don't recommend checking whether the User-agent exactly matches "Googlebot-Mobile" (the current User-agent). Instead, check whether the User-agent header contains the string "Googlebot-Mobile". You can also use DNS Lookups to verify Googlebot.


Verify that Google can recognize your mobile URLs

Once Googlebot-Mobile crawls your URLs, we then check for whether each URL is viewable on a mobile device. Pages we determine aren't viewable on a mobile phone won't be included in our mobile site index (although they may be included in the regular web index). This determination is based on a variety of factors, one of which is the "DTD (Doc Type Definition)" declaration. Check that your mobile-friendly URLs' DTD declaration is in an appropriate mobile format such as XHTML Mobile or Compact HTML (). If it's in a compatible format, the page is eligible for the mobile search index.