Which search engines are international. Internet search engines: an overview of existing solutions

Total

Introduction

Few people now can imagine the Internet without search, search results and organizing all this information search engines (ISS). But until recently, all the information on the Internet fit into several directories, the name of which is still on hearing (DMOZ, Yahoo).

Today, the amount of information on the Internet is so huge that it is not possible to fit it into any catalogs. For processing, storing information, organizing search, powerful software products that we call search engines (SE) have been created and continue to be created. Each search engine (search engine) has its own databases, its algorithms for processing, searching, ranking and issuing information.

Internet search engines are

You can give the following academic definition to search engines. A search engine is a set of programs and technical means for organizing a user search on the Internet, in which, upon a text query, the user receives a list of relevant (corresponding to the query) results.

Issuance is made in the form of a list of links to a source of information with a short description (preview), sometimes with a photo.

For the first example, let us recall the world leader of search "Google" and the leader of Runet, the search engine "Yandex". In addition to these search engines, you can name a dozen more existing search engines, which we will talk about below.

Opinion: Search engines Google, Yandex and others are not generators (producers) of content, but aggregators (accumulators) of content and, in the bulk, other people's content. It is worth remembering that the use of someone else's content to create your own traffic and monetize it can be characterized as "piracy", which, of course, does not happen in practice.

Rating

• and Google share the first two places of the leaders: about 49% and 45%.
• Third place: Search Mail.ru about 3%;
• The rest of the search engines float below 1%.

Looking at Google Analytics statistics:

• yandex / organic 40.26%
• google / organic 38.93%
• mail.ru / organic 0.60%
• rambler / organic 0.52%
• bing / organic 0.12%

The statistics are relentless: Yandex searches are used the most, and if we consider that 3% is a good result compared to 45%, then the third most popular search is Mail.ru.

In this regard, the reasoning about the popularity of search engines other than Yandex and Google can be attributed to superstition, and the special promotion of sites in other search engines (not Yandex and Google) that do not deserve attention.

How search engines work

The question of how search engines work is as general as the question of "what color is the sky." If the sky is blue, then search engines collect information on the Internet, process it, rank it and give it to the user according to the search query.

The theory of Internet search is much more voluminous and cannot be stated in the article. However, the main points will come in handy:

Internet search engines do not store documents, that is, they do not download and upload documents completely to their repositories;

IRS use the Internet as a decentralized repository of documents. Search engines periodically crawl the Internet, select the information they need, according to their algorithms, and partially place it (information) in my database (Database). Hence, there are several problems:

• IRS does not use all the information on the Internet for issuing, but only a part;
• Internet information changes frequently. About 1500 thousand pages are added per day, hence the possible "empty issue";
• There are a large number of duplicates (duplicate content). Unfortunately, I do not have accurate data on takes, and the figure of 25% of takes seems to be overstated;
• A lot of advertisements, which are also bypassed by search engines;
• The "wandering" of search robots in the network multiplies the load of non-resources (does not apply to search engines);
• Most of the sites are commercial (about 83%), and have little informative value.

For these and some other reasons, the overwhelming majority of ISS on the Internet use a search engine, rather than the classical search scheme for information classification.

Keyword search features

Despite the changing algorithms of search engines, whose advertising tries to convince us that machines are becoming smarter and more intelligent, keyword searches are at the heart of search engines.

I like this keyword search scheme.

As you can see, the work of Internet search engines is based on the search for new documents (search robot Spider + Crawler), indexing of discovered documents (Indexer) and execution of a user query (Search Engine Results Engine). The names of the search robots used for these purposes are listed in brackets.

As I said, most search engines do not copy the full text of documents into their database. For search, when indexing a document, its search image is created. To organize the search by, the indexing robot creates a document image using the so-called derived method. That is, the title and a set of keywords are indicated in the image of the document.

However, it can be argued quite accurately that all IRS pay attention to the following:

• The presence of the keyword in