How to cancel the inclusion of a web page after it has been included

Create a file and upload it to the root directory.

The file reads:

user-agent: *

allow: /

disallow: /dir_name/

disallow: /file_

Note: dir name is the directory name, that is, you don't want the included directory and the files under it to be blocked.

file name is the file name that you don't want to include, so be careful to add a path!

You can add a noindex tag to the page or block it in, or simply delete the page and cancel the inclusion of the page when it is updated again.

Actually, just write it in robots, if you don't want to include your web page, please set it this way.

user-agent: baiduspider This one is for spiders, restricting it from crawling your page only works.

disallow: You can write your restriction directory name or file name here, and the few digits upstairs are for all engines.

Hope it helps you a little thanks.

a.The web page does a lot of things that are targeted at the search engine rather than the user, so that the user sees something completely different from the actual content of the page, or causes the page to be inappropriately ranked in the search results, which can lead to the user feeling cheated.

If you have a lot of these pages in your website, this may affect the inclusion and sorting of your entire page.

b.Web pages are highly repetitive content copied from the internet.

c.The webpage contains content that does not comply with Chinese laws and regulations.

Anything that has been completely corrected** has a chance to be re-inscribed. Processed sites are automatically evaluated on a regular basis, and those who meet the criteria are re-inducted.

a.If I become an advertiser or affiliate**, I can be re-inducted.

b.I give a few bills and they can be re-included.

c.Someone I know, you can be re-included.

You can take a closer look at the following to see if your**meet the inclusion requirements,If the robot likes you**, it will definitely include you,If there is something that doesn't work, you have to hurry up and correct it:

A guide to building a website for webmasters:

How to make your site effectively indexed.

Add a title to each page that is relevant to the body of the text. If it is the first homepage, it is recommended to use the name of the site or the name of the company represented by the site; For the rest of the content pages, the title is recommended to be a refinement and summary of the content of the main text. This allows your potential users to quickly access your page.

Make sure that each page is reachable with a single text link. If the links in the flash cannot be recognized, the links on these units point to the web pages that cannot be included.

Use plain hyperlinks instead of redirects for links between pages. Pages that use auto-redirects may be discarded.

Use frame and iframe structures sparingly.

If it's a dynamic page, control the number of parameters and the length of the URL. Prefer to include static web pages.

On the same page, don't have too many links. On those sitemap-type pages, link to the important content, not all the details. Too many links may also result in not being included.

What kind of site will be welcomed.

Sites should be user-oriented, not search engine-oriented. A site that is popular with users will eventually be welcomed by search engines as well; On the other hand, if your site does a lot of optimization, but it brings a lot of negative experiences to users, then your site may still end up being left out in the cold.

Prefer web pages with unique content rather than simply plagiarizing and repeating what is already on the internet. Content that has been repeated thousands of times may not be included.

Please use your sitelinks sparingly. Linking to some spam sites is likely to negatively affect your. So, when someone is very enthusiastic about asking you to provide a link to their site, look at the following two points:

First, is the other party's site of high quality in his field? Many of the so-called traffic and rankings among webmasters are obtained by deception and cannot be maintained for a long time.

Second, is the link name requested by the other party commensurate with the other party's ** status? Using a broad keyword to make a link name with very limited content is likely to negatively impact yours.

Keep your content updated frequently. Sites that often generate new content are noticed and strongly welcomed, and will be visited frequently.

Spider crawling is prohibited.

**Content plagiarism, which already includes a large amount of the same content.

** Spiders are blocked by a server error setting.

**The structure is not set up reasonably, resulting in the spider being unable to crawl normally.

2.Ensure the originality of the content of the article, and at the same time submit it to the initiative to promote spider crawling and inclusion.

3.Check and adjust the ** structure.

It's hard to get free now, and you generally have to charge promotion fees.

You know,、Google and other search engines have a deep suspicion of the new submission**,Generally, there is a 1-3 month examination period,Often the same search engine is different for different new sites,Or it is not included for a long time,Or after the inclusion of a considerable period of time the inclusion has not increased、The snapshot is stagnant,And even some began to include the situation is unimaginably good,But after some time it fell again,There are only dozens of inclusions left,The above situation is normal。 Why would search engines be skeptical of new sites? Handan Construction believes that doing it is a long-term and protracted process, and the search engine must be responsible for its own users, so it is normal to think about it.

Therefore, your ** should be in the investigation period, so what should we do at this time, first of all, we must insist on updating**, the content is best original, and if there is no originality, then pseudo-originality can also be; In addition, you need to add some internal and external links to guide search engine indexing, I believe that it will take a long time to count, and your ** will be included. Remember, the most important thing to do is to be consistent!

If it's a new site, as I said upstairs, I'll update the article every day after submitting **, waiting to be included. If it's not a new site, if the previous inclusion was normal and suddenly not included, then there may be many reasons why the inclusion is not normal:

Below I will list a few possibilities for occurrence:

1.The article has not been updated for a long time, resulting in crawlers not thinking that your site has not been updated for a long time, and over time they don't like to come over.

2.Do you add a friend chain that is k**, so that your station is also affected.

3.Suddenly add a lot of backlinks, thinking that you have the possibility of cheating, so k your site.

4.There is also a recent adjustment, which will be normal after a while, don't worry.

The above is the situation that my station encountered before, there may be other situations, in short, check what is the difference between your station and the previous one, and what has been added, which may lead to such a problem.

There are several reasons for discontinuing the collection:

1 Test of the new station. Because it is a new station, the trust that has not been gained needs to be judged and tested for a period of time.

2 **Excessive collection in a short period of time. Because Baidu Spider is tired of the thousands of funny reply systems on the Internet.

3 The content of the article is pseudo-original and has no value. Due to excessive pseudo-originality, the article is not readable, completely worthless, and is discarded.

4 Setting incorrectly, prohibiting spider crawling.

5. The server is unstable or the program contains viruses.

Solution:

1 If most of the logs appear 200 0 64, including user access requirements and other search spider access, then you can conclude that there is a problem with the server, and you can change to a stable space.

2 If other spiders in the log access are normal but no spiders appear, it means that we should check the ** article to see if the article is collected or has no value, so as to dig up new and valuable original articles.

3 If the log shows that there are a lot of baiduspider coming, but the inner page is not crawled, it can be concluded that ** is in the assessment period and needs to update high-quality articles to wait for the assessment to pass.

Let's talk about them one by one. One. The quality of the article is low The article you send, whether it is original, or pseudo-original, or direct, I believe that there are many webmasters who like other people's articles, resulting in a large number of repetitive content on the Internet, and the server capacity of the search engine is only 50 billion pages.

Spiders crawl about 200 million web pages every day, and if they find that the quality is not good, or if they are too repetitive, they will be deleted. In order to avoid this, everyone tries to do some original articles. It can increase your writing skills and produce high-quality essays, so why not.

Two. The relevance of the article and the topic is poor A** has a center, that is**The keywords made, as well as the fixed target customers, should be sent in your ** Some useful articles for your target customers, relevant articles, if you are selling electrical appliances, there are a lot of things that have nothing to do with electrical appliances in the store, take these irrelevant things, customers will have no interest in them, and they will be excluded by search engines. Therefore, let's do it, not only to make original articles, but also to do articles with strong physical characteristics in our own habits, so that we can develop healthily and for a long time.

Three. **Poor trust,Or in the assessment period of the new station Generally, the new station often appears today to include 10 articles,Tomorrow a check on the base liquid 5 included,For the new station often appears,This new station period,That is, within three months**,It is a new station,Within three months, there will be an observation period,**Layout and keywords,Title, etc., There will be changes or updates, so the credibility is not high, and after three months, it will tend to be stable, so during the new station, You should try your best to make high-quality articles, and ensure that you have continuous and regular updates, so that your trust will continue to increase.