How Do I View Spider Access Logs? 5

Server Event Viewer log file:

microsoft-windows-forwarding/operational

System security.

microsoft-windows-fo

internet explorer

Use the FTP tool to log in to the server and view the logs.

There is a logs folder in the root directory of the server, which contains **logs, and the extension of the log file is log. You can view the log file by opening it with a Windows text tool.

If you need to view access statistics, you can use or a statistical tool directly, but if you want to check whether the spiders of each search engine crawl their own on time, then look at the log file.

Use the ftp tool to log in to the server, there is a logs folder under the root directory of the server, which contains **logs, and the extension of the log file is log. You can view the log file by opening it with a Windows text tool.

**Log,It is a text record automatically generated by the server,Detailed records**Access details,If the webmaster needs to view access statistics,Then use or statistical tools on it,But if you want to check whether the spiders of the search engine crawl their own on time**,Then you have to learn to check the log file yourself。

For many novices who do **, they have not been systematically taught to learn network technology and website building knowledge, and they all rely on self-study, and they will not know how to optimize when they encounter problems. Two days ago, I saw a lot of people post questions, but the replyer's answer is more concise, not specific, the questioner is still in the clouds, and now I will systematically operate it once with my own **, and submit it to you for reference.

1. Open the ftp login software, I use flashfxp, login space ftp

After logging in to FTP, you will find that there is a wwwlogs folder in the root directory, (some are weblog, note: the log file directory names generated by different server spaces are different, for reference only, the log folder containing log characters in the general folder is the log folder).

2. After opening the wwwlogs folder, there are some file names with date format features. gz suffix end files, these are the log files we need to ** to the local one.

3. **After going to the computer desktop, unzip and open it, inside is a notepad format file, open the file, and see the following picture**, I** is the file on March 7th.

4. Analysis**.

Figure 1 above shows the IP address of the spider;

2 is the date and time of the spider's visit (1:21:22 on March 6, 2012), and the log file on March 7 records the entire period of n visits from the early morning of March 6 to 1:11:39 on March 7);

3 is the spider baiduspider

5 is the visit of sogou Sogou spider, and you can also see the time and the visited web page.

If it's a simple view, you can search for BaiduSpider in Notepad, and if you want to analyze it accurately, you can use some dedicated analysis software. Analyze which time periods the spiders come most frequently, then we will update our ** content during this time period, which is easy to be included.

By analyzing the spider's visit history, you can understand the general situation of this site, and you don't have to worry about not releasing the inner page or not including it.

Note: Some shared IP space may not support the log function, for the independent IP web host, the daily log is provided**, but there is really no space for the log function, please refer to some methods using the spider crawling plugin for analysis.

Normal, why don't you come to see your **, you just go everywhere to post**, such as forums, know, post it, so that you can attract it.

For example, if you look up BaiduSpider, the following sentence is a record that the spider has visited.

To find other spiders, you can enter other spider names, such as 360:360spider, Google:googlebot, soso:sosospider, Sogou:sogou news spider

Severe dizziness is your own first to enable the IIS log feature Please follow these steps:1Open IIS.

To do this, click Start, point to Programs, point to Administrative Tools, and then click Internet Service Manager. 2.Click the plus sign (+) next to your server name

3.Right-click or FTP site, and then click Properties. 4.

On the Web site or FTP site tab, select Enable logging. 5.In the Activity log format list, select a format.

By default, Enable Logging is selected in the W3C Extended Log File format, and the following fields are enabled for logging: Time, Client IP Address, Method, URI Resource, and HTTP Status. Select the items you want to monitor in the logs, and leave the default settings if you don't want to customize the monitoring.

Note: If you selected ODBC logging, click Properties, and then type the name of the data source and the name of the table within the database in the text box. If a username and password are required to access the database, type them, and then click OK.

6.Click Apply, and then click OK.

Open FTP and there is a file containing "log" in the background. This file is the log. There are so on in the log folder.

The log records the history of your web page being crawled, as well as the IP address of your **, etc., and at the same time, each time you crawl your server, it will return a status code indicating the crawl status.

You can use the Light-Year Log tool to view your logs, which is quick and easy. Don't be dazzled by which ** of the logs.

I took a look at the log today, but I didn't understand, did the spider have been here? There's no sign of it!

1. Make sure that the log records the name of the client access machine and the access IP address.

This question is actually not good, because you can read the spider crawling log, and you must also understand the basic theory. I would also like to provide some suggestions for reference.

1. Personally, I think that the ranking algorithm has been fluctuating recently. So, this aspect is more likely to be larger. You can check it out.

2. Publish two high-quality external links, guide them, and then pay attention to the spider crawling records;

3. Like submitting an application for inclusion.

4. Sit and wait. It takes about 10 days to record it. And even more.

5. Check the server, this possibility is also available.