HTTP状态码100、200、300、400、500、600的含义

### HTTP Status Codes in Web Crawling In the context of web crawling, understanding HTTP status codes is crucial because they provide information about the success or failure of an HTTP request. These codes are grouped into five classes based on their first digit: - **Informational responses (100–199)** indicate that the client must take additional action to complete the request. For instance, `100 Continue` means the initial part of a request has been received without error[^1]. - **Successful responses (200–299)** signify that the action was successfully received, understood, and accepted. The most common code here is `200 OK`, which indicates that everything worked as expected. - **Redirection messages (300–399)** inform the client that further action needs to be taken by the user agent in order to fulfill the request. A typical example is `301 Moved Permanently`, indicating that the resource requested has moved permanently to another URL. - **Client error responses (400–499)** occur when there seems to have been something wrong with the request sent by the client. An important one for crawlers is `403 Forbidden`, signaling that access to the resource is forbidden regardless of authorization[^2]. - **Server error responses (500–599)** happen when the server failed to fulfill an apparently valid request. One frequently encountered code during crawling operations is `500 Internal Server Error`. Here's how you can handle these statuses within your crawler using Python’s requests library: ```python import requests def check_status(url): try: response = requests.get(url) if 200 <= response.status_code < 300: print(f'Successful Response ({response.status_code})') elif 300 <= response.status_code < 400: print('Redirected.') elif 400 <= response.status_code < 500: print('Client Error:', response.reason) elif 500 <= response.status_code < 600: print('Server Error:', response.reason) else: print('Unknown Status Code.') except Exception as e: print(e) check_status("http://example.com") ``` This script checks different types of HTTP status codes returned from fetching URLs via GET method calls.