How to Capture HTTP Requests in Python for Debugging?

Capturing HTTP Requests in Python for Troubleshooting

Encountering HTTP errors can be frustrating, especially when external support requires detailed request information. This article explains how to capture the entire HTTP request sent from your Python application using the Requests library. By enabling logging in recent versions of Requests, you can gain valuable insights into the request's headers, data, and response.

Enabling Request Logging

Requests leverages the Python logging module to configure logging verbosity. To enable logging, simply modify your code as follows:

import logging

# Enable debugging at http.client level
logging.basicConfig()
logging.getLogger().setLevel(logging.DEBUG)

# Set logging level for requests.packages.urllib3
requests_log = logging.getLogger("requests.packages.urllib3")
requests_log.setLevel(logging.DEBUG)
requests_log.propagate = True

Demonstration

After enabling logging, you can execute a GET request to a public API like httpbin.org:

import requests

requests.get('https://httpbin.org/headers')

Example Output

The logging output will include valuable information about the request:

INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection (1): httpbin.org
send: 'GET /headers HTTP/1.1\r\nHost: httpbin.org\r\nAccept-Encoding: gzip, deflate, compress\r\nAccept: */*\r\nUser-Agent: python-requests/1.2.0 CPython/2.7.3 Linux/3.2.0-48-generic\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Content-Type: application/json
header: Date: Sat, 29 Jun 2013 11:19:34 GMT
header: Server: gunicorn/0.17.4
header: Content-Length: 226
header: Connection: keep-alive
DEBUG:requests.packages.urllib3.connectionpool:"GET /headers HTTP/1.1" 200 226

The output displays the complete request, including headers and the first 1024 bytes of the response body. This information can be invaluable for identifying the source of HTTP errors and communicating with external support teams.

The above is the detailed content of How to Capture HTTP Requests in Python for Debugging?. For more information, please follow other related articles on the PHP Chinese website!