问题描述
我正在使用 Python请求 get方法来查询 MediaWiki API ,但是接收响应需要很多时间.相同的请求通过Web浏览器很快收到响应.请求google.com时遇到相同的问题.以下是我在Windows 10上的Python 3.5中尝试的示例代码:
I am using Python requests get method to query the MediaWiki API, but it takes a lot of time to receive the response. The same requests receive the response very fast through a web browser. I have the same issue requesting google.com. Here are the sample codes that I am trying in Python 3.5 on Windows 10:
response = requests.get("https://www.google.com")
response = requests.get("https://en.wikipedia.org/wiki/Main_Page")
response = requests.get("http://en.wikipedia.org/w/api.php?", params={'action':'query', 'format':'json', 'titles':'Labor_mobility'})
但是,在检索其他网站时,我不会遇到此问题:
However, I don't face this issue retrieving other websites like:
response = requests.get("http://www.stackoverflow.com")
response = requests.get("https://www.python.org/")
推荐答案
这听起来与服务器的基础连接存在问题,因为对其他URL的请求有效.这些是我想到的:
This sounds like there is an issue with the underlying connection to the server, because requests to other URLs work. These come to mind:
- 服务器可能只允许特定的用户代理字符串
尝试添加无害的标题,例如: requests.get("https://www.example.com",headers = {"User-Agent":"Mozilla/5.0(X11; CrOS x86_6412871.102.0)AppleWebKit/537.36(KHTML,例如Gecko)Chrome/81.0.4044.141 Safari/537.36}})
Try adding innocuous headers, e.g.: requests.get("https://www.example.com", headers={"User-Agent": "Mozilla/5.0 (X11; CrOS x86_64 12871.102.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.141 Safari/537.36"})
- 服务器限制您的速度
等待几分钟,然后重试.如果这解决了您的问题,则可以通过添加 time.sleep()
来降低代码速度,以防止再次受到速率限制.
Wait for a few minutes, then try again. If this solves your issue, you could slow down your code by adding time.sleep()
to prevent being rate-limited again.
- IPv6不起作用,但IPv4起作用
通过执行 curl --ipv6 -v https://www.example.com
进行验证.然后,与 curl --ipv4 -v https://www.example.com
进行比较.如果后者明显更快,则可能是您的IPv6连接有问题.在此处查看可能的解决方案.
Verify by executing curl --ipv6 -v https://www.example.com
. Then, compare to curl --ipv4 -v https://www.example.com
. If the latter is significantly faster, you might have a problem with your IPv6 connection. Check here for possible solutions.
如果这不能解决您的问题,则我在此处收集了一些其他可能的解决方案.
If that did not solve your issue, I have collected some other possible solutions here.
这篇关于Python请求GET需要很长时间才能响应某些请求的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!