如何在需要在 python 中进行身份验证的代理服务器后面运行 selenium Web 驱动程序

问题描述

目前这是我的代码，但 webDriver 显示一个弹出来输入代理凭据，我不希望出现这种烦人的情况，这不是 stackoverflow 中第一次出现相同的问题，但没有人回答一个正确的答案.

At present this is my code, but webDriver is showing a pop-up to enter proxy credentials and I don't want this annoying situation, This is not the first time the same question appeared in stackoverflow, but no one replied with a proper answer.

我试过谷歌寻找这个问题的解决方案.我开始知道java中的解决方案，但我不知道我们如何在python中实现.

I tried google to find a solution for this problem. I came to know the solution in java, but i dont know how we do it in python.

    PROXY_HOST = "65.49.1.59"
    PROXY_PORT = 60099
    fp = webdriver.FirefoxProfile()
    # Direct = 0, Manual = 1, PAC = 2, AUTODETECT = 4, SYSTEM = 5

    print " im in parse_details"

    fp.set_preference("network.proxy.type", 1)
    fp.set_preference('network.http.phishy-userpass-length', 255)

    fp.set_preference("network.proxy.http", PROXY_HOST)
    fp.set_preference("network.proxy.http_port", PROXY_PORT)
    fp.set_preference("network.proxy.ftp", PROXY_HOST)
    fp.set_preference("network.proxy.ftp_port", PROXY_PORT)
    fp.set_preference("network.proxy.ssl", PROXY_HOST)
    fp.set_preference("network.proxy.ssl_port", PROXY_PORT)
    #fp.set_preference("network.proxy.user_name", 'someusername')
    #fp.set_preference("network.proxy.password", 'somepassword')
    fp.set_preference("network.proxy.no_proxies_on", "") # set this value as desired

    self.driver = webdriver.Firefox(firefox_profile=fp)
    self.driver.get("http://www.whatismyip.com/")

下面这些语句是我猜测的，我不确定它们的语法是否正确，即使我试图在 selenium 文档中找到，但没有帮助.你们能不能对此有所了解.

These below statements are guessed by me, and I am not sure whether their syntax is correct or not, even i tried to find out in selenium documentation, but no help. Would you guys throw some light on this.

    #fp.set_preference("network.proxy.user_name", 'someusername')
    #fp.set_preference("network.proxy.password", 'somepassword')

附言同样的问题在这里问Selenium using Python: enter/provide http proxy password for火狐

p.s. The same question asked here Selenium using Python: enter/provide http proxy password for firefox

推荐答案

Selenium 不能处理基本身份验证，也不能很好地处理弹出窗口.但是这个问题是可以解决的.作为对我有用的解决方案(我发现它这里)是添加对 Selenium 进行身份验证的浏览器扩展.这很简单.以下是 Chrome 和 Python 的工作原理:

Selenium can't handle with basic authentication neither it works well with popups. But this problem is resolvable. As a solution that worked to me (I found it here) is to add a browser extension that does the authentication for Selenium. It's quite simple. Here is how it works for Chrome and Python:

1. 创建一个包含两个文件的 zip 文件 proxy.zip:

background.js

var config = {
    mode: "fixed_servers",
    rules: {
      singleProxy: {
        scheme: "http",
        host: "YOU_PROXY_ADDRESS",
        port: parseInt(YOUR_PROXY_PORT)
      },
      bypassList: ["foobar.com"]
    }
  };

chrome.proxy.settings.set({value: config, scope: "regular"}, function() {});

function callbackFn(details) {
    return {
        authCredentials: {
            username: "YOUR_PROXY_USERNAME",
            password: "YOUR_PROXY_PASSWORD"
        }
    };
}

chrome.webRequest.onAuthRequired.addListener(
        callbackFn,
        {urls: ["<all_urls>"]},
        ['blocking']
);

不要忘记将 YOUR_PROXY_* 替换为您的设置.

Don't forget to replace YOUR_PROXY_* to your settings.

ma​​nifest.json

{
    "version": "1.0.0",
    "manifest_version": 2,
    "name": "Chrome Proxy",
    "permissions": [
        "proxy",
        "tabs",
        "unlimitedStorage",
        "storage",
        "<all_urls>",
        "webRequest",
        "webRequestBlocking"
    ],
    "background": {
        "scripts": ["background.js"]
    },
    "minimum_chrome_version":"22.0.0"
}

1. 将创建的 proxy.zip 添加为扩展

Python 代码:

from selenium import webdriver
from selenium.webdriver.chrome.options import Options

chrome_options = Options()
chrome_options.add_extension("proxy.zip")

driver = webdriver.Chrome(executable_path='chromedriver.exe', chrome_options=chrome_options)
driver.get("http://google.com")
driver.close()

就是这样.对我来说，这就像一个魅力.如果您需要动态创建 proxy.zip 或需要 PHP 示例，请转到 原始帖子

That's it. For me that worked like a charm. If you need to create proxy.zip dynamically or need PHP example then go to the original post

这篇关于如何在需要在 python 中进行身份验证的代理服务器后面运行 selenium Web 驱动程序的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！