我尝试在下面的网站上抓取产品项目的详细信息，但是脚本虽然总是存在，但始终失败，并显示错误no such element。谁能帮助解决这个问题？我的代码：
from time import sleep
from scrapy import Spider
from selenium import webdriver
from scrapy.selector import Selector
from scrapy.http import Request
from selenium.common.exceptions import NoSuchElementException
driver = webdriver.Chrome('D:\chromedriver_win32\chromedriver.exe')
driver.get('http://www.tesensors.com/global/en/product/inductive-capacitive/xs-xt-ref')
sleep(5)
#soemtime the site ask you select language and country so need click button as below
sign_in_button = driver.find_element_by_id('edit-submit--4')
sign_in_button.click()
sleep(5)
# scrapy content.total 1168 items, here there is no result.
product_model_name=driver.find_elements_by_xpath('span[@itemprop="name"]')
product_desc=driver.find_elements_by_xpath('span[@itemprop="description"]')
最佳答案
iframe中的产品数据
您可以使用XPath来定位：
iframe = driver.find_element_by_xpath("//iframe[@id='ecat']")
然后切换到：
driver.switch_to.frame(iframe)
以下是切换回默认内容（之外）的方法：
driver.switch_to.default_content()
不要使用
time-sleep模块，请尝试explicit-waits。see差异。
例如：
from scrapy import Spider
from selenium import webdriver
from scrapy.selector import Selector
from scrapy.http import Request
from selenium.common.exceptions import NoSuchElementException
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
driver = webdriver.Chrome('D:\chromedriver_win32\chromedriver.exe')
driver.get('http://www.tesensors.com/global/en/product/inductive-capacitive/xs-xt-ref')
#soemtime the site ask you select language and country so need click button as below
sign_in_button = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.ID, "edit-submit--4")))
sign_in_button.click()
#switch iframe
iframe = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//iframe[@id='ecat']")))
driver.switch_to.frame(iframe)
# scrapy content.total 1168 items, here there is no result.
product_model_name = driver.find_elements_by_xpath('//span[@itemprop="name"]')
print(product_model_name[0].text)
product_desc=driver.find_elements_by_xpath('//span[@itemprop="description"]')
print(product_model_name[0].text)
关于python - 如何在一个站点表内容中定位元素，我们在Stack Overflow上找到一个类似的问题：https://stackoverflow.com/questions/56733445/