Python学习之旅

工具Pycharm、Chrome、Xpath插件 思路——总结页面规律、标题查找、图片链接查找、文件保存 """ url = http://www.mmxyz.net/rosi-2221/ """ #导入模块 import requests,time,os from lxml import etree #爬取页面 def get_html(url): res = requests.get(...

大量爬取为了必备封IP，需要大量代理IP，代码如下 from urllib import error import random,requests # 代理IP proxies_list = [ {'http':'39.137.77.66:8080'}, { 'http':'124.42.7.103:80'} ] url = 'http://www.baidu.com' # 免费...

通过find_element_by_id查找搜索输入框，百度一下按钮，输入、剪切、清空搜索内容，保存屏幕截图 from selenium import webdriver from selenium.webdriver.common.keys import Keys import time driver = webdriver.Chrome() url = "http://www.baidu.c...

代码，使用xpath筛选 import requests from lxml import etree #词汇表 words = [] def shanbei(page): url ='https://www.shanbay.com/wordlist/104899/202159/?page=%s'%page print(url) rsp = requests.g...

数据、headers、代理怎么用上 import requests url='http://www.renren.com/PLogin.do' data = {} headers = {} proxies = {} res = requests.post(url,data=data, headers=headers, proxies=proxies) 二进制网页 res.content 经过默...