Python自动化（二）使用Beautifu Soup爬取电影下载链接

置顶 Gavinsun

于 2017-09-13 17:49:02 发布

阅读量632

点赞数

CC 4.0 BY-SA版权

分类专栏： Python 文章标签： python 自动化

本文链接：https://blog.csdn.net/gavinsun/article/details/77968973

Python 专栏收录该内容

25 篇文章

订阅专栏

本文介绍了一个使用Python的BeautifulSoup库从指定网站爬取电影名称及其迅雷下载链接的方法。通过发送HTTP请求获取网页内容，解析HTML文档并提取所需的电影名称及下载链接。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

#coding:utf-8
from bs4 import BeautifulSoup
import requests
import codecs
host = "http://www.poxiao.com"
url = "http://www.poxiao.com/mtype5.html"
html_doc = requests.get(url).content.decode("GBK")
with codecs.open("poxiao.html","w",encoding="GBK") as f:
    f.write(html_doc)
poxiao = BeautifulSoup(html_doc,"lxml")
div_content = poxiao.find(name="div",attrs={"class":"content"})
movies = div_content.find_all("h3")
for movie in movies:
    print movie.text
    movie_url = host+movie.a.get("href")
    movie_content = requests.get(movie_url).content
    movie_soup = BeautifulSoup(movie_content,"lxml")
    try:
        thunder_link = movie_soup.find("input",attrs={"name":"checkbox2"})
        print thunder_link.get("value")
    except:
        print "获取链接失败"