首页用jupyternotebook爬取图片

用jupyternotebook爬取图片

时间: 2023-12-03 13:04:15 浏览: 187

以下是使用Jupyter Notebook爬取图片的步骤： 1.导入所需的库，包括requests、os和beautifulsoup4等库。 ```python import requests import os from bs4 import BeautifulSoup ``` 2.定义一个函数，用于获取图片的URL。 ```python def get_img_url(url): html = requests.get(url).text soup = BeautifulSoup(html, 'html.parser') img_urls = [] for img in soup.find_all('img'): img_url = img.get('src') if img_url.startswith('http'): img_urls.append(img_url) return img_urls ``` 3.定义一个函数，用于下载图片。 ```python def download_img(url, save_path): if not os.path.exists(save_path): os.makedirs(save_path) response = requests.get(url) with open(os.path.join(save_path, url.split('/')[-1]), 'wb') as f: f.write(response.content) ``` 4.调用上述函数，爬取并下载图片。 ```python url = 'https://www.example.com' img_urls = get_img_url(url) for img_url in img_urls: download_img(img_url, 'save_path') ```

阅读全文