如何用Python编写代码爬取素材网站中的音频文件？

本文共计335个文字，预计阅读时间需要2分钟。

基本环境配置：Python 3.6 + PyCharm + requests + parsel 模块，pip安装即可。

目标网页：https://www.tukuppt.com/peiyue/zonghe_0_0_0_0_0_0_1.

请求代码：pythonimport requestsfrom requests.exceptions import RequestException

url='https://www.tukuppt.com/peiyue/zonghe_0_0_0_0_0_0_1.'headers={ 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'}

try: response=requests.get(url, headers=headers) response.raise_for_status() print(response.text)except RequestException as e: print(e)

基本环境配置

• python 3.6
• pycharm
• requests
• parsel

相关模块pip安装即可

目标网页

请求网页

import requests url = 'www.tukuppt.com/peiyue/zonghe_0_0_0_0_0_0_1.html' headers = { 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', } response = requests.get(url=url, headers=headers)

解析网页，提取数据

import parsel selector = parsel.Selector(response.text) urls = selector.css('#audio850995 source::attr(src)').getall() titles = selector.css('.b-box .info .title::text').getall() data = zip(urls, titles) for i in data: mp3_url = 'https:' + i[0] title = i[1]

保存数据

def download(url, title): response = requests.get(url=url, headers=headers) path = 'D:\\python\\demo\\熊猫办公素材\\背景音乐\\' + title + '.mp3' with open(path, mode='wb') as f: f.write(response.content)

以上就是本文的全部内容，希望对大家的学习有所帮助，也希望大家多多支持易盾网络。