Python爬取小姐姐图片代码_批量下载

halio · 发表于 2021-1-12 22:53

import os
import time
import requests
import re
headers = {
'User-Agent': "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/22.0.1207.1 Safari/537.1",
'Accept': "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8",
'Accept-Encoding': 'gzip',
"Referer": "https://www.baidu.com/"
}
httpnum = int(input("请输入爬取网页的起始ID:"))
httpnum1 = int(input("请输入爬取网页的结束ID:"))
for i in range(httpnum,httpnum1+1):
httpurl = "https://www.vmgirls.com/{0}.html".format(i)
response = requests.get(httpurl, headers=headers)
html = response.text
if str("<style></style><meta name=keywords content=") not in html:
print("{0}网页不存在".format(i))
continue
else:
dir_name = re.findall('<h1 class="post-title h1">(.*?)</h1>', html)[-1]
if not os.path.exists(dir_name):
os.mkdir(dir_name)
urls = re.findall('<a href="(.*?)" alt=".*?" title=".*?">', html)
for url in urls:
time.sleep(1)
name = url.split('/')[-1]
response = requests.get("https:" + url, headers=headers)
print(name + "正在下载")
with open(dir_name + '/' + name, 'wb') as f:
f.write(response.content)
print("{0}下载完毕".format(i))
print("全部下载完毕")

复制代码

小小飞 · 发表于 2021-1-12 22:53

6666

combob · 发表于 2021-1-12 22:54

感谢楼主的分享

574936337 · 发表于 2021-1-12 22:58

感谢分享，谢谢提供分享

ycsos001 · 发表于 2021-1-12 23:03

感谢楼主分享

593754965 · 发表于 2021-1-12 23:03

谢谢大牛

hurry90 · 发表于 2021-1-12 23:11

谢谢分享

2238442504 · 发表于 2021-1-12 23:47

支持楼主，谢谢分享。

knight丶 · 发表于 2021-1-13 00:24

谢谢分享！

zhao130836333 · 发表于 2021-1-13 00:36

多谢楼主分享

		自动登录	找回密码
密码			注册[Register]

[python] Python爬取小姐姐图片代码_批量下载