H04 - js加密混淆及简单反调试
coding=utf-8 import requests from lxml import etree from selenium import webdriver import time base_url = ‘https://spiderbuf.cn/web-scraping-practice/javascript-confuse-encrypt-reverse’ myheaders = { ‘User-Agent’: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/5...
H03 - 网页滚动加载的原理及爬取(JavaScript加密混淆逆向基础)
coding=utf-8 import os.path import requests from lxml import etree import time base_url = ‘https://spiderbuf.cn/web-scraping-practice/scraping-scroll-load’ myheaders = { ‘User-Agent’: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chro...
H02 - 高分电影列表复杂页面的解析(仿豆瓣电影)-xpath高级用法
coding=utf-8 import os.path import requests from lxml import etree import time base_url = ‘https://spiderbuf.cn/web-scraping-practice/scraping-douban-movies-xpath-advanced’ myheaders = { ‘User-Agent’: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML,...
N03 - 限制访问频率不低于1秒
coding=utf-8 import requests from lxml import etree import time base_url = ‘https://spiderbuf.cn/web-scraping-practice/scraper-bypass-request-limit/%d’ myheaders = { ‘User-Agent’: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/9...
N02 - 使用Base64编码的图片爬取与解码还原
coding=utf-8 import requests from lxml import etree import base64 url = ‘https://spiderbuf.cn/web-scraping-practice/scraping-images-base64’ myheaders = { ‘User-Agent’: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.164...