shaochangli/articleCrawler
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Update start.py

Browse Source 
解决远程加载js失败导致打开网页很慢的问题
This commit is contained in:
LeLe86 2022-05-06 14:53:36 +08:00 committed by GitHub
parent ac3473fda1
commit f98ee35da6
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
start.py
View File

@ -104,6 +104,10 @@ def ChangeImgSrc(htmltxt,saveimgdir,htmlname):
img.attrs["src"] = "" img.attrs["src"] = ""
ChangeCssSrc(bs) #修改link标签 ChangeCssSrc(bs) #修改link标签
ChangeContent(bs) #修改js_content的style，使正文能正常显示 ChangeContent(bs) #修改js_content的style，使正文能正常显示
allscript = bs.findAll("script")
for script in allscript:
if "src" in script.attrs: #解决远程加载js失败导致打开网页很慢的问题
script["src"]=""
return str(bs) #将BeautifulSoup对象再转换为字符串，用于保存 return str(bs) #将BeautifulSoup对象再转换为字符串，用于保存
def ChangeCssSrc(bs): def ChangeCssSrc(bs):