python selenium chromedriver 自动化超时报错：你需要使用多标签保护罩护体
在使用selenium + chrome 作自动化测试的时候，有可能会出现网页连接超时的情况
如果出现网页连接超时，将会导致 webdriver 也跟着无法响应，不能继续进行任何操作
即时是去打开新的连接也会报Time out错误
那么如果有很多连接要去做弹窗抓取，却不想因为其中一两个页面超时而中断进程该怎么办呢？
这时候你需要一个备用标签做金刚保护罩来护体！
具体的思路是在打开需求页面之后，再次开启一个新的标签去访问一个一定不会超时的页面（如百度），此时窗口句柄不要切换，依旧按照自己的逻辑去操作，当出现页面超时情况的时候，关闭原有标签，设置主窗口句柄到百度页面所在的标签通过get访问后续的连接，同时在开启一个标签做保护罩即可。
相关代码实现：
#!/usr/bin/python3# -*- coding: UTF-8 -*-import tracebackfrom xml import etreefrom selenium import webdriverfrom selenium.webdriver.chrome.options import Optionschrome_options = Options()prefs = {'profile.default_content_setting_values': {'images': 2, # 禁用图片的加载'javascript': 2 ##禁用js，可能会导致通过js加载的互动数抓取失效}}chrome_options.add_experimental_option("prefs", prefs)# chrome_options.add_argument("--headless") # 不弹出浏览器browser = webdriver.Chrome(chrome_options=chrome_options)browser.implicitly_wait(5) # 操作、获取元素时的隐式等待时间browser.set_page_load_timeout(10) # 页面加载超时等待时间main_win = browser.current_window_handle #记录当前窗口的句柄all_win = browser.window_handles# 开始访问页面print('Opening page')urls = [] # 定义你想要抓取的全部的页面for url in urls:try:if len(all_win) == 1:print('弹出保护罩')js = 'window.open("https://www.baidu.com");'browser.execute_script(js)# 还是定位在main_win上的for win in all_win:if main_win != win:print('保护罩WIN', win, 'Main', main_win)browser.switch_to.window(main_win)browser.get(url) # 此处访问你需要的URLbody = browser.page_sourcehtml = etree.HTML(body)# 下面是你的抓取逻辑 省略except:# 超时print('Time out')# 切换新的浏览器窗口for win in all_win:if main_win != win:print('保护罩WIN', win, 'Main', main_win)print '切换到保护罩'browser.close()browser.switch_to.window(win)main_win = winjs = 'window.open("https://www.baidu.com");'browser.execute_script(js)if 'time' in str(traceback.format_exc()):print '页面访问超时'
A fascinating discussion is worth comment. I think that you should publish more on this subject, it may not be a taboo matter but usually people do not speak about such issues. To the next! All the best!!
This website was... how do you say it? Relevant!! Finally I have found something which helped me. Thanks a lot!
Thanks for finally writing about >python selenium chromedriver 自动化超时报错：你需要使用多标签保护罩护体_KevinFei博客
Hi there! Would you mind if I share your blog with my twitter group? There's a lot of folks that I think would really enjoy your content. Please let me know. Thanks
I used to be able to find good info from your articles.
Hey there! I know this is somewhat off topic but I was wondering if you knew where I could find a captcha plugin for my comment form? I'm using the same blog platform as yours and I'm having problems finding one? Thanks a lot!
Hi there, You've done an excellent job. I will certainly digg it and personally recommend to my friends. I am confident they'll be benefited from this website.
Hi, just wanted to tell you, I liked this blog post. It was funny. Keep on posting!
I got this site from my buddy who told me on the topic of this web site and now this time I am browsing this website and reading very informative posts at this time.
Hi it's me, I am also visiting this site on a regular basis, this web site is truly pleasant and the users are genuinely sharing nice thoughts.
Magnificent beat ! I would like to apprentice while you amend your web site, how can i subscribe for a blog website? The account helped me a acceptable deal. I had been tiny bit acquainted of this your broadcast provided bright clear idea
A person necessarily lend a hand to make critically posts I might state. That is the very first time I frequented your website page and thus far? I amazed with the research you made to create this actual submit extraordinary. Fantastic process!
Wonderful, what a website it is! This webpage provides useful data to us, keep it up.
I feel this is among the most significant information for me. And i'm satisfied studying your article. However should statement on few normal issues, The website taste is perfect, the articles is in reality great : D. Just right task, cheers
Hello Dear, are you actually visiting this site daily, if so after that you will without doubt take good knowledge.
I could not resist commenting. Perfectly written!
Hi there, this weekend is pleasant for me, because this time i am reading this fantastic educational piece of writing here at my residence.
Its not my first time to visit this web site, i am browsing this web page dailly and take good facts from here everyday.
Excellent web site. Lots of helpful info here. I am sending it to a few friends ans also sharing in delicious. And certainly, thank you for your effort!
Aw, this was an exceptionally good post. Taking a few minutes and actual effort to make a superb article… but what can I say… I procrastinate a lot and don't seem to get nearly anything done.
I always used to read post in news papers but now as I am a user of net thus from now I am using net for content, thanks to web.
Howdy! I could have sworn I've visited your blog before but after going through a few of the posts I realized it's new to me. Anyhow, I'm certainly pleased I stumbled upon it and I'll be book-marking it and checking back regularly!
Hi, i feel that i noticed you visited my blog thus i got here to return the prefer?.I'm trying to find things to improve my website!I suppose its good enough to make use of some of your ideas!!
Great post. I was checking constantly this blog and I am impressed! Very useful info particularly the last part :) I care for such information much. I was seeking this particular information for a very long time. Thank you and best of luck.
I don't even know how I stopped up here, however I assumed this put up was once good. I don't recognize who you are but certainly you are going to a famous blogger when you aren't already. Cheers!
Appreciate the recommendation. Let me try it out.
Thanks for your marvelous posting! I actually enjoyed reading it, you may be a great author. I will always bookmark your blog and will come back later on. I want to encourage continue your great writing, have a nice afternoon!
Good day! Would you mind if I share your blog with my myspace group? There's a lot of folks that I think would really enjoy your content. Please let me know. Cheers
I was suggested this web site by my cousin. I'm not sure whether this post is written by him as no one else know such detailed about my trouble. You are incredible! Thanks!
I go to see every day some websites and information sites to read posts, except this webpage presents quality based content.
I'll right away grab your rss feed as I can't find your e-mail subscription hyperlink or e-newsletter service. Do you've any? Please allow me know in order that I could subscribe. Thanks.
Quality content is the secret to be a focus for the visitors to pay a visit the web site, that's what this site is providing.
Hello there, You've done a fantastic job. I will definitely digg it and personally recommend to my friends. I am confident they will be benefited from this site.
Peculiar article, exactly what I was looking for.
Wow, incredible blog layout! How long have you been blogging for? you made blogging look easy. The overall look of your web site is great, let alone the content!
Fantastic post however , I was wondering if you could write a litte more on this subject? I'd be very thankful if you could elaborate a little bit more. Cheers!
I have fun with, lead to I found exactly what I used to be looking for. You have ended my four day lengthy hunt! God Bless you man. Have a great day. Bye
We stumbled over here different web page and thought I may as well check things out. I like what I see so i am just following you. Look forward to going over your web page yet again.
It's an remarkable post for all the web people; they will get benefit from it I am sure.
Hi there, just became alert to your blog through Google, and found that it is truly informative. I am gonna watch out for brussels. I will appreciate if you continue this in future. Many people will be benefited from your writing. Cheers!
Hi, just wanted to mention, I loved this article. It was funny. Keep on posting!
Thanks for sharing your info. I really appreciate your efforts and I am waiting for your next write ups thank you once again.
I don't even know the way I finished up here, but I believed this put up was once great. I do not understand who you are however certainly you're going to a well-known blogger when you aren't already. Cheers!
I visited various web pages except the audio feature for audio songs present at this web page is in fact excellent.
It's actually a cool and useful piece of information. I'm happy that you just shared this helpful information with us. Please keep us up to date like this. Thank you for sharing.
Very nice post. I just stumbled upon your blog and wanted to mention that I have truly loved surfing around your weblog posts. In any case I will be subscribing for your rss feed and I am hoping you write again very soon!
Valuable info. Fortunate me I found your website by chance, and I am shocked why this twist of fate didn't happened in advance! I bookmarked it.
My family every time say that I am killing my time here at net, however I know I am getting knowledge everyday by reading such nice articles.
Terrific article! That is the kind of information that are meant to be shared around the internet. Shame on the search engines for no longer positioning this submit higher! Come on over and consult with my site . Thanks =)
That is really attention-grabbing, You are an excessively skilled blogger. I've joined your feed and stay up for seeking more of your magnificent post. Additionally, I've shared your site in my social networks
Pretty! This has been an incredibly wonderful article. Thank you for providing this info.
Howdy! I just wish to give you a big thumbs up for your great info you have got here on this post. I will be coming back to your website for more soon.
Appreciate the recommendation. Let me try it out.
Spot on with this write-up, I truly believe that this web site needs much more attention. I'll probably be back again to read more, thanks for the advice!
My family all the time say that I am wasting my time here at web, except I know I am getting knowledge all the time by reading thes nice content.
I think this is among the most vital info for me. And i am glad reading your article. But should remark on few general things, The web site style is perfect, the articles is really excellent : D. Good job, cheers
It's hard to come by educated people in this particular topic, but you seem like you know what you're talking about! Thanks
An intriguing discussion is definitely worth comment. I do believe that you need to publish more about this topic, it may not be a taboo matter but usually people do not discuss these subjects. To the next! Cheers!!
Hello! I could have sworn I've been to this website before but after checking through some of the post I realized it's new to me. Anyways, I'm definitely glad I found it and I'll be bookmarking and checking back often!
This post provides clear idea designed for the new people of blogging, that really how to do blogging.
I do not even understand how I stopped up right here, but I assumed this post was once good. I do not recognise who you're however certainly you are going to a famous blogger in case you are not already. Cheers!
Hey! Would you mind if I share your blog with my twitter group? There's a lot of folks that I think would really enjoy your content. Please let me know. Cheers
Incredible! This blog looks exactly like my old one! It's on a totally different topic but it has pretty much the same layout and design. Outstanding choice of colors!
Hello friends, pleasant paragraph and fastidious arguments commented here, I am really enjoying by these.