python selenium chromedriver 自动化超时报错：你需要使用多标签保护罩护体
在使用selenium + chrome 作自动化测试的时候，有可能会出现网页连接超时的情况
如果出现网页连接超时，将会导致 webdriver 也跟着无法响应，不能继续进行任何操作
即时是去打开新的连接也会报Time out错误
那么如果有很多连接要去做弹窗抓取，却不想因为其中一两个页面超时而中断进程该怎么办呢？
这时候你需要一个备用标签做金刚保护罩来护体！
具体的思路是在打开需求页面之后，再次开启一个新的标签去访问一个一定不会超时的页面（如百度），此时窗口句柄不要切换，依旧按照自己的逻辑去操作，当出现页面超时情况的时候，关闭原有标签，设置主窗口句柄到百度页面所在的标签通过get访问后续的连接，同时在开启一个标签做保护罩即可。
相关代码实现：
#!/usr/bin/python3# -*- coding: UTF-8 -*-import tracebackfrom xml import etreefrom selenium import webdriverfrom selenium.webdriver.chrome.options import Optionschrome_options = Options()prefs = {'profile.default_content_setting_values': {'images': 2, # 禁用图片的加载'javascript': 2 ##禁用js，可能会导致通过js加载的互动数抓取失效}}chrome_options.add_experimental_option("prefs", prefs)# chrome_options.add_argument("--headless") # 不弹出浏览器browser = webdriver.Chrome(chrome_options=chrome_options)browser.implicitly_wait(5) # 操作、获取元素时的隐式等待时间browser.set_page_load_timeout(10) # 页面加载超时等待时间main_win = browser.current_window_handle #记录当前窗口的句柄all_win = browser.window_handles# 开始访问页面print('Opening page')urls = [] # 定义你想要抓取的全部的页面for url in urls:try:if len(all_win) == 1:print('弹出保护罩')js = 'window.open("https://www.baidu.com");'browser.execute_script(js)# 还是定位在main_win上的for win in all_win:if main_win != win:print('保护罩WIN', win, 'Main', main_win)browser.switch_to.window(main_win)browser.get(url) # 此处访问你需要的URLbody = browser.page_sourcehtml = etree.HTML(body)# 下面是你的抓取逻辑 省略except:# 超时print('Time out')# 切换新的浏览器窗口for win in all_win:if main_win != win:print('保护罩WIN', win, 'Main', main_win)print '切换到保护罩'browser.close()browser.switch_to.window(win)main_win = winjs = 'window.open("https://www.baidu.com");'browser.execute_script(js)if 'time' in str(traceback.format_exc()):print '页面访问超时'
Thanks for your marvelous posting! I actually enjoyed reading it, you may be a great author. I will always bookmark your blog and will come back later on. I want to encourage continue your great writing, have a nice afternoon!
Good day! Would you mind if I share your blog with my myspace group? There's a lot of folks that I think would really enjoy your content. Please let me know. Cheers
I was suggested this web site by my cousin. I'm not sure whether this post is written by him as no one else know such detailed about my trouble. You are incredible! Thanks!
I go to see every day some websites and information sites to read posts, except this webpage presents quality based content.
I'll right away grab your rss feed as I can't find your e-mail subscription hyperlink or e-newsletter service. Do you've any? Please allow me know in order that I could subscribe. Thanks.
Quality content is the secret to be a focus for the visitors to pay a visit the web site, that's what this site is providing.
Hello there, You've done a fantastic job. I will definitely digg it and personally recommend to my friends. I am confident they will be benefited from this site.
Peculiar article, exactly what I was looking for.
Wow, incredible blog layout! How long have you been blogging for? you made blogging look easy. The overall look of your web site is great, let alone the content!
Fantastic post however , I was wondering if you could write a litte more on this subject? I'd be very thankful if you could elaborate a little bit more. Cheers!
I have fun with, lead to I found exactly what I used to be looking for. You have ended my four day lengthy hunt! God Bless you man. Have a great day. Bye
We stumbled over here different web page and thought I may as well check things out. I like what I see so i am just following you. Look forward to going over your web page yet again.
It's an remarkable post for all the web people; they will get benefit from it I am sure.
Hi there, just became alert to your blog through Google, and found that it is truly informative. I am gonna watch out for brussels. I will appreciate if you continue this in future. Many people will be benefited from your writing. Cheers!
Hi, just wanted to mention, I loved this article. It was funny. Keep on posting!
Thanks for sharing your info. I really appreciate your efforts and I am waiting for your next write ups thank you once again.
I don't even know the way I finished up here, but I believed this put up was once great. I do not understand who you are however certainly you're going to a well-known blogger when you aren't already. Cheers!
I visited various web pages except the audio feature for audio songs present at this web page is in fact excellent.
It's actually a cool and useful piece of information. I'm happy that you just shared this helpful information with us. Please keep us up to date like this. Thank you for sharing.
Very nice post. I just stumbled upon your blog and wanted to mention that I have truly loved surfing around your weblog posts. In any case I will be subscribing for your rss feed and I am hoping you write again very soon!
Valuable info. Fortunate me I found your website by chance, and I am shocked why this twist of fate didn't happened in advance! I bookmarked it.
My family every time say that I am killing my time here at net, however I know I am getting knowledge everyday by reading such nice articles.
Terrific article! That is the kind of information that are meant to be shared around the internet. Shame on the search engines for no longer positioning this submit higher! Come on over and consult with my site . Thanks =)
That is really attention-grabbing, You are an excessively skilled blogger. I've joined your feed and stay up for seeking more of your magnificent post. Additionally, I've shared your site in my social networks
Pretty! This has been an incredibly wonderful article. Thank you for providing this info.
Howdy! I just wish to give you a big thumbs up for your great info you have got here on this post. I will be coming back to your website for more soon.
Appreciate the recommendation. Let me try it out.
Spot on with this write-up, I truly believe that this web site needs much more attention. I'll probably be back again to read more, thanks for the advice!
My family all the time say that I am wasting my time here at web, except I know I am getting knowledge all the time by reading thes nice content.
I think this is among the most vital info for me. And i am glad reading your article. But should remark on few general things, The web site style is perfect, the articles is really excellent : D. Good job, cheers
It's hard to come by educated people in this particular topic, but you seem like you know what you're talking about! Thanks
An intriguing discussion is definitely worth comment. I do believe that you need to publish more about this topic, it may not be a taboo matter but usually people do not discuss these subjects. To the next! Cheers!!
Hello! I could have sworn I've been to this website before but after checking through some of the post I realized it's new to me. Anyways, I'm definitely glad I found it and I'll be bookmarking and checking back often!
This post provides clear idea designed for the new people of blogging, that really how to do blogging.
I do not even understand how I stopped up right here, but I assumed this post was once good. I do not recognise who you're however certainly you are going to a famous blogger in case you are not already. Cheers!
Hey! Would you mind if I share your blog with my twitter group? There's a lot of folks that I think would really enjoy your content. Please let me know. Cheers
Incredible! This blog looks exactly like my old one! It's on a totally different topic but it has pretty much the same layout and design. Outstanding choice of colors!
Hello friends, pleasant paragraph and fastidious arguments commented here, I am really enjoying by these.