Selenium Python: StaleElementReferenceException with a twist
I'm running into the infamous StaleElementReferceExeption error with selenium. I've checked previous questions on the subject, and the common solution is to add and implicit.wait, explicit.wait, or time.sleep to give the website time to load. I've tried this, but I am still experiencing an error. Can anyone tell what the issue is
Here is my code:
links = driver.find_elements_by_css_selector("a.overline-productName")
time.sleep(2)
#finds pricing data of links on page
link_count = 0
for element in links:
links[link_count].click()
cents = driver.find_element_by_css_selector("span.cents")
dollar = driver.find_element_by_css_selector("span.dollar")
text_price = dollar.text + "." + cents.text
price = float(text_price)
print(price)
print(link_count)
driver.execute_script("window.history.go(-1)")
link_count = link_count + 1
time.sleep(5)
what am I missing?
python selenium web-scraping
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
add a comment |
I'm running into the infamous StaleElementReferceExeption error with selenium. I've checked previous questions on the subject, and the common solution is to add and implicit.wait, explicit.wait, or time.sleep to give the website time to load. I've tried this, but I am still experiencing an error. Can anyone tell what the issue is
Here is my code:
links = driver.find_elements_by_css_selector("a.overline-productName")
time.sleep(2)
#finds pricing data of links on page
link_count = 0
for element in links:
links[link_count].click()
cents = driver.find_element_by_css_selector("span.cents")
dollar = driver.find_element_by_css_selector("span.dollar")
text_price = dollar.text + "." + cents.text
price = float(text_price)
print(price)
print(link_count)
driver.execute_script("window.history.go(-1)")
link_count = link_count + 1
time.sleep(5)
what am I missing?
python selenium web-scraping
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
Can you share the URL?
– QHarr
Nov 15 '18 at 7:27
Update the question with the Manual Steps you are trying to Automate and the relevant HTML
– DebanjanB
Nov 15 '18 at 8:58
this has nothing to do with waiting at all. it is simply programmer error.. you are triggering navigation which causes all elements to go stale and then expecting them to not be stale.
– Corey Goldberg
Nov 15 '18 at 16:09
add a comment |
I'm running into the infamous StaleElementReferceExeption error with selenium. I've checked previous questions on the subject, and the common solution is to add and implicit.wait, explicit.wait, or time.sleep to give the website time to load. I've tried this, but I am still experiencing an error. Can anyone tell what the issue is
Here is my code:
links = driver.find_elements_by_css_selector("a.overline-productName")
time.sleep(2)
#finds pricing data of links on page
link_count = 0
for element in links:
links[link_count].click()
cents = driver.find_element_by_css_selector("span.cents")
dollar = driver.find_element_by_css_selector("span.dollar")
text_price = dollar.text + "." + cents.text
price = float(text_price)
print(price)
print(link_count)
driver.execute_script("window.history.go(-1)")
link_count = link_count + 1
time.sleep(5)
what am I missing?
python selenium web-scraping
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
I'm running into the infamous StaleElementReferceExeption error with selenium. I've checked previous questions on the subject, and the common solution is to add and implicit.wait, explicit.wait, or time.sleep to give the website time to load. I've tried this, but I am still experiencing an error. Can anyone tell what the issue is
Here is my code:
links = driver.find_elements_by_css_selector("a.overline-productName")
time.sleep(2)
#finds pricing data of links on page
link_count = 0
for element in links:
links[link_count].click()
cents = driver.find_element_by_css_selector("span.cents")
dollar = driver.find_element_by_css_selector("span.dollar")
text_price = dollar.text + "." + cents.text
price = float(text_price)
print(price)
print(link_count)
driver.execute_script("window.history.go(-1)")
link_count = link_count + 1
time.sleep(5)
what am I missing?
python selenium web-scraping
python selenium web-scraping
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
asked Nov 15 '18 at 2:28
Black_lotusBlack_lotus
32
32
Can you share the URL?
– QHarr
Nov 15 '18 at 7:27
Update the question with the Manual Steps you are trying to Automate and the relevant HTML
– DebanjanB
Nov 15 '18 at 8:58
this has nothing to do with waiting at all. it is simply programmer error.. you are triggering navigation which causes all elements to go stale and then expecting them to not be stale.
– Corey Goldberg
Nov 15 '18 at 16:09
add a comment |
Can you share the URL?
– QHarr
Nov 15 '18 at 7:27
Update the question with the Manual Steps you are trying to Automate and the relevant HTML
– DebanjanB
Nov 15 '18 at 8:58
this has nothing to do with waiting at all. it is simply programmer error.. you are triggering navigation which causes all elements to go stale and then expecting them to not be stale.
– Corey Goldberg
Nov 15 '18 at 16:09
Can you share the URL?
– QHarr
Nov 15 '18 at 7:27
Can you share the URL?
– QHarr
Nov 15 '18 at 7:27
Update the question with the Manual Steps you are trying to Automate and the relevant HTML
– DebanjanB
Nov 15 '18 at 8:58
Update the question with the Manual Steps you are trying to Automate and the relevant HTML
– DebanjanB
Nov 15 '18 at 8:58
this has nothing to do with waiting at all. it is simply programmer error.. you are triggering navigation which causes all elements to go stale and then expecting them to not be stale.
– Corey Goldberg
Nov 15 '18 at 16:09
this has nothing to do with waiting at all. it is simply programmer error.. you are triggering navigation which causes all elements to go stale and then expecting them to not be stale.
– Corey Goldberg
Nov 15 '18 at 16:09
add a comment |
1 Answer
1
active
oldest
votes
You're storing your links in a list. The second you follow a link to another page, that set of links is stale. So the next iteration in your loop will attempt to click a stale link from the list.
Even if you go back in history as you do later, that original element reference is gone.
Your best bet is to loop through based on index, and find the links each time you return to the page.
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53311571%2fselenium-python-staleelementreferenceexception-with-a-twist%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
You're storing your links in a list. The second you follow a link to another page, that set of links is stale. So the next iteration in your loop will attempt to click a stale link from the list.
Even if you go back in history as you do later, that original element reference is gone.
Your best bet is to loop through based on index, and find the links each time you return to the page.
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
add a comment |
You're storing your links in a list. The second you follow a link to another page, that set of links is stale. So the next iteration in your loop will attempt to click a stale link from the list.
Even if you go back in history as you do later, that original element reference is gone.
Your best bet is to loop through based on index, and find the links each time you return to the page.
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
add a comment |
You're storing your links in a list. The second you follow a link to another page, that set of links is stale. So the next iteration in your loop will attempt to click a stale link from the list.
Even if you go back in history as you do later, that original element reference is gone.
Your best bet is to loop through based on index, and find the links each time you return to the page.
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
You're storing your links in a list. The second you follow a link to another page, that set of links is stale. So the next iteration in your loop will attempt to click a stale link from the list.
Even if you go back in history as you do later, that original element reference is gone.
Your best bet is to loop through based on index, and find the links each time you return to the page.
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
answered Nov 15 '18 at 2:47
Lucas TierneyLucas Tierney
1,64288
1,64288
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53311571%2fselenium-python-staleelementreferenceexception-with-a-twist%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Can you share the URL?
– QHarr
Nov 15 '18 at 7:27
Update the question with the Manual Steps you are trying to Automate and the relevant HTML
– DebanjanB
Nov 15 '18 at 8:58
this has nothing to do with waiting at all. it is simply programmer error.. you are triggering navigation which causes all elements to go stale and then expecting them to not be stale.
– Corey Goldberg
Nov 15 '18 at 16:09