Puppeteer not updating content (innerHtml) after the button click. (Google recaptcha)
I am trying to get the google captcha image from a site using puppeteer. On pressing the button the google recaptcha code is triggered and a standard 4x4 grid is shown. I can see that in the image0.png which is taken after the button click. But when I try to get the content of the page, I see no code related to the captcha. Both the div and iframe which are visible in the devtools are nowhere to be seen in then html page downloaded. It always shows the contents of the initial page and not of the dialog box. Since puppeteer is exposing devtools, I was hoping I would get the same output here too.
Below I have shared the code for the same. For sample purposes, you can see a similar functionality on the www.proxydb.net.
const nextPageButton = await page.$x("//button[contains(text(), 'Next page')]");
if (nextPageButton.length > 0)
await nextPageButton[0].click();
await page.waitFor(1000);
await page.screenshot(
fullPage: true,
path:`image0.png`
);
const html = await page.content();
await fs.writeFile("proxyDB.html", html, function(err)
if(err)
return console.log(err);
console.log("The file was saved!");
);
else
throw new Error("Link not found");
javascript html puppeteer
asked Nov 14 '18 at 9:35
ChaksChaks
83110
add a comment |
I am trying to get the google captcha image from a site using puppeteer. On pressing the button the google recaptcha code is triggered and a standard 4x4 grid is shown. I can see that in the image0.png which is taken after the button click. But when I try to get the content of the page, I see no code related to the captcha. Both the div and iframe which are visible in the devtools are nowhere to be seen in then html page downloaded. It always shows the contents of the initial page and not of the dialog box. Since puppeteer is exposing devtools, I was hoping I would get the same output here too.
Below I have shared the code for the same. For sample purposes, you can see a similar functionality on the www.proxydb.net.
const nextPageButton = await page.$x("//button[contains(text(), 'Next page')]");
if (nextPageButton.length > 0)
await nextPageButton[0].click();
await page.waitFor(1000);
await page.screenshot(
fullPage: true,
path:`image0.png`
);
const html = await page.content();
await fs.writeFile("proxyDB.html", html, function(err)
if(err)
return console.log(err);
console.log("The file was saved!");
);
else
throw new Error("Link not found");
javascript html puppeteer
asked Nov 14 '18 at 9:35
ChaksChaks
83110
This answer helped me to solve the above one. stackoverflow.com/questions/50588874/…
– Chaks
Nov 27 '18 at 13:01
add a comment |
I am trying to get the google captcha image from a site using puppeteer. On pressing the button the google recaptcha code is triggered and a standard 4x4 grid is shown. I can see that in the image0.png which is taken after the button click. But when I try to get the content of the page, I see no code related to the captcha. Both the div and iframe which are visible in the devtools are nowhere to be seen in then html page downloaded. It always shows the contents of the initial page and not of the dialog box. Since puppeteer is exposing devtools, I was hoping I would get the same output here too.
Below I have shared the code for the same. For sample purposes, you can see a similar functionality on the www.proxydb.net.
const nextPageButton = await page.$x("//button[contains(text(), 'Next page')]");
if (nextPageButton.length > 0)
await nextPageButton[0].click();
await page.waitFor(1000);
await page.screenshot(
fullPage: true,
path:`image0.png`
);
const html = await page.content();
await fs.writeFile("proxyDB.html", html, function(err)
if(err)
return console.log(err);
console.log("The file was saved!");
);
else
throw new Error("Link not found");
javascript html puppeteer
asked Nov 14 '18 at 9:35
ChaksChaks
83110
I am trying to get the google captcha image from a site using puppeteer. On pressing the button the google recaptcha code is triggered and a standard 4x4 grid is shown. I can see that in the image0.png which is taken after the button click. But when I try to get the content of the page, I see no code related to the captcha. Both the div and iframe which are visible in the devtools are nowhere to be seen in then html page downloaded. It always shows the contents of the initial page and not of the dialog box. Since puppeteer is exposing devtools, I was hoping I would get the same output here too.
Below I have shared the code for the same. For sample purposes, you can see a similar functionality on the www.proxydb.net.
const nextPageButton = await page.$x("//button[contains(text(), 'Next page')]");
if (nextPageButton.length > 0)
await nextPageButton[0].click();
await page.waitFor(1000);
await page.screenshot(
fullPage: true,
path:`image0.png`
);
const html = await page.content();
await fs.writeFile("proxyDB.html", html, function(err)
if(err)
return console.log(err);
console.log("The file was saved!");
);
else
throw new Error("Link not found");
javascript html puppeteer
javascript html puppeteer
asked Nov 14 '18 at 9:35
ChaksChaks
83110
asked Nov 14 '18 at 9:35
ChaksChaks
83110
asked Nov 14 '18 at 9:35
ChaksChaks
83110
asked Nov 14 '18 at 9:35
ChaksChaks
83110
asked Nov 14 '18 at 9:35
ChaksChaks
83110
83110
This answer helped me to solve the above one. stackoverflow.com/questions/50588874/…
– Chaks
Nov 27 '18 at 13:01
add a comment |
This answer helped me to solve the above one. stackoverflow.com/questions/50588874/…
– Chaks
Nov 27 '18 at 13:01
This answer helped me to solve the above one. stackoverflow.com/questions/50588874/…
– Chaks
Nov 27 '18 at 13:01
This answer helped me to solve the above one. stackoverflow.com/questions/50588874/…
– Chaks
Nov 27 '18 at 13:01
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53296962%2fpuppeteer-not-updating-content-innerhtml-after-the-button-click-google-recap%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53296962%2fpuppeteer-not-updating-content-innerhtml-after-the-button-click-google-recap%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
This answer helped me to solve the above one. stackoverflow.com/questions/50588874/…
– Chaks
Nov 27 '18 at 13:01