I am trying to scrape data from a website using Puppeteer and it seems that the page is getting redirected in the session opened with Puppeteer and using a web browser normally.
To be able to understand more what’s happening, I am using a headfull browser with the devtools enabled. Once the page gets loaded, I trigger all the user events manually.
If you want to try it this is the code for now :
const browser = await puppeteer.launch({
headless: false,
args: [`--window-size=1920,1080`],
defaultViewport: {
width:1920,
height:1080
},
devtools: true
});
const page = await browser.newPage();
await page.goto('https://otv.verwalt-berlin.de/ams/TerminBuchen', { waitUntil: 'domcontentloaded' });
Click on “EN” for English, then “Book Appointment”.
In the Network tab, it seems that there is a cancelled request in the Puppeteer version. I am sure this has to do something with this issue.
Any idea on what could be causing this?