Currently, I am using a Node.js backend with the Puppeteer library to simulate a browser for scraping data and then sending it back to the client.
However, my manager has requested that the entire data scraping process be moved to the client-side in order to save server resources. After doing some research on various sites and asking ChatGPT, I found that relying solely on client-side JavaScript for scraping is insufficient.
I learned that writing a browser extension could be a better option, as it offers more capabilities. However, the trade-off is that there would be no headless browsing mode, meaning the scraping process would always be visible to the user.
Any advice or guidance on how to proceed would be greatly appreciated!
Thanks in advance for help!