trying to crawl a website says … javascript disabled
i mean when i try to crawl it using a spider built in php i get javascript disabled and i get nothing out of the websites because the website needs javascript enabled so i can crawl it ….
the website it self has no javascript i am sure but it makes sure you have javascript so no one can crawl it … not because it needs javascript … i hope you understand … and also the website needs me to login before crawling …but i know how to log in into it using cURL extension
i am using php
i just need a function or anything that can fake that javascript is enabled …. i am using linux
