I have a script that crawls our website so it can be pre-cache for visitors so there is less loading time for the customer when they access the website. It works fine on all our other websites but since we setup a new shopping cart its not crawling the new site. It just dies after visiting the first page. The reason appears to be the new shopping cart does not use the full path in links http://www.domain.com/index.php they only use /index.php.
I need someone to help me fix it to crawl the new…
