Details:
Need the ability to harvest streaming links on a video aggregator site.
Website is setup as a blog hybrid and contains less than 200 pages. New posts are made once per day.
All links are divided up into posts based on keywords. Each post contains multiple scenes with multiple streaming mirrors.
The streaming links are not obfuscated and are obtained through the source html embedded through iframe.
Requirements:
Crawler will initially spider entire site and harvest all streaming…
