I have written an Asynchronous web scraper in C#, but I’m having problems getting it to run through hundreds of domains without hanging up. My understanding of Asynchronous HTTP requests is limited. I need someone to look over the code and debug the tool to make sure it works flawlessly by handling edge-cases like improperly formatted URLs, sites that won’t load, etc. There’s only about 500 lines of code to look over. This is a basic console application.
