I have recently wrote code for WebCrawler in C#. You can find code here at Github. This is basically used to crawl on start and it would stop once it is stopped. Please go through readme section for more details Let me know for more details. Happy coding!