Skip to content

Ellery Yang

I write about products and the PM role.

Menu
  • Home
  • About me
Menu

Dr.Spider is here!

Posted on August 19, 2015April 25, 2020 by Ellery

I have been spending the past week and half working on my new project, Dr.Spider. This is a Java web application used to detect invalid links in a website. Here is a live demo.

Dr.Spider screen shot

Dr.Spider crawls the web link a user supplies, and performs a Depth-First Search starting from that point. It can detect invalid links in the website, and will display a report if any invalid link is found.

Notice that this is a proof-of-concept project, so it is only configured to crawl links within the given domain name. For example, if I have a link on my home page pointing to a LinkedIn page (which can lead to thousands of links recursively), it will detect this link but ignore it.

An example: if I put two invalid links in my website, then use Dr.Spider to diagnose it, the result will look like this:

Results of Dr.Spider screen shot

Have fun playing with Dr.Spider!

PM Blog (2017 - present)

  • April 2024
  • November 2023
  • September 2023
  • March 2023
  • January 2023
  • September 2022
  • July 2022
  • February 2022
  • September 2021
  • August 2021
  • April 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • February 2020
  • January 2020
  • December 2019
  • October 2019
  • July 2019
  • June 2019
  • April 2019
  • March 2019
  • December 2018
  • October 2018
  • May 2018
  • March 2018
  • December 2017

A Student's Blog (2015 - 2017)

  • July 2017
  • June 2017
  • August 2016
  • July 2016
  • April 2016
  • March 2016
  • February 2016
  • December 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
© 2025 Ellery Yang | Powered by Minimalist Blog WordPress Theme