How to Scrape a Website: Scraping for Vulnerability Reports

This tutorial will show you how to scrape a website for links using Ruby and Nokogiri. Specifically, I show you how to scrape for publicly disclosed website vulnerabilities. In doing so, we rely on the Nokogiri to find all of our a tags and match the pattern /reports/REPORT_NO, writing each match to a file.