How to Scrape a Website: Scraping Hackerone.com for Vulnerability Reports

This tutorial will show you how to scrape a website for links using Ruby and Nokogiri. Specifically, I show you how to scrape Hackerone.com/hacktivity for publicly disclosed website vulnerabilities. In doing so, we rely on the Nokogiri to find all of our a tags and match the pattern /reports/REPORT_NO, writing each match to a file.