Make a Web Crawler Using Python

Introduction This tutorial will show to make a web crawler using simple Python and built-in packages. Prerequisites You must have gone through the setup tutorial, or at least have Python installed along with a basic text editor. Reddit’s JSON api Visualizing the JSON The first thing to do is obtain a list of posts from our favorite subreddit. For this tutorial I have chosen r/Eyebleach, which I occasionally visit for pictures of cats and other soul-cleansing content.