Python: Crawling Static Pages

Feb 24, 2015
As a software developer assigned to test and create crawler scripts for a few months... or years.. I would like to share to you how to scrape the page source from a static webpage. Here's what we need: IDLE (Python GUI) (I am using 2.7.5) The code is simple as: #imports import urllib2 # variable declaration url = "http://techno-ob.blogspot.com" # get page source data = urllib2.urlopen(url).read() # print source print...
Read more ...