Did I find the right examples for you? yes no      Crawl my project      Python Jobs

All Samples(5)  |  Call(1)  |  Derive(0)  |  Import(4)
Template to read a list of URLs and store other URLS that are reference in the JS
The urls is a list with two members, a url that is requested (first) and the url that was actually visited (second)

src/b/r/browse-2007-HEAD/modules/browse/State.py   BROWSE(Download)
from JSConfig import JSConfig
from SignatureList import SignatureList
from Debug import Debug
from URLList import URLList
from JSBlockList import JSBlockList
  def readURLs(self,filename):
    """Read the default URL file and must be called during initialisation"""
    self.urls=URLList(filename,self.conf)
 

src/b/r/browse-2007-HEAD/modules/browse/Crawler.py   BROWSE(Download)
from JSReader import JSReader
from URLList import URLList
#import JSConfig
from JSBlockList import JSBlockList
from SignatureList import SignatureList