Did I find the right examples for you? yes no

All Samples(2)  |  Call(1)  |  Derive(0)  |  Import(1)
Controller class to manage url and retrieve content using BeautifulSoup.

Created on 27/09/2012

@author: Ricardo García Fernández
@mail: ricardogarfe@gmail.com

src/r/i/ricardo_crawler-01.00.01/controllers/http_links_collector.py   ricardo_crawler(Download)
'''
 
from url_content_retrieve import UrlContentRetrieve
import logging
import traceback
        self.setup_log()
        # Define url content retrieve to use
        self.url_content_retrieve = UrlContentRetrieve(starting_url)
 
    def retrieve_links(self, target_url, depth=1, level=1):