This is a simple, preety basic URL scrapper using BeatifulSoup package in Python.

The scraper extract and parses all HTML elements from all given URL that are websites.txt.

We use depth argument to indicate depth for the parsing process.

We extract the anchor element() with an existing href.

Save all URL's to a dataframe and write it to txt file.