Responsible Web Scraping: Gathering Data Ethically and Legally

Author: Denis Kryukov

Publisher: Soshace

Publication Year: 2019

Summary: The following resource talks about the ethical ways to scrape the web. Although data on the web is public, obtaining it does not always entail completely ethical procedures. Scraping can entail getting data that shouldn’t have been kept, copying things that are under copyright, etc. Overall, the article recommends using application programming interfaces (APIs) since there are some websites that make scraping challenging, to refer to the terms of service for any legal guidelines, identifying your scraper as legitimate and maybe linking a page for why you are scraping, among other technical things to implement during the process.