What is the legality of webscraping reviews from Goodreads?
<p>Suppose a developer creates a project which involves webscraping reviews. In particular, reviews from <a href="https://www.goodreads.com/" rel="nofollow noreferrer">Goodreads</a>.</p>
<p>When actually using this scraped data, the  project displays a note that it is from Goodreads, e.g:</p>
<blockquote>
<p><strong>User_Name</strong> <em>Posted on Goodreads</em></p>
<p>Review Here</p>
</blockquote>
<p>The robots.txt file, in my understanding, outlines whether scraping is allowed, but I am not sure whether for Goodreads this is permissible.</p>
<p>I have been researching this, and I have not been able to find any real definitive answer, except don't violate GDPR or cause any damage to the website.</p>

<h2>Copyright</h2>
<p>User posts remain the copyright of the author and you can only use them if you have permission (which you don’t - see clause 4 of the  <a href="https://www.goodreads.com/about/terms" rel="nofollow noreferrer">terms</a>) or if your use is fair use or fair dealing depending on where you are. See <a href="https://law.stackexchange.com/questions/48359/what-is-the-practical-difference-between-fair-use-and-fair-dealing-in-copyri/48380#48380">What is the practical difference between &quot;fair use&quot; and &quot;fair dealing&quot; in Copyright law?</a> - it might be, you haven’t given us enough information on what you plan to do with it to tell.</p>
<h2>Privacy</h2>
<p>Privacy law vary around the world but based on the EU’s GDPR, both the user name and the review are personal information (since they can be linked to an individual) and you must have a lawful basis for collecting the data or it must be for purely personal or household use.</p>
<p>If you are doing it for personal study as part of a recognised course, that meets the copyright fair dealing test. If you are doing it for practice and won’t submit it to someone who is covered by the GDPR, like your school, that covers the privacy issue. Once you choose to submit it, you are now no longer in “purely personal or household use” and you must have a lawful basis and go through all the hoops of the GDPR (as must your school when you give them the data).</p>

<p>They post <a href="https://www.goodreads.com/about/terms" rel="nofollow noreferrer">GoodReads Terms</a></p>
<blockquote>
<p><strong>4. Our Proprietary Rights</strong></p>
</blockquote>
<blockquote>
<p>Except for your User Content, the Service and all materials therein or transferred thereby, including, without
limitation, software, images, text, graphics, illustrations, logos,
patents, trademarks, service marks, copyrights, photographs, audio,
videos, music, and User Content (the &quot;Goodreads Content&quot;), and all
intellectual property Rights related thereto, are the exclusive
property of Goodreads and its licensors. Except as explicitly provided
herein, nothing in this Agreement shall be deemed to create a license
in or under any such intellectual property Rights, and you agree not
to sell, license, rent, modify, distribute, <strong>copy</strong>, reproduce, transmit,
publicly display, publicly perform, publish, adapt, edit or create
derivative works from any materials or content accessible on the
Service. Use of the Goodreads Content or materials on the Service for
any purpose not expressly permitted by this Agreement is strictly
prohibited.</p>
</blockquote>
<p>So your &quot;scraping&quot; is clearly in the &quot;copy&quot; category and is prohibited under the terms their service is licensed to you.</p>
<p>If this is a school project you might consider contacting them and getting permission to do what you plan.  Otherwise you could just continue on and take the risk that they will discover what you are doing.</p>

copyright internet