Data plays a prominent role in our lives today, even if we arent aware of its presence. There are many complex moral, legal, and philosophical questions about how we gather and use data; not least who actually owns it. After all, if I tell you how tall I am, do you now own my height? If you write the number down and sell the information on to someone else, am I entitled to a cut?
A case between data aggregator HiQ and social media platform LinkedIn highlights some of the difficult questions facing data scientists today.
The implications of the litigation between LinkedIn and HiQ are profound, but the case itself is simple enough to understand. It centered around LinkedIns invocation of the Computer Fraud and Abuse Act in a cease-and-desist letter to HiQ.
HiQ is a data analytics firm that provides business intelligence based on publicly-available data scraped from LinkedIn. Like many businesses today, they depend on access to public-facing data to be able to function. One of the unspoken but very salient questions raised by the case is where the line between public and private data lies.
Before you continue reading, how about a follow on LinkedIn?
The data that LinkedIn holds belongs to the company, inasmuch as it is being stored on their systems. However, the data itself consists only of what other people have submitted to LinkedIn. At the time of the case, the data was accessible to anyone who visited LinkedIn. From HiQs perspective, this meant that the data on LinkedIn was fair game for scraping. From LinkedIns perspective, their ToS prohibited the use of automation tools. They had a right to enforce those ToS by banning IP addresses associated with scraping.
With a growing number of entities scraping LinkedIn for data, the platform took action to terminate the accounts of suspected offenders. One of the businesses caught up in the bans was HiQ. They were able to easily circumvent the IP ban, by utilizing proxy services to mask the IP addresses they used for scraping.
LinkedIn responded by sending a cease-and-desist letter to HiQ. They asserted that not only had the firm breached LinkedIns ToS, but they had also violated the Computer Fraud and Abuse Act (CFAA), along with some other laws. HiQ responded with a lawsuit seeking an injunction against LinkedIn to prevent them from hindering HiQs access to data until the case was resolved.
In an opinion published in September 2019, the Ninth Circuit, while stopping short of issuing a definitive ruling, appeared to be leaning towards HiQs side. The Ninth Circuit made the significant decision to disregard some of its own prior rulings. This case was far from the first concerning how online services use the CFAA to enforce their own terms of service.
Giving the CFAA a broader focus so that it could be used to enforce a websites user agreement would have had a chilling effect on the then-nascent data scraping industry. In fact, the potential impact on internet users would have been far-reaching. Just about any internet user could be criminally liable for even minor infractions of a social media services ToS. The Ninth Circuits ruling in Nosal suggested that its interpretation of the CFAA was relatively narrow and that violations of the Act required more than a ToS violation.
However, two other decisions taken by the Ninth Circuit muddied the waters. One of these concerned a second decision in the Nosal case. The other was a ruling in an unrelated case, Facebook v. Power Ventures. In the second Nosal ruling, the court held that the term without authorization in the CFAA is not limited to circumventing access control using technical methods. A user gaining unauthorized access with legitimate login credentials could still be in violation of the act.
In the Power Ventures ruling, the court found that even though the data scraper had permission to access Facebook accounts using passwords and scrape data, it continued to do so after Facebook issued a cease-and-desist letter. This put Power Ventures in violation of the CFAA. Facebook had also blocked the IP address Power Ventures had initially used, although Power Ventures circumvention of this block was not in itself considered to be a violation.
A number of organizations, including the Electronic Frontier Foundation (EFF), have taken a particular interest in the case because it has far-reaching implications for data scraping. The case also presented an opportunity to overturn or limit the impact of the Ninth Circuits earlier rulings. The EFF feared this would have a chilling effect on innovation and web scraping.
In their cease-and-desist to HiQ, LinkedIn cited the Power Ventures case as evidence that continuing to access its data would mean HiQ was in violation of the CFAA. HiQ decided to beat LinkedIn to the punch and filed for a preliminary injunction. Despite the earlier Power Ventures ruling, the Ninth Circuit found that HiQ was likely to be successful in their claim that automated access to public-facing data was not a violation of the CFAA.
The Ninth Circuit ultimately upheld the preliminary injunction, but there is still potential for the case to come back to court.
During the case, the EFF filed an amicus brief that emphasized to the court how vital scraping is to a number of industries. Web scraping isnt just used commercially. It is vital for research and has a number of other beneficial uses.
The Ninth Circuit affirmed that any data that required no authorization to access and was freely available by default was fair game for scraping. As the court pointed out, authorization to access data is implicit unless steps are taken to restrict general access.
The ruling in HiQ v. LinkedIn means that judges in the future will have more leeway. It limits the significance of earlier rulings in the Power Ventures and Nosal cases. In those cases, the court was of the opinion that requiring a login before providing access to data would render it as private, not public, data.
This raises another problem, however. Upon logging in to Facebook, a wealth of otherwise private data is now easily available without restrictions. LinkedIn appears to have interpreted the courts ruling as meaning that any and all data that requires a login is private and LinkedIn can revoke access to it. As a result, LinkedIn is now requiring users to login before being able to browse the platform.
However, for many people, the most significant finding of the Ninth Circuit was that the CFAA exists to combat hacking and cannot be used as a catch-all enforcement document for enforcing a websites ToS.
Finally, the case touches on one of the most important data and privacy issues of our time. Who actually owns our personal data? The Ninth Circuits ruling would appear to affirm that it is us that owns our data. Any platforms we share that data with are merely licensed to use it, they dont own it outright.
Data scraping is an integral part of the modern internet ecosystem. It isnt about to go anywhere. LinkedIns interest in pursuing HiQ may have more to do with them competing to provide the same services than it does about any legitimate security or privacy concerns. It is worth noting that the Ninth Circuit listed a number of other potential legal remedies for businesses in LinkedIns position. The case will now return to the district court for a trial. A lot of people will be watching developments with great interest.
See the original post:
- The Army turns to automation for officer assignments - Defense Systems - February 12th, 2020
- AI And Automation: Together Forever? - Forbes - February 12th, 2020
- Viewpoint: How Automation is Digitally Transforming the Insurance Industry - Claims Journal - February 12th, 2020
- Ponemon Institute Report Finds Security Automation Continues to Reshape Hiring Trends Year-by-year - Chinook Observer - February 12th, 2020
- Automation Is Probably Coming for Your Job Too - GQ - February 12th, 2020
- Survey: Firms trend towards automation - Bangkok Post - February 12th, 2020
- AI, automation, and the cybersecurity skills gap - VentureBeat - February 12th, 2020
- SaltStack Infrastructure Automation Now Integrated with Tenable.io for Closed-Loop Vulnerability Remediation - The Herald Journal - February 12th, 2020
- 2020 State of Branding Report Reveals Marketers Divided Over Automation's Role in Branding - Supply and Demand Chain Executive - February 12th, 2020
- TD Bank: Automation and mobile apps inevitable for the restaurant industry - Tech Wire Asia - February 12th, 2020
- Demand for Fast Deployment and Ease-of-Use Drives AP Automation to the Cloud - CPAPracticeAdvisor.com - February 12th, 2020
- Feb. 20: CLC to host author John Wasik for automation talk - Patch.com - February 12th, 2020
- WorkFusion Named No. 1 for Intelligence and Overall Innovation in Robotic Process Automation (RPA) by HFS Research - Yahoo Finance - February 12th, 2020
- CAN in Automation at Embedded World 2020 - Embedded Computing Design - February 12th, 2020
- Making the Most of AI and Automation: Steps to success - Gigabit Magazine - Technology News, Magazine and Website - February 12th, 2020
- Industrial automation technology trends 2020 - Verdict - February 12th, 2020
- Dassault Systmes announces expanded 3DEXPERIENCE WORKS offerings - Automation.com - February 12th, 2020
- HANNOVER MESSE 2020 to focus on 5G, industrial climate protection - Automation.com - February 12th, 2020
- Global Process Automation Market: 2020 Global Trend and 2025 Forecast Research Report on Demands, Business Analysis - Instant Tech News - February 12th, 2020
- Robotic Process Automation Software Market Latest Trends , Size, Share, Types, Technical Applications, In-depth Industry Analysis and Competitive... - February 12th, 2020
- Workstream, A Staffing Automation Startup, Helps Small Businesses Hire Hourly Workers - Forbes - February 12th, 2020
- Automation Puts Reply Guys Out of Work in Fake Social Media App Botnet - VICE - February 12th, 2020
- Industrial Automation Market Boosting the Manufacturing Industry Worldwide - Robotics Tomorrow - February 12th, 2020
- Epiroc and ASI Mining to automate Roy Hill haul truck fleet - International Mining - February 12th, 2020
- Automation Solutions Market in the Oil and Gas Industry 2020-2024 | Rise in the Global Demand for Oil and Gas to Boost Growth | Technavio - Business... - February 12th, 2020
- Automated oil and gas well control - Engineer Live - February 12th, 2020
- 32% of jobs in 'red wall' seats at risk of automation by early 2030s - LabourList - February 12th, 2020
- Picking the Right Automation Tool for the Job - No Jitter - February 7th, 2020
- Have robots grounded the flying geese? Automation and offshoring in the manufacturing sector - Brookings Institution - February 7th, 2020
- How to get started with automation: A Red Hat exec offers advice - TechRepublic - February 7th, 2020
- Tenjin is releasing a new set of automation APIs and making it free - Pocket Gamer.Biz - February 7th, 2020
- Frost Radar in the Industrial Automation Market - Yahoo Finance - February 7th, 2020
- Intellecta AI-Driven And Multichannel Analytics From OnviSource Delivers Automation For Workforce Optimization, CX Management And Content Management -... - February 7th, 2020
- The Challenge of Automation in Strawberries - AG INFORMATION NETWORK OF THE WEST - AGInfo Ag Information Network Of The West - February 7th, 2020
- Automation as a Service Market by Component, Business Function, Enterprise Size, and Industry Vertical: Global Opportunity Analysis and Industry... - February 7th, 2020
- Robotic Process Automation Market Procurement Intelligence Report | Evolving Opportunities with Blue Prism and UiPath in the Robotic Process... - February 7th, 2020
- Intelligent Automation Will Boost India's Economy to US 5 Trillion By 2024-25 - THE WEEK - February 7th, 2020
- The Age of Automation is coming to a MLB strike zone near you - Motor City Bengals - February 7th, 2020
- Benefits and challenges of automated processes for wildlife trade in poor countries - Trade for Development News - February 7th, 2020
- How automated workflows increase the capacity and scale of a - SelectScience - February 7th, 2020
- Savesor Presents a KNX Hotel Automation Kit and Innovative Bundle for Airbnb Hosts at ISE 2020 - KNXtoday - February 7th, 2020
- Watch how to program automation in Ableton Live 10 - MusicTech - February 7th, 2020
- Perfecto by Perforce Releases 2020 State of Test Automation Report - Yahoo Finance - February 7th, 2020
- Zapier now connects 2,000+ apps--more than any other automation tool - Yahoo Finance - February 7th, 2020
- Iris Automation Announces First Beyond-Visual-Line-of-Sight (BVLOS) Drone Waiver In South Africa - PRNewswire - February 7th, 2020
- Vineland names new head of automation - Greenhouse Canada - February 7th, 2020
- Automation Anywhere Backing Arrow McLaren SP - SPEED SPORT - February 7th, 2020
- CRM's 'Automated Virtual Agents': Coming Soon to an Office Near You - Toolbox - February 7th, 2020
- Even With Industry 4.0, Sometimes The Best Level Of Automation Is None - Forbes - January 5th, 2020
- What we can do to make sure automation doesn't negatively affect the work force - TNW - January 5th, 2020
- Automation and Public Policy - State of the Planet - January 5th, 2020
- In 2020, AI to enable acceleration from automation to autonomy, say experts - Robot Report - January 5th, 2020
- Improving Your Manufacturing Productivity and Quality with CMM Networking and Automation - Quality Magazine - January 5th, 2020
- Listen to top VCs discuss the next generation of automation startups at TC Sessions: Robotics+AI - TechCrunch - January 5th, 2020
- How the most vulnerable workers to job automation can adapt - Yahoo Money - January 5th, 2020
- DevOps The Troubles Of Automating All The Things - JAXenter - January 5th, 2020
- The unsettling grip of the automated gods | News, Sports, Jobs - Williamsport Sun-Gazette - January 5th, 2020
- Automation and AI will launch a golden age of marketing - The Drum - January 5th, 2020
- Hashtag Trending Automation predictions for 2020 - ITBusiness.ca - January 5th, 2020
- Stories that will define the next decade: Automation will likely cause changes to the ports of LA, Long Beach - The Daily Breeze - January 5th, 2020
- True automation, a bigger streaming revolution: Tech that will take over our lives this year - Economic Times - January 5th, 2020
- Robotic Process Automation Market Size, Outlook on Key Growth Trends, Factors and Forecast to 2026 - ReportsPioneer - January 5th, 2020
- Home Automation Is Taking Control On The Upper Cape - CapeNews.net - January 5th, 2020
- Despite Chaotic Year, Automation, AI Offer Benefits to Indian IT Industry - Analytics Insight - January 5th, 2020
- How AI may be the key to future-proofing jobs at risk of being automated - Employee Benefit News - January 5th, 2020
- The End of the Road for Spreadsheets? - Automation World - January 5th, 2020
- What is Automation | IBM - December 31st, 2019
- Automation benefits and costs - Economics Help - December 31st, 2019
- Save 15% on Automation - The Car Company Tycoon Game on Steam - December 31st, 2019
- Pricing - Automation | Microsoft Azure - December 31st, 2019
- Automation | Definition of Automation at Dictionary.com - December 31st, 2019
- What is Automation?- ISA - December 31st, 2019
- Using robotic process automation to manage revenue cycles - Healthcare IT News - December 31st, 2019
- Guest Post: Why 2020 Will be Better Than 2019 in Automation - Robotics Business Review - December 31st, 2019
- 5 Robotic Process Automation Trends To Look For In 2020 - Inc42 Media - December 31st, 2019
- Vanguard: automation is great until it doesn't work - FX Week - December 31st, 2019
- Crestview Weighed IPO of JR Automation Before Clinching $1.4 Billion Sale - Barron's - December 31st, 2019
- What Jobs Will be Lost to Automation? - San Diego Entertainer Magazine - December 31st, 2019
- Energy Asset Performance Management to Take on Automation - IoT World Today - December 31st, 2019
- How to get started with HomeKit home automation - Cult of Mac - December 31st, 2019