We need better tools and ability to track this stuff. Pretty amazing we can have a super powered chatbot that can answer any question but I can’t find an excel sheet that tracks historical prices of goods in a meaningful way.
Also I bet it would be illegal to create that excel sheet in some way.
I believe we’re now entering a new era online. AI has now made scrapping a much more lucrative business. I think we will see a greater effort to build walls so company’s have to pay for this information.
We’re dealing with people who get their way strictly through the court system. Reddit and twitter won’t be the last company to make these changes.
This next decade will be all about hording information online. Its like the modern day version of arguing whose cows were eating what on whose land. Lawyers are salivating at the next decade and the losers will be all of us.
ChatGPT could be used a trojan horse to get webscrapping made illegal. Companies will fight tooth and nail if people had a good ability to see their price history. There are apps to do it. But it requires a lot of time and the data isn’t always reliable or not available
We need better tools and ability to track this stuff. Pretty amazing we can have a super powered chatbot that can answer any question but I can’t find an excel sheet that tracks historical prices of goods in a meaningful way.
Also I bet it would be illegal to create that excel sheet in some way.
There are many such apps. Search for price trackers.
Not illegal. Check out CamelCamelCamel.com
Not fully legal either though. We’ll see much more pressure to make it illegal in the next few years
That’s just not true.
This article describes the grey area pretty well and it also links to a legal case.
https://www.scraperapi.com/blog/is-web-scraping-legal/
I believe we’re now entering a new era online. AI has now made scrapping a much more lucrative business. I think we will see a greater effort to build walls so company’s have to pay for this information. We’re dealing with people who get their way strictly through the court system. Reddit and twitter won’t be the last company to make these changes.
This next decade will be all about hording information online. Its like the modern day version of arguing whose cows were eating what on whose land. Lawyers are salivating at the next decade and the losers will be all of us.
Not only is such a thing not illegal, I found half a dozen in 2 seconds on Google.
ChatGPT could be used a trojan horse to get webscrapping made illegal. Companies will fight tooth and nail if people had a good ability to see their price history. There are apps to do it. But it requires a lot of time and the data isn’t always reliable or not available
I’ve been using Keepa for this for years in Firefox.