Oh, yeah, definitely that should also be illegal. If you want to train an ML model you should have to pay directly for that data, not in connection with any other service or product. The current system means every successful monopolist is also a de facto nigh-unassailable leader in ML, which clearly sucks. "Create or buy a massive spying service" shouldn't be a necessary step 1 to realistically competing in consumer- and human-focused ML.
I disagree, many times the very reason I gave the company my data was to leverage their ML capabilities. For example, the only reason I gave LinkedIn my data was so they could find me better jobs. No one would have bothered if it were just a glossier version of Craigslist.
Plus, banks training models for fraud detection has an obvious benefit to everyone.
