A lot of people don't think about how hard validation can be. You need a lot of high quality labeled data to confidently say that your algorithm works. I don't see a way around this even if learning algorithms become very data-efficient.