"But it really needs mobile devices capable of doing the processing locally"

I would think this shouldn't be a problem as the correct hardware gets adopted in phones. As it stands now, you could probably run it on a Coral USB accelerator and battery run Pi (just an example of hardware, obviously we don't have the code).