You can already get close to this with near eye light field displays[1], but the resolution suffers massively. As a bonus though, it can correct for a glasses prescription in software.

1: http://research.nvidia.com/publication/near-eye-light-field-...