No you can achieve a very comfortable effect with a very small field of view, the difference is due to inaccuracies in positioning resulting from not having a close enough approximation of the eye's position or too low of a frame rate so the image is lagging behind motion. All of this stuff has been very actively developed by the VR community.