von Neumann played a major role in the development of the nuclear weapons. Not just the Manhattan project, but also in the development of the hydrogen bomb and ICBMs. It's pretty likely that those are the secrets the government was guarding in 1953.