The ex-con should be empowered to decide upon release whether his criminal record is public or private. The only time a private record will be read is in sentencing him for a subsequent conviction.
The flip side to allowing this is the probability of incentivization/intimidation by gov't to cover up past prosecutorial wrong-doings. There's no good solutions it seems.