You are a Canadian citizen. I think it's fair that they would look at your situation (a Canadian who hasn't lived in Canada and never paid taxes, etc) as something unusual. This is the type of thing immigration get's bagged on all the time when something goes wrong. If all it takes is a few simple things from you to establish yourself a bit more, why not do it? Would save you a lot of hassle. Not doing it just doesn't add up.
Simply: Don't get all self-righteous. It's a small thing.