I am with you, as of now I use a paper notebook for all that. But in a previous (more predictable) life I was using task warrior and time warrior and was very happy with it. Especially since it also runs on android and you can just sync the data.

If you like Command line applications and need something that is good for many tasks in nested projects and time tracking capabilities (e.g. as happens in software world) it is worth checking out.