But this only works if you push each commit separately. If you push them all at once, it only tests the last one. Also, whenever you rebase, only the last commit is tested.

I tested this here: https://github.com/liskin/nodejs-hello-world/pull/1