There's the nbval plugin for pytest. https://nbval.readthedocs.io/en/latest/ I've used that in one of my packages (https://github.com/qucontrol/krotov) to verify example notebooks on every push, on Travis CI