i think keeping the 3d AR aspect of it and moving the object/mesh with a very intuitive controller for 3d sculpting instead of having to turn my head and walk around behind it to modify it is the way to go.