This is some old stuff from Andy Wilson at MSR.
I am actually realy surprised that a lot of this thinking hasn't ended up being explored on Surface yet. It seem like the easiest opportunity for Surface to really reinvent interaction.
3D Modelling and unmediated interaction
Any thoughts on this? Is the resolution of Surface too low?