what if the blocks weren't there, but the hand movements remained the same? What if the blocks were various sizes? What if they were various sizes but some of them were glued together?
2 problems with this
1) muscle motion as it relates to pressure from real objects. to give an easy example: try to wiggle your ears. now put a pair of glasses on and try to adjust them by wiggling your ears. it's very easy to do it with glasses on, but an entirely different (and more difficult) process to do it without. this is the same with those cubes. the isolation of your fingers in space as they relate to the box can be easily performed because the box is there...take the box away and now those same isolations require in intensely greater amount of coordination and muscle control.
2) as yejoon pointed out, reference. what makes the box a box as you move it in space without it being there? how can you get people to 'see' the edges? it's probably going to end up looking like a squishy blob to an onlooker as you move it around in space.