Luke was combining the wall project with practical Jedi training, so he was only using his hands to hold up a portion of the wood and using his mind to keep the rest from falling on him.

If it helped distract him from the incredibly disturbing guy-in-the-flannel-bikini, so much the better.