William deliberately 'distanced himself from Harry'