Andrew is 'worried' about how William is going to 'deal with' him