Charles shut down royal couple's big move