Being Casual Is Not as Easy as It Sounds When they decide to dress down, members of the royal family still need to follow a specific dress code. Ladies can wear a smart day dress or trousers with a jacket, while men can wear chinos, a collared shirt, and a blazer. Image Source: Getty / Chris Jackson