Swap out that cashmere sweater for a fleece, keeping the look just as classically preppy with a pair of ankle-crop jeans and loafers.