If you have a small face like Eva Longoria or Selena Gomez, it’s all about proportion, says Inlander. “If you have a small face you need a smaller hat, whereas a larger face needs a bigger, more dramatic hat. Using the same principal, petite figures should avoid big hats; while larger women should avoid hats that are too small,” she says.

So think “small” (beanies are great since they sit tight on the head and don’t overwhelm your face), and make sure to avoid hats with a large crown or brim — they’ll swallow your face whole.

Next: The best hat recommendations for small faces