If you have one or two small cups of coffee every day, you don't need to stress, but if you're a big coffee drinker, you'll need to make some changes. Dr. Zaher explained that "high levels of caffeine consumption have been associated with decreased fertility." This means you would have to drink five cups of coffee or its equivalent each day to decrease your chances of getting pregnant.