Caffeine is the most widely consumed psychoactive drug in the world. Natural sources of caffeine include coffee, tea, and chocolate. Synthetic caffeine is also added to products to promote arousal, alertness, energy, and elevated mood. Over the past decade, the introduction of new caffeine-containing food products, as well as changes in consumption patterns of the more traditional sources of caffeine, has increased scrutiny by health authorities and regulatory bodies about the overall consumption of caffeine and its potential cumulative effects on behavior and physiology. Of particular concern is the rate of caffeine intake among populations potentially vulnerable to the negative effects of caffeine consumption: pregnant and lactating women, children and adolescents, young adults, and people with underlying heart or other health conditions, such as mental illness. Here, we review the research into the safety and safe doses of ingested caffeine in healthy and in vulnerable populations. We report that, for healthy adults, caffeine consumption is relatively safe, but that for some vulnerable populations, caffeine consumption could be harmful, including impairments in cardiovascular function, sleep, and substance use. We also identified several gaps in the literature on which we based recommendations for the future of caffeine research.