Bees require large amounts of pollen for their own reproduction. While several morphological flower traits are known to have evolved to protect plants against excessive pollen harvesting by bees, little is known on how selection to minimize pollen loss acts on the chemical composition of pollen. In this study, we traced the larval development of four solitary bee species, each specialized on a different pollen source, when reared on non-host pollen by transferring unhatched eggs of one species onto the pollen provisions of another species. Pollen diets of Asteraceae and Ranunculus (Ranunculaceae) proved to be inadequate for all bee species tested except those specialized on these plants. Further, pollen of Sinapis (Brassicaceae) and Echium (Boraginaceae) failed to support larval development in one bee species specialized on Campanula (Campanulaceae). Our results strongly suggest that pollen of these four taxonomic groups possess protective properties that hamper digestion and thus challenge the general view of pollen as an easy-to-use protein source for flower visitors.