For decades, ecologists have hypothesised that exposure to plant secondary compounds (PSCs) modifies herbivore-associated microbial community composition. This notion has not been critically evaluated in wild mammalian herbivores on evolutionary timescales. We investigated responses of the microbial communities of two woodrat species (Neotoma bryanti and N. lepida). For each species, we compared experienced populations that independently converged to feed on the same toxic plant (creosote bush, Larrea tridentata) to naïve populations with no exposure to creosote toxins. The addition of dietary PSCs significantly altered gut microbial community structure, and the response was dependent on previous experience. Microbial diversity and relative abundances of several dominant phyla increased in experienced woodrats in response to PSCs; however, opposite effects were observed in naïve woodrats. These differential responses were convergent in experienced populations of both species. We hypothesise that adaptation of the foregut microbiota to creosote PSCs in experienced woodrats drives this differential response.