Recent studies suggest that intraspecific genetic diversity in one species may leave a substantial imprint on the surrounding community and ecosystem. Here, we test the hypothesis that genetic diversity within host-plant patches translates into consistent and ecologically important changes in the associated herbivore community. More specifically, we use potted, grafted oak saplings to construct 41 patches of four saplings each, with one, two, or four tree genotypes represented among the host plants. These patches were divided among two common gardens. Focusing first at the level of individual trees, we assess how tree-specific genotypic identity, patch-level genetic diversity, garden-level environmental variation, and their interactions affect the structure of the herbivore community. At the level of host-plant patches, we analyze whether the joint responses of herbivore species to environmental variation and genetic diversity result in differences in species diversity among tree quartets. Strikingly, both species-specific abundances and species diversity varied substantially among host-tree genotypes, among common gardens, and among specific locations within individual gardens. In contrast, the genetic diversity of the patch left a detectable imprint on local abundances of only two herbivore taxa. In both cases, the effect of genetic diversity was inconsistent among gardens and among host-plant genotypes. While the insect community differed significantly among individual host-plant genotypes, there were no interactive effects of the number of different genotypes within the patch. Overall, additive effects of intraspecific genetic diversity of the host plant explained a similar or lower proportion (7-10%) of variation in herbivore species diversity than did variation among common gardens. Combined with the few previous studies published to date, our study suggests that the impact of host-plant genetic diversity on the herbivore community can range from none to nonadditive, is generally low, and reaches its most pronounced impact at small spatial scales. Overall, our findings strengthen the emerging view that the impacts of genetic diversity are system, scale, and context dependent. As the next step in community genetics, we should then start asking not only whether genetic diversity matters, but under what circumstances its imprint is accentuated.