Since the colonization of land by ancestral plant lineages 450 million years ago, plants and their associated microbes have been interacting with each other, forming an assemblage of species that is often referred to as a “holobiont.” Selective pressure acting on holobiont components has likely shaped plant-associated microbial communities and selected for host-adapted microorganisms that impact plant fitness. However, the high microbial densities detected on plant tissues, together with the fast generation time of microbes and their more ancient origin compared to their host, suggest that microbe-microbe interactions are also important selective forces sculpting complex microbial assemblages in the phyllosphere, rhizosphere, and plant endosphere compartments. Reductionist approaches conducted under laboratory conditions have been critical to decipher the strategies used by specific microbes to cooperate and compete within or outside plant tissues. Nonetheless, our understanding of these microbial interactions in shaping more complex plant-associated microbial communities, along with their relevance for host health in a more natural context, remains sparse. Using examples obtained from reductionist and community-level approaches, we discuss the fundamental role of microbe-microbe interactions (prokaryotes and micro-eukaryotes) for microbial community structure and plant health. We provide a conceptual framework illustrating that interactions among microbiota members are critical for the establishment and the maintenance of host-microbial homeostasis.