Ruminants sustain a long-lasting obligatory relationship with their rumen microbiome dating back 50 million years. In this unique host-microbiome relationship, the host’s ability to digest its feed is completely dependent on its coevolved microbiome. This extraordinary alliance raises questions regarding the dependent relationship between ruminants’ genetics and physiology and the rumen microbiome structure, composition, and metabolism. To elucidate this relationship, we examined the association of host genetics with the phylogenetic and functional composition of the rumen microbiome. We accomplished this by studying a population of 78 Holstein-Friesian dairy cows, using a combination of rumen microbiota data and other phenotypes from each animal with genotypic data from a subset of 47 animals. We identified 22 operational taxonomic units (OTUs) whose abundances were associated with rumen metabolic traits and host physiological traits and which showed measurable heritability. The abundance patterns of these microbes can explain high proportions of variance in rumen metabolism and many of the host physiological attributes such as its energy-harvesting efficiency. Interestingly, these OTUs shared higher phylogenetic similarity between themselves than expected by chance, suggesting occupation of a specific ecological niche within the rumen ecosystem. The findings presented here suggest that ruminant genetics and physiology are correlated with microbiome structure and that host genetics may shape the microbiome landscape by enriching for phylogenetically related taxa that may occupy a unique niche.