A third object in the vicinity of a binary system causes variations in the eccentricity and the inclination of the binary through the Kozai-Lidov effect. We examine if such variations leave a detectable imprint on the gravitational waves of a binary consisting of intermediate mass black holes and stellar mass objects. As a proof of concept, we present an example where LISA may detect the Kozai-Lidov modulated gravitational wave signals of such sources from at least a distance of 1Mpc if the perturbation is caused by a supermassive black hole tertiary. Although the quick pericenter precession induced by general relativity significantly reduces the appropriate parameter space for this effect by quenching the Kozai-Lidov oscillations, we still find reasonable parameters where the Kozai-Lidov effect may be detected with high signal-to-noise ratios.