Quantum repeaters rely on an interfacing of flying qubits with quantum memories. The most common implementations include a narrowband single photon matched in bandwidth and central frequency to an atomic system. Previously, we demonstrated the compatibility of our versatile source of heralded single photons, which is based on parametric down-conversion in a triply-resonant whispering-gallery mode resonator, with alkaline transitions [Schunk et al., Optica 2, 773 (2015)]. In this paper, we analyze our source in terms of phase matching, available wavelength-tuning mechanisms, and applications to narrow-band atomic systems. We resonantly address the D1 transitions of cesium and rubidium with this optical parametric oscillator pumped above its oscillation threshold. Below threshold, the efficient coupling of single photons to atomic transitions heralded by single telecom-band photons is demonstrated. Finally, we present an accurate analytical description of our observations. Providing the demonstrated flexibility in connecting various atomic transitions with telecom wavelengths, we show a promising approach to realize an essential building block for quantum repeaters.