We present an implementation of the canonical formulation of second-order Møller-Plesset (MP2) perturbation theory within the projector-augmented-wave method under periodic boundary conditions using a plane wave basis set. To demonstrate the accuracy of our approach we show that our result for the atomization energy of a LiH molecule at the Hartree-Fock+MP2 level is in excellent agreement with well converged Gaussian-type-orbital calculations. To establish the feasibility of employing MP2 perturbation theory in its canonical form to systems that are periodic in three dimensions we calculated the cohesive energy of bulk LiH.