The present work proposed a nanocellulose (NC)-silver nanoparticles (AgNPs) embedded pebbles-based composite material as a novel reusable cost-effective water purification device for complete removal of dyes, heavy metals and microbes. NC was prepared using acid hydrolysis of cellulose. The AgNPs were generated in situ using glucose and embedded within the porous concrete pebbles by the technique of inter-diffusion of ion, providing a very strong binding of nanoparticles within the porous pebbles and thus preventing any nanomaterials leaching. Fabrication of a continual running water purifier was achieved by making different layering of NC and Ag nano-embedded pebbles in a glass column. The water purifier exhibited not only excellent dye and heavy metal adsorption capacity, but also long-term antibacterial activity against pathogenic and non-pathogenic bacterial strains. The adsorption mainly occurred through electrostatic interaction and pore diffusion also contributed to the process. The bed column purifier has shown 99.48% Pb(II) and 98.30% Cr(III) removal efficiency along with 99% decontamination of microbial load at an optimum working pH of 6.0. The high adsorption capacity and reusability, with complete removal of dyes, heavy metals and Escherichia coli from the simulated contaminated water of composite material, will provide new opportunities to develop a cost-effective and eco-friendly water purifier for commercial application.