The present study attempts to treat S. aureus-induced soft skin infections using a combinatorial therapy with an antibiotic, Ciprofloxacin (CIP), and an efflux pump inhibitor 5-Nitro-2-(3-phenylpropoxy) pyridine (5-NPPP) through a smart hydrogel delivery system. The study aims to reduce the increasing rates of infections and antimicrobial resistance; therefore, an efflux pump inhibitor molecule is synthesized and delivered along with an antibiotic to re-sensitize the pathogen towards antibiotics and treat the infections. CIP-loaded polyvinyl alcohol (PVA) hydrogels at varying concentrations were fabricated and optimized by a chemical cross-linking process, which exhibited sustained drug release for 5 days. The compound 5-NPPP loaded hydrogels provided linear drug release for 2 days, necessitating the need for the development of polymeric nanoparticles to alter the release drug pattern. 5-NPPP loaded Eudragit RSPO nanoparticles were prepared by modified nanoprecipitation—solvent evaporation method, which showed optimum average particle size of 230–280 nm with > 90% drug entrapment efficiency. The 5-NPPP polymeric nanoparticles loaded PVA hydrogels were fabricated to provide a predetermined sustained release of the compound to provide a synergistic effect. The selected 7% PVA hydrogels loaded with the dual drugs were evaluated using Balb/c mice models induced with S. aureus soft skin infections. The results of in vivo studies were evidence that the dual drugs loaded hydrogels were non-toxic and reduced the bacterial load causing re-sensitization towards antibiotics, which could initiate re-epithelization. The research concluded that the PVA hydrogels loaded with CIP and 5-NPPP nanoparticles could be an ideal and promising drug delivery system for treating S. aureus-induced skin infections.