Small angle neutron scattering (SANS) and fluorescence correlation spectroscopy (FCS) measurements were carried out on agarose hydrogels to link their microscopic structure to the diffusivity of solutes at different scales. SANS allowed for the determination of the distribution of void volumes within the gels. They were shown to be compatible with a random network of cylindrical fibers as described by the Ogston model. FCS measured solute diffusivity in spaces similar in size to the void volumes, and thus, the results reflected the gel heterogeneity. Solute diffusivity was predicted by modeling the gel as microscopic geometrical cells. Variations in the diffusivity of solutes of different sizes could be predicted from the structural parameters of the gel using theory, taking into account obstruction by cylindrical cells and solute hydrodynamics. Prediction of the FCS autocorrelation functions for solutes from a cell model demonstrated a lack of sensitivity of this technique for multicomponent analysis.