The VLT LBG Redshift Survey - II. Interactions between galaxies and the IGM at z similar to 3