First simultaneous optical/near-infrared imaging of an X-ray selected, high-redshift cluster of galaxies with GROND The galaxy population of XMMU J0338.7+0030 at z=1.1