The gamma-ray afterglows of tidal disruption events