I think there's not an easy way or filter to eliminate the distortion since you have to recover the fabric pattern deleted by the moire.
Here an approach making a photomontage duplicating and, rotating and masking this part in different layers and masking: