This is caused by one item of clothing intersecting with another. You can improve this by playing around with the simulation settings, but the process of smoothing this out is far too detailed to go into here.
Perhaps more importantly, it's unlikely you'll get quick and accurate answers regarding MD on this forum. You really need to address these concerns in the MD forum itself where there is a far greater density of experts in the field.