Cotton is best, but really anything that won't scratch or get your hand oils on it is fine. There are simple white cotton gloves that are dirt cheap that are the standard.
https://www.amazon.com/COOBL-Cotton-Gloves-Jewelry-Inspection/dp/B0765V75RG/