There will be undoubtedly be a capacitor to ground which will be a ceramic.. might want to replace these with monolithic which carry less noise ( the problem you are having). That and solid grounding should limit any noise to a whisper