The hairy/furry layer between the shell and the nut is impossible to remove.
Are you channeling your best self with this comment? (If you're not sure, check out our Code of Conduct.)
Amanda is a co-founder of Food52.
I don't know of any way to prevent that, although it helps if the chestnuts were harvested awhile ago. If they were just harvested, that furry layer will cling more tightly, whereas if they've been harvested for days that layer will begin to dry and will cling less.