Cupcakes with a peanut mousse, do I have to store them in the fridge?

Depends on when you plan to serve them. They could reasonably live outside of the fridge for up to four hours at room temperature. But for long term storage definitely keep them in the fridge when they are filled with a mousse.