Using the blade of a large chef knife, apply enough pressure using the palm of your hand to pop out the pits from the cherries. Once all the cherries have been pitted, line them on the bottom of a buttered pie dish.
Whisk the flour and eggs together first, then whisk in the butter, followed by the sugar and baking powder. Whisk together the buttermilk and vanilla, and then pour the buttermilk mixture into the batter until smooth.
Pour the batter over the cherries, and then place in the oven for 50 minutes or until the top is golden brown. Dust with powdered sugar and serve immediately. Store any leftovers and eat the next morning for breakfast.