Sometimes a fermented fruit can be cooked with some vinegar or simple syrup and you can make a glaze or a syrup for a future something. If I were to do this I would refrigerate what I made and taste when cold. If it still tastes "off" to you, toss it, yes, but I often add random bits & bobs to muffin batter and no one is the worse for it.

I would probably get rid of them -- better safe than sorry!