Forgot important ingredient

Fudge can be very finicky....you may be able to melt it down and recrystallize it, but I imagine that may be difficult. I know you may have expected a flavor of orange, but I would try to fudge and see if you like the flavor and just repurpose your intentions. If its not sufficient for you, and you're not going to be happy with it, you might as well try to melt it down, flavor it and recrystallize it.