my coconut based soup is too spicy can i add more milk?

Sure. You could make another batch or 1/2 batch and just leave whatever is spicy out. I don't know what other ingredients are involved or how too spicy it is, but just adding CM may dilute other flavors.