I'm looking for a non-butter substitute that isn't going to break the bank for a college student budget
Are you channeling your best self with this comment? (If you're not sure, check out our Code of Conduct.)
What are you trying to make? That may help people know what will work if you give your recipe.
I don't have much experience with it but sometimes, but not always you can just use coconut or other vegetable oil. Otherwise peanut/almond/cashew butter for the coconut butter. Maybe mashed banana or applesauce and a bit of extra oil.
There really isn't any substitute for coconut milk where it is a main ingredient like a thai curry. I'd just make something else. But you might be able to use yogurt, almond milk, soy milk, evaporated milk. There is coconut milk powder that can be reconstituted.