Add potatoes to a large pot of salted water. Bring to a boil, and let it cook until a fork slides in the potatoes easily. Drain and transfer to a large mixing bowl or pot.
Add the buttermilk, sour cream, goat cheese, celery seeds and salt and pepper to the potatoes. Smash until they are creamy, but still have lumps. Stir in the celery at the end, just to incorporate. Serve piping hot with some delicious food!