Would it be a total waste to make this recipe if I don't use whole fat milk?
No -- not at all! Butternut squash makes such a velvety soup, even when you just use stock or water. Of course milk and cream are always good, but It's very flexible.
No need to add any dairy at all if you'd rather not -- just use another cup or so of stock when you're making the soup.