Do I add water if broth is almost gone?

Yes, you should add some water. Otherwise, the lentils will dry out. I'd add about half a cup and then check in a half an hour. If it looks dry again, add a bit more. ;o)