You're just human my friend. I get what you are saying and been there myself. But I am now in the position where I wish some folks where still around to take some of my time. It is a balancing act. Seems you may be doing a good job of it. Or at least the best you can. Don't beat yourself up.
Also, booze always makes a conversation with cousins and in-laws go smoother. :)