That's pretty similar to my thinking, most of the time. It still stings, though, when I try to set some very basic limits in the form of "I can't talk now, I'm busy" and then get an earful about how controlling I am. So I guess I need to work on expecting that, and not taking it to heart.
Re: On places one cannot leave: a rambling