You put it so well, I love that:

The important part I think is not to leave that 'wondering place' wishing to have stayed.

But I think many people do. You're right, it's great to be able to imagine other lives, but it's now always beneficial. Especially when you start liking the vision more than your life.