Sometimes some do, yes. I'm certain enough of that. You're right that it can be pretty complicated, though.
I don't remember Roland ever actually refusing to talk about the Tower. I think we might indeed be able to guess what he wants to find, or at least what he hopes to find... but not without a pretty full thread.