Agreed. In the earlier books it's not a big deal. But in a lot of the later books you'll start seeing references to characters or events from other books that you might miss if you haven't read them...