For sure! But then, he can just go and get them and take them with him. I'd have to assume a) language, and b) narrative convenience. But language may be plausible on its own, considering he didn't learn to read until he was forty. Perhaps he thinks he can't learn in a different language.

...and as I write this, I remember it's canon that most of the books in his house - at least at one point - were travel books. So maybe he thought about it, or researched it, or just dreamed of different places but never managed to take the step. *pats him*