It is often lamented that a prophet has no honor in his own village.
I suspect it's because people closest to him are acquainted with his ordinariness, and his ordinariness blocks out the greatness, like dense trees block out a view of the forest. The people closest to him may also know his weaknesses or sins, which tend to cancel out his greatness.
I would think it's a good state of affairs, at least for the prophet. After a long day of prophesying–of addressing audiences, giving advice, being interviewed–he would probably want to wind down and drink a cold beer with those who don't revere him. Every person, after all, is ultimately ordinary, and it's no fun–and hardly comfortable–to be deemed otherwise.
