And CRob is right: people blast AS selections but hold Gold Gloves as sacrosanct.
You're right. I don't trust them, either. Ozzie Smith by most accounts was the greatest fielding shortstop of the modern era, but he probably didn't deserve the last few he got. He won them on reputation.
MVP and Cy Young are a bit more accurate, but not totally.
While the BBSWA are not perfect and give a lot of unqualified people votes, I really do believe they are more objective judges of performance than fans or managers.