There must always be those scholars, true to the faith, who are learned in Hebrew and Greek and can instruct us on the meaning of the original text. These men and women safeguard the integrity of our translations, and bring the Word of God into many other languages where it has not been available.
But, I think fluency is superfluous to the general work of the local church. Rather, I think is makes sense to give pastors and lay members the right tools to be able to consider the fullness of meaning in an original language and the context of concepts and words in the Scriptures. Such tools like a decent concordance and lexicon, and commentaries like Robertson's Word Pictures.
The American church (the biblical, evangelical church, that is) seems to be ever learning, and never doing. Let's work on bringing the light of the gospel to relationships and bring the divorce rate back down below 50%. Let's bring the peace to the inner city (I live in Philadelphia, where murders are skyrocketing). Let's be good stewards of the resources we have, good givers, good senders, good doers. Solid theology requires a trustworthy translation of the Scriptures. We have many, so let's put the Word into practice!
All that being said, I think you're handicapped only if your service for the kingdom requires the use of Hebrew and Greek! You aren't handicapped in so many areas to which you could devote many lifetimes of service.