No, it is not a contradiction.God is perfect, yet not all men are saved. This is a contradiction that is not argued well by your position.
Scripture states that God is not pleased to destroy the wicked, yet Scripture also states that God will destroy the wicked. This does not make God less than perfect (in fact, it is exactly the opposite).
How do you believe it does?