First, you have no way to prove that he was speaking only to the apostles in that context because Acts 1:21-22 asserts that others were continually ASSEMBLING with Christ from the baptism of John to the ascension or else they would have no one to choose to replace Judas. So you cannot prove this is said to merely apostles but could have been directed to the whole church. Moreover, Matthew 18:17-18 grammatically demands the keys are in the hands of the whole "church" not its eldership or else step two in Matthew 18:16 would be call the elders and/or step three would be call the elders.
No Apostle claimed this right and Paul provides more written literature on remission of sins than any apostle and yet he never claimed the ROMAN CATHOLIC interpetation of these words.
___________________________________________________________________________________________________
The proof lies in the interpretation and practice from the very origins of the Church. Your interpretation (Baptist) was totally foreign to the Early Church. Can you show me that your interpretation was held or ever espoused in the Early Church? Here is the historical writings which support the Catholic practice of confession to a priest. Check out the dates of these writings. Do you have any historical writings that say these beliefs were ever in dispute in the Early Church?
"In church confess your sins, and do not come to your prayer with a guilt conscience. Such is the Way of Life...On the Lord's own day, assemble in common to break bread and offer thanks; but first confess your sins, so that your sacrifice may be pure." Didache, 4:14,14:1 (c. A.D. 90).
"Moreover, it is in accordance with reason that we should return to soberness[of conduct], and, while yet we have opportunity, exercise repentance towards God. It is well to reverence both God and the bishop." Ignatius, Epistle to the Smyraeans, 9 (c. A.D. 110).
"Father who knowest the hearts of all grant upon this Thy servant whom Thou hast chosen for the episcopate to feed Thy holy flock and serve as Thine high priest, that he may minister blamelessly by night and day, that he may unceasingly behold and appropriate Thy countenance and offer to Thee the gifts of Thy holy Church. And that by the high priestly Spirit he may have authority to forgive sins..." Hippolytus, Apostolic Tradition, 3 (A.D. 215).
"The Pontifex Maximus--that is, the bishop of bishops--issues an edict: 'I remit, to such as have discharged (the requirements of) repentance, the sins both of adultery and of fornication.'" Tertullian, Modesty, 1 (A.D. 220).
"In addition to these there is also a seventh, albeit hard and laborious: the remission of sins through penance...when he does not shrink from declaring his sin to a priest of the Lord." Origen, Homilies on Leviticus, 2:4 (A.D. 248).
"It is necessary to confess our sins to those whom the dispensation of God's mysteries is entrusted." Basil, Rule Briefly Treated, 288 (A.D. 374).
"All mortal sins are to be submitted to the keys of the Church and all can be forgiven; but recourse to these keys is the only, the necessary, and the certain way to forgiveness. Unless those who are guilty of grievous sin have recourse to the power of the keys, they cannot hope for eternal salvation. Open your lips, them, and confess your sins to the priest. Confession alone is the true gate to Heaven." Augustine, Christian Combat (A.D. 397).
"Just as in the Old Testament the priest makes the leper clean or unclean, so in the New Testament the bishop and presbyter binds or looses not those who are innocent or guilty, but by reason of their office, when they have heard various kinds of sins, they know who is to be bound and who loosed." Jerome, Commentary on Matthew, 3:16,19 (A.D. 398).
It is not Biblical and you have absolutely no scripture to show it is Biblical.
What I have is proof that the Early Church interpreted the scriptures just as the Catholic Church of today does.
No different than John hearing the confession of sins prior to baptizing those who believed in Christ (Jn. 3:36) demanding "fruits meet for repentance" for baptism.
These Early Church writings contradict your claim.
Of course, if ANYTHING can be found in the Early Church Fathers writings to be heretical or in error, you will automatically throw out anything else they said whether it is biblically supported or not. They didn't always agree on every point of doctrine. I don't know anyone who believe that everything an ECF ever said is orthodox and biblical, but there are many doctrines of the Christian faith that they were are all in agreement on. These writings concerning 'confession to a priest' is a good example.