Regarding NT books that were disputed but which ultimately made the canon:
Hebrews, James, Jude, 2 Peter, 2 John , 3 John, and Revelation (to John)
(at least James through Revelation were still disputed in the East by the time Eusebius wrote his CHURCH HISTORY in the early 4th century, and Hebrews was still disputed in the West, including Rome, through the 4th century)
Books that had a measure of local canonicity but ultimately did not make the canon:
Didache, First Clement (Epistle to the Corinthians), Epistle of Barnabas, Shepherd of Hermas, and a couple of others like Apocalypse of Peter and Gospel of Hebrews.
(In fact First and Second Clement are included in Codex Alexandrinus after Revelation, while Barnabas and (parts of )Shepherd are listed in Codex Sinaiticus after Revelation)
Books that were outside of orthodoxy and never considered for the canon:
Gospel of Thomas, Gospel of Peter, Gospel of Matthias, Acts of Andrew, Acts of John (all mentioned by Eusebius as heretical and rejected by the Church), and many others like them--ie Gospels of Philip, of Judas, of Mary, etc.
(see Eusebius' THE CHURCH HISTORY, primarily section 3:25 among others)
The earliest list of NT books which exactly matches our 27 book canon is from Athanasius, Bishop of Alexandria, in his Festal Letter in AD 367. The Councils of Hippo and Carthage at the end of the 4th and beginning of the 5th century confirmed this 27 book list.
...And I'm in general agreement with Agnus' sig line (I'm Anglican, not Eastern Orthodox). Chronologically the Church indeed preceded the NT; the founding members of the Church, the Apostles, wrote the NT (under the inspiration of the Holy Spirit); and the Church recognized and determined the limits of canonical scriptures; and the Church defended the correct interpretation of the same in response to the misinterpretations of the heretics (ie Arians, Sabellians, Marcionites, and the like). Even the OT Scriptures were correctly interpreted by Christ to the Apostles (Luke 24) and then proclaimed as being fulfilled in Jesus of Nazareth to the Jews and then the Gentiles (as recorded in Acts). The early Church even used OT books that the non-Christian Palestinian Jews ultimately omitted like Wisdom of Sirach, Wisdom of Solomon and other 'Deuterocanonicals'.