In Romans 10 Paul speaks of those who haven't heard saying, "How can they believe in whom they have not heard?" In this regard, those who haven't heard the gospel can't believe the gospel. This is true of those in John 6. Israel was being blinded (hardened) from the truth (John 12:39-41), and the message hadn't even been sent to the Gentiles yet (Acts 28:28).
So, its not because they were born "totally depraved" that they can't come to Jesus. It is because they (Israel) are being hardened in their rebellion. The exception is the remnant of Israel who have been reserved from the hardening process and chosen for noble purposes (i.e. apostleship). That is why Jesus in John 6 goes on to say, "65 He went on to say, "This is why I told you that no one can come to me unless the Father has enabled him." 66 From this time many of his disciples turned back and no longer followed him. 67 "You do not want to leave too, do you?" Jesus asked the Twelve."
So, the mistake Calvinists make when reading John 6 is to presume that Jesus' audience can't come to Christ because they are born Totally Depraved and non-elect, when in reality John 12:39-41 tells us exactly why they can't come:
39 For this reason they could not believe, because, as Isaiah says elsewhere: 40 "He has blinded their eyes and deadened their hearts, so they can neither see with their eyes, nor understand with their hearts, nor turn--and I would heal them."
This is what Paul is talking about in Romans 11 when he speaks of Israel being "cut off" and the Gentiles being "grafted in."
So you are not really than an Arminianist , as classically, they believe same way as cals do , that man as a result of the fall and born into sin, are both depraived and unable to come to Christ apart from God doing a work of grace on our behalf? that even IF we have the Gospel preached to us, without God enabling us, cannot respond in faith?
Bot cals/Arms affirm that as being true!