We are judged for Adam's sin.
Romans 5:12-14 Therefore, just as sin came into the world through one man, and death through sin, and so death spread to all men because all sinned— 13 for sin indeed was in the world before the law was given, but sin is not counted where there is no law. 14 Yet death reigned from Adam to Moses, even over those whose sinning was not like the transgression of Adam, who was a type of the one who was to come.
Unfortunately, this will likely be a hit-and-run post. Much to do.
Paul is clear that those who lived from Adam to Moses--though there was no Law (as in the OT Law, that's Paul's common usage)--still died.
Adam's sin was imputed to all his progeny. This is why everyone died. Let's say that Adam had a great-great grandson named, for lack of a better term, Fred. There was no Law in Fred's time, no rules to break, and, therefore, no sin to commit. Yet, Fred died in due time. If there was no sin on Fred's account, why did he die? Because Adam's sin spread to all men and all men are counted guilty before God for what Adam did.
Now, I know you Arminian-types don't like this notion of the imputation of Adam's sin. However, if you don't accept the imputation of Adam's sin and the guilt that entails, you cannot hope to accept the imputation of Christ's righteousness.
Blessings,
The Archangel