A pastor's primary responsibility is the pulpit. Serving the physical needs of people in the church, including social visitation, is primarily the job of the deacons (Acts 6). This doesn't mean that we don't care about people, or do nice things for them, or make them feel welcome...we just don't use our study time, and pulpit time, for jobs that are rightly someone else's for, "Act 6:2 And the twelve summoned the full number of the disciples and said, "It is not right that we should give up preaching the word of God to serve tables."
So that is a big part of this: for too long the church has been viewed like a business, with the pastor seen as a salesman sent to round up dissatisfied customers.
But I will also tell you another big part of it. For the last 20-30 years or so, church participation has dropped off A LOT. So people come to church, they drop money in the plate, but a person actually getting involved is rare. And so what happens is us "younger pastors" of small churches, end up doing EVERYTHING. After fixing the sound system, the roof, and the air conditioner, and squeezing in some study time, you don't really have time to do anything else.
ESPECIALLY if you have a family. Us "younger pastors" have a wife, and kids, that "older" pastors don't have to deal with...and these deserve our time as well.