I find that people, including church people, are very judgmental toward the poor. The idea is that they must be poor because they have a character flaw. And that is often true.
Of course, we all have a character flaw: the flesh. But God does not call us to judge the poor, but to be generous to them and to treat them fairly, not taking advantage of them. I have been convicted of this over the last several years. I try to always give something to everyone who asks me. If I get the chance to share the gospel, I do that also. But, regardless, I give them something. God puts me to the test regularly and I try to be faithful.
Try to do what the Bible says without excuses. It will change you.