I've rather enjoyed it. I can understand the frustration, though. I just try to look at it as simply a blog and not even think about the $. You're not doing too bad so far. I think if you hold firm, the following will come.

I'm also looking to boost my fellow minnows and prodding the dolphins to pay note to new/active posts that have great content but are getting buried under their weight. In the meantime, I think we should actively work to push other minnows up that are otherwise getting overlooked.

It's also a growing community. As the community expands, the active interests of the readership should rise which I think will help. I'm also prodding my own social network following to get involved. It will be work, but I think it's worth it.