You cannot possibly have all the active followers all the time but you gotta make sure that you engage with most of them so that they keep on checking out your blog regularly. I agree there are some bots / inactive followers whom you cannot do anything about. But you have to keep majority of your followers active.. nice on you to reflect on the issue.. ^_^