Although the Steem/SBD fluctuations affect payouts, and the whales can and do loose interest, there is another factor at play over the long-term that needs to be looked at: the growing SP of your followers.

As you build up a follower base, the voting power of each follower grows over time as each minnow builds up their SP stacks. This growth has a compounding effect!