I believe the crawlers tend to overlook Steemit, they probably don't want to promote a decentralized system that they have no control over Google ads. But anyway these SEO algorithms are complex and ever changing. So its very hard to understand all the facts of getting indexed.