🔝 Most popular websites on Steem: Analysis of the Steem BlockchainsteemCreated with Sketch.

in #utopian-io7 years ago (edited)

Most popular websites on Steem

In this post I will show what are the most popular URL's, Websites and Social Profiles on Steemit by analyzing the Steem blockchain with Python. I have made the code open source here https://github.com/codewithcheese/steem-mentions. I wanted to include the data but after processing every URL on the blockchain it comes to 2GB, which is too large for GitHub. Look at the methodology section below for how to generate the data on your own machines.

Why is this useful?

When Smart Media Tokens were announced I thought "Who will be the early adopters? What publishers might adopt SMT's?". To start answering that question I wanted to see what websites and social profiles Steemian's interacted with. By looking at the top URL's, websites and social media profiles we can gain some insight into the Steem communities reach on the Internet.

Utopian + Steem is awesome for open source

I am writing this as a Contributor Report on Utopian.io. Utopian is an amazing project by fellow Steemian @elear. A Steem platform site that focuses on rewarding open source contribution. Check out @elear's post to see how Steem + Open Source using Utopian.io has the power to change the world for good. https://utopian.io/utopian-io/@elear/utopian-the-begin-of-a-new-shared-meritocratic-economy

Results

I am going to jump right into the results for those of you not interested in the technical details. If you want to know how I did it you can scroll down to the The methodology section below.

The results are in 3 sections. URL's results for individual URLs, Websites result for mentioned Domains and Social Media results for Twitter, Facebook and of course Steemit.

URL's

Top 50 mentioned URL by number of authors

Here are the top 50 URL's mentioned in posts ordered by the number of individual authors. As you can see nearly every URL is Steem or Crypto related. I was surprised by this, I thought we would see a little more variety. This may be explained by the early days of Steem attracting mostly Crypto interested authors. Share your thoughts in the comments.

url num_authors
coinmarketcap.com/ 543
steemit.com/~witnesses 438
www.steemit.com/~witnesses 373
steemit.com 346
pixabay.com 256
pixabay.com/ 256
steem.io/SteemWhitePaper.pdf 255
bittrex.com/ 247
vimeo.com 244
steemit.com/images/steemit-share.png 224
steemit.com/ 220
coinmarketcap.com 216
poloniex.com/ 196
steemitimages.com/DQma5mbjPtLaw2HYWdyUogvU1KH6CbUR9peeoWdB35PCBhk/steemit-share.png 196
steemitimages.com/DQmRhDtjokAZnGKi4QwheqksKTFo6m4fsjMYsNNrsitC1xk/DQmRhDtjokAZnGKi4QwheqksKTFo6m4fsjMYsNNrsitC1xk.gif 183
steemd.com/ 179
coinmarketcap.com/ 174
coinmarketcap.com/currencies/steem/ 173
steemit.chat 173
www.myetherwallet.com/ 171
i.imgur.com/YSt1Mis.gif 168
steemtools.com/ 166
twitter.com/bobbyclee/status/865851769116475392 158
blocktrades.us/ 156
poloniex.com 149
bittrex.com 145
www.exodus.io/ 144
steemd.com 137
www.bitcoincash.org/ 133
eos.io/ 132
www.genesis-mining.com 132
bitcoin.org/bitcoin.pdf 128
www.genesis-mining.com/ 128
discord.gg/HYj4yvw 119
www.ethereum.org/ 118
steem.io/ 116
www.steemnow.com/ 115
steemit.chat/home 114
steemvoter.com/ 114
steemit.chat/ 112
streemian.com/ 112
steemnow.com/ 109
steemd.com/distribution 109
dtube.video/ 108
steemd.com/witnesses 107
golem.network/ 106
www.coinbase.com/ 105
sia.tech/ 103
steemstats.com 103
www.bitfinex.com/ 102

Top 50 with highest average vote

Here are the top 50 URL's with the highest average vote mentioned by at least 10 authors. This is my attempt to find some of the URL's that might not be the most popular but that Steemit users like the most.

url avg_votes
discord.gg/S37bYma 901.145455
www.steemvoter.com 768.897887
www.peerhub.com/ 682.867521
steemit.com/witness/@teamsteem/what-are-steem-witnesses-and-why-you-should-support-them 658.971429
steemit.com/buildteam/@buildteam/launching-the-buildteam-token 630.166667
steemit.com/witness-category/@reggaemuffin/witness-reggaemuffin 543.111111
steemit.com/minnowbooster/@minnowbooster/introducing-minnowbooster-beta 532.238095
steemit.com/almost-famous/@teamsteem/hello-steemit-coinmaketcap-com-introduced-me 523.034483
steemit.chat/channel/curie 516.731034
steemit.com/steemit/@donkeypong/announcing-project-curie-bringing-rewards-and-recognition-to-steemit-s-undiscovered-and-emerging-authors 502.166667
markdownpad.com/ 499.853659
www.minnowbooster.net/delegate 491.642857
steemit.com/promoting-steem/@teamsteem/creating-the-world-we-long-for 489.310345
steemit.com/contest/@papa-pepper/bonus-round-of-the-wild-and-strange-contest-250-steem-payout-an-attempt-to-boost-moral-and-increase-community-fun-and 459.416667
www.minnowbooster.net/market 424.880000
steemit.com/steemit/@the-alien/announcement-jumpstarting-new-tags-rewarding-comments-boosting-engagement-and-going-viral 398.882353
steemd.com/@minnowbooster 378.571429
steemit.com/translation/@papa-pepper/operation-translation-now-under-construction-what-it-is-and-how-you-can-help 377.394762
steemit.com/minnowbooster/@minnowbooster/6rt2mn-introducing-minnowbooster-beta 348.588235
steemit.com/eos/@eosio/eos-io-technical-white-paper 336.333333
steemit.com/esteem/@good-karma/esteem-spotlight-top-users-and-giveaway-2-2017623t85513623z 336.058824
steemit.com/@thecryptofiend 331.455621
steemdb.com/witnesses 325.403846
www.youtube.com/watch?v=oQSilwOySU8 320.378378
steemit.com/~witnesses 320.137500
esteem.ws 308.361111
www.mumble.com/mumble-download.php 307.166667
steemit.com/steem/@steemitblog/consensus-reached-for-hardfork-17-18-the-new-features-are-yours-on-thursday-march-30th-at-11am-est 301.357143
steemfest.com 297.600000
steemit.com/@ericvancewalton 296.666667
creativecommons.org/publicdomain/zero/1.0/deed.en 272.393443
steemit.com/steemfest/@stellabelle/win-a-trip-to-steemfest-submit-a-3-minute-video 263.720000
steemit.com/steemit/@donkeypong/announcing-steem-guild-a-second-stage-project-to-continue-supporting-good-authors-after-project-curie 262.241176
itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=1141397898&mt=8 260.970588
www.youtube.com/watch?v=VuYURpAIa4I 260.800000
steemit.com/dpos/@dantheman/dpos-consensus-algorithm-this-missing-white-paper 260.777778
bitcoinwisdom.com/markets/bitfinex/btcusd 257.769231
steemit.com/steemprentice/@sykochica/steemprentice-steemit-mentoring-group-launch-announcement 256.072464
www.youtube.com/watch?v=K6uR0A9cC5Y 255.111111
steemit.com/steemit/@firepower/successful-2-india-steemit-accelerator-and-steem-cryptocurrency-meetup-2017-at-robert-bosch-india-hq 251.631579
steemvoter.com 246.266234
t.me/Peerplays 243.250000
steemit.com/steem/@steemitblog/important-notification 242.750000
ipfs.io 240.266667
steemit.com/steem/@dantheman/building-long-term-value-from-your-blog 238.272727
steemit.com/@furion 236.222222
creativecommons.org/licenses/by-sa/3.0 235.071429
steemitimages.com/DQmRHxe6LLLr1qMi84PxNTB2AHuVk51csUmGTfDoevD7sPP/image.png 234.545455
www.steemithelp.net 233.685358
steemit.com/@steemship 233.052632

Top 20 URL's by highest average payout

Here are the top 20 URL's mentioned in posts with the highest average payout by at least 10 different authors. This is attempt to find some of the most valued websites by the Steem community. However I think this list is skewed by some URL's that whales regularly include in their posts.

url total_payout
www.steemit.com/@steemdrive 37585.703
github.com/xeroc/piston 47905.119
www.bravenewcoin.com/steem 23633.304
www.blocktrades.us 21939.083
www.expanse.tech 20865.044
www.youtube.com/watch?v=YkJ7zxdpUwE 19667.129
anarchapulco.com 25368.469
steemit.com/books/@federicopistono/hi-steem-community-i-am-the-author-of-robots-will-steal-your-job-but-thats 18287.280
i.imgur.com/hX8LV01.png 15688.495
steemit.com/steemit/@teamsteem/a-bit-about-steemit 13278.872
steemit.com/steem/@jesta/building-a-high-availability-steemd-node-for-web-apis 10862.894
steemit.com/introduceyourself/@teamsteem/make-more-steem-verify-your-introduction-posts 13178.835
steemit.com/joy/@teamsteem/steem-the-most-enjoyable-governance-tool-ever-devised 14184.357
dollarvigilante.com 14616.087
beta.chainbb.com/chainbb/@jesta/chainbbcom-a-blockchain-forum-platform-for-steem 9659.715
steemit.com/money/@teamsteem/money-are-tokens-of-influence-with-the-purpose-of-facilitating-bliss 9615.526
www.amazon.com/Steemit-101-Discover-Social-Content-ebook/dp/B01HC47NLU 40082.394
i.imgur.com/do6Qt9I.png 16052.166
steemit.com/science/@timsaid/myth-or-fact-20-a-penny-dropped-off-the-empire-state-building-kills-you 10215.198
steemit.com/christmas/@timsaid/myth-or-fact-13-does-santa-claus-exist 10215.198

Websites

OK, we just looked at individual URL's now lets look at domains. I will only include websites sorted by number of authors. Sorting websites by average vote or other metrics did not yield very different resuls since the results are dominated by the image sites and large websites that every one mentions. I think it would be interesting to remove the largest websites but Ill have to leave that for another day.

Top 50 websites by number of authors

Here are the top 50 websites by number of mentions by unique authors. As you can see image sites and popular social networks are commonly linked to.

domain num_authors
steemitimages.com 68390
youtube.com 30941
steemit.com 20290
youtu.be 16894
imgur.com 9854
facebook.com 9818
wikipedia.org 8166
esteem.ws 7583
twitter.com 7297
wordpress.com 6612
postimg.org 6122
pixabay.com 6102
blogspot.com 6020
google.com 5963
imgsafe.org 5864
fbcdn.net 5064
dtube.video 4241
ipfs.io 4208
wikimedia.org 4190
pinimg.com 4161
instagram.com 3785
github.com 3597
ytimg.com 3534
giphy.com 3513
medium.com 3120
goo.gl 3070
amazonaws.com 3023
twimg.com 3013
wp.com 2836
coindesk.com 2794
coinmarketcap.com 2765
reddit.com 2733
cointelegraph.com 2556
tumblr.com 2521
bitcointalk.org 2362
amazon.com 2251
steemimg.com 2245
soundcloud.com 2229
ipfsstore.it 2096
bitcoin.com 1956
vimeo.com 1848
tinypic.com 1842
googleusercontent.com 1789
staticflickr.com 1738
cloudfront.net 1723
bit.ly 1708
businessinsider.com 1671
theguardian.com 1631
dailymail.co.uk 1605
cryptocoinsnews.com 1549

Twitter

Most mentioned statuses by unique authors

Here we have the most mentioned twitter statuses by number of authors. Im suprised at how little overlap there is. This might require more preprocessing to match similar statuses. Bobby Lee's Twitter competition to list STEEEM on BTCC saw huge support.

url num_authors
twitter.com/bobbyclee/status/865851769116475392 158
twitter.com/bobbyclee/status/864155469899644928 60
twitter.com/bobbyclee/status/862908660707540992 18
twitter.com/realDonaldTrump/status/881503147168071680 16
twitter.com/VitalikButerin/status/879127496024772610 11
twitter.com/YourBTCC/status/908285586368167936 11
twitter.com/IamNomad/status/908831764457672709 9
twitter.com/officialmcafee/status/887012614131372032 9
mobile.twitter.com/bobbyclee/status/865851769116475392 8
twitter.com/agurevich23/status/907692985424371712 7
twitter.com/bobbyclee/status/865851769116475392 6
twitter.com/luluyilun/status/906163511658557440 6
twitter.com/avsa/status/755144980008697857 6
twitter.com/kyletorpey/status/890253492190945285 5
twitter.com/officialmcafee/status/887024683379544065 5
twitter.com/btcecom/status/889918430228492289 5
twitter.com/wikileaks/status/829693251133272064 5
twitter.com/naval/status/877467629308395521 5
twitter.com/wikileaks/status/829324362943696896 5
twitter.com/realdonaldtrump/status/881503147168071680 5
twitter.com/maxkeiser/status/754110399666987009 5
twitter.com/SatoshiLite/status/911328252928643072 5
twitter.com/ArcadeCityHall/status/754784578489896960 5
twitter.com/CNBCFastMoney/status/908089342605889536 5
twitter.com/bobbyclee/status/865851769116475392 5
twitter.com/hitbtc/status/872800553432219649 5
twitter.com/SatoshiLite/status/873343321296429056 5
twitter.com/JUN_Omise/status/902844287557148673 5
twitter.com/JoshuaBaer/status/754036505203453952 4
twitter.com/pbartstephens/status/907727923536265216 4
twitter.com/huobicom/status/868442008402014208 4
twitter.com/VitalikButerin/status/879127496024772610/photo/1 4
twitter.com/hitbtc/status/903223626887032832 4
twitter.com/ViaBTC/status/888813075368886272 4
twitter.com/wikileaks/status/827828627488268290 4
twitter.com/john_lam/status/888442492051259392 4
twitter.com/inthepixels/status/888876843176271872 4
twitter.com/CharlieShrem/status/890254097009565697 4
twitter.com/SiaTechHQ/status/877172219679563778 4
twitter.com/ArcadeCityHall/status/754059398335631361 4
twitter.com/etherdelta/status/906027544696168449 4
twitter.com/omise_go/status/897472052457684993 4
twitter.com/maraoz/status/887755889897295872 4
twitter.com/wikileaks/status/828889235994324992 4
twitter.com/i/web/status/864155469899644928 4
twitter.com/KimDotcom/status/865987139166552064 4
twitter.com/bobbyclee/status/864155469899644928 4
twitter.com/bobbyclee/status/865851769116475392 4
twitter.com/JulianAssange/status/882430554544713728 3
twitter.com/FloydMayweather/status/875104754334023680 3

Most mentioned Twitter accounts

Here we have the most mentioned twitter accounts order by number of unique authors. This is a great list to see who Steemians follow on twitter. However, it is domainated by those interested in Crypto. I would like to see this list narrowed for some other tags.

url num_authors
twitter.com/blocklancer 35
twitter.com/CCS_Crystal 35
twitter.com/cosscrypto 30
twitter.com/SatoshiLite 23
twitter.com/ 22
twitter.com/bitquence 22
twitter.com/aantonop 21
twitter.com/ToneVays 20
twitter.com/atlantio 20
twitter.com/ex_scudo 20
twitter.com/steemit 20
twitter.com/insurextech 19
twitter.com/UTRUST_Official 19
twitter.com/domraider 18
twitter.com/BitJob_Team 17
twitter.com/changefinance 17
twitter.com/iconominet 16
twitter.com/joinindorse 16
www.twitter.com/theswarmfund 16
www.twitter.com/Centra_Card 15
twitter.com/VitalikButerin 15
twitter.com/reality_clash 15
twitter.com/amandab_johnson 15
twitter.com/Nimfamoney 15
twitter.com/beone_co 14
twitter.com/Centra_Card 14
twitter.com/IMMLA_io 14
twitter.com/fundyourselfnow 13
twitter.com/rogerkver 13
twitter.com/GenesisMining 13
twitter.com/PowerLedger_io 12
twitter.com/wcxofficial 12
twitter.com/CarTaxi_24 12
twitter.com/MadBitcoins 12
twitter.com/TaaSfund 12
twitter.com/sonmdevelopment 12
twitter.com/coindashio 12
twitter.com/on_place 12
twitter.com/easymineio 12
twitter.com/realDonaldTrump 12
twitter.com/KICKICOplatform 12
twitter.com/LunyrInc 11
twitter.com/minexcoin 11
twitter.com/OAX_Foundation 11
twitter.com/STeX_Exchange 11
twitter.com/bowheadhealth 10
twitter.com/rivetzcorp 10
twitter.com/bobbyclee 10
twitter.com/PolybiusBank 10
twitter.com/eos_io 10

Steemit.com

Most mentioned URL's

Here are the top 50 most mentioned Steemit.com URL's ordered by number of unique authors

url num_authors
steemit.com/~witnesses 438
www.steemit.com/~witnesses 373
steemit.com 346
steemit.com/images/steemit-share.png 224
steemit.com/ 220
steemit.com/video/@heimindanger/introducing-dtube-a-decentralized-video-platform-using-steem-and-ipfs 101
steemit.com/images/steemit-share.png 91
steemit.com/faq.html 88
steemit.com 86
img1.steemit.com/0x0/i.imgsafe.org/b87bb98157.gif 83
steemit.com/@luzcypher 79
steemit.com/tags 77
steemit.com/welcome 77
steemit.com/market 72
steemit.com/colorchallenge/@kalemandra/new-colorchallenge-for-all-steemians 63
steemit.com/steem/@ned/announcing-smart-media-tokens-smts 63
steemit.com/@dollarvigilante 56
steemit.com/monomad/@brumest/monomad-photographic-contest-2nd-week-topic 55
steemit.com/@cervantes 55
www.steemit.com/~witnesses 54
steemit.com/trending/steemit 54
steemit.com/ 51
steemit.com/blog/@darthnava/fellow-steemers-i-need-help-as-my-mri-results-are-not-encouraging 49
steemit.com/steemfest/@roelandp/save-the-date-steemfest-2017-creamy-and-delicious-1-2-3-4-5-november-lisbon 48
steemit.com/monomad/@brumest/monomad-photographic-contest-week-6-topic-flowers 47
steemit.com/monomad/@brumest/monomad-photographic-contest-week-3-topic-silhouettes 47
steemit.com/monomad/@brumest/monomad-photographic-contest-week-8-topic-buildings 46
steemit.com/@jerrybanfield 45
steemit.com/steemit/@donkeypong/still-confused-by-steem-steem-dollars-and-steem-power-the-power-plant-analogy 45
steemit.com/trending/photography 44
steemit.com/bwphotocontest/@daveks/b-and-w-photo-contest-new-theme-announcement-plants 44
steemit.com/@minnowsupport 44
steemit.com/steemit-guides/@pfunk/a-full-steemit-user-s-guide-to-steem-witnesses 44
steemit.com/ 44
steemit.com/cn/@htliao/anime-character-drawing-challenge-or-50-sbd-prize-pool-or-50-sbd 43
steemit.com/minnowbooster/@minnowbooster/introducing-minnowbooster-beta 43
steemit.com/steem/@dan/steemit-s-evil-plan-for-cryptocurrency-world-domination 42
steemit.com/monomad/@brumest/monomad-photographic-contest-week-4-topic-abstract-please-read-the-rules 42
steemit.com/introduceyourself/@dantheman/daniel-larimer--co-founder-of-bitshares-steemit 42
steemit.com/memechallenge/@fibra59/meme-challenge-33-winners-of-32-doubled-reward-pool-for-33 41
steemit.com/minnowsupportproject/@minnowsupport/minnow-support-project-problem-statement-vision-statement-mission-statement-and-plan-to-help-you-grow-from-minnow-to-whale-with 41
steemit.com/monomad/@brumest/monomad-photographic-contest 41
steemit.com/@ned 40
steemit.com/pick_account 40
steemit.com/spanish/@don.quijote/concurso-de-nanocuentos-don-quijote- 40
steemit.com/steemit/@noisy/we-just-hacked-11-accounts-on-steemit-1158-sbd-and-8250-steem-is-under-our-control-but-we-are-good-guys-so 38
steemit.com/created 37
steemit.com/beauty/@guerrint/the-first-steemit-makeup-turtorial-bringing-youtubers-to-steemit 36
steemit.com/bwphotocontest/@daveks/b-and-w-photo-contest-new-theme-announcement-food 35
steemit.com/trending/steem 35

Most mentioned accounts

Here are the top 50 most mention Steemit.com accounts ordered by number of unique authors.

url num_authors
steemit.com/@luzcypher 79
steemit.com/@ned 74
steemit.com/@jerrybanfield 67
steemit.com/@papa-pepper 60
steemit.com/@dollarvigilante 56
steemit.com/@cervantes 55
steemit.com/@dan 51
steemit.com/@dantheman 50
steemit.com/@minnowsupport 44
steemit.com/@eosio 30
steemit.com/@randowhale 28
steemit.com/@stellabelle 28
steemit.com/@cheetah 26
steemit.com/@eeks 25
steemit.com/@officialfuzzy 24
steemit.com/@craig-grant 23
steemit.com/@good-karma 23
steemit.com/@steemitblog 22
steemit.com/@steemitmarket 21
steemit.com/@steemvoter 20
steemit.com/@trevonjb 20
steemit.com/@kalemandra 20
steemit.com/@jesta 20
steemit.com/@crypt0 20
steemit.com/@roelandp 20
steemit.com/@steemsports 19
steemit.com/@sweetsssj 19
steemit.com/@blocktrades 19
steemit.com/@steemfest 18
steemit.com/@minnowbooster 18
steemit.com/@stellabelle 18
steemit.com/@donkeypong 18
steemit.com/@ausbitbank 18
steemit.com/@pfunk 17
steemit.com/@poloniex/transfers 17
steemit.com/@berniesanders 16
steemit.com/@curie 16
steemit.com/@fyrstikken 16
steemit.com/@booster 16
steemit.com/@jesta 16
steemit.com/@officialfuzzy 15
steemit.com/@heiditravels 15
steemit.com/@lukewearechange 15
steemit.com/@corbettreport 15

Facebook

Most mentioned Facebook URL's

Here we have the top 50 Facebook URL's order by number of unique authors

url num_authors
facebook.com/steemitmarket 62
www.facebook.com/ 58
www.facebook.com/CCSer/ 33
www.facebook.com/cosscrypto/ 26
www.facebook.com/blocklancer 26
www.facebook.com/groups/ICoLR/ 19
www.facebook.com/utrust.io/ 18
www.facebook.com/steemit/ 17
www.facebook.com/InsureX-1467549329975479 17
www.facebook.com/rsrc.php/v3/y4/r/-PAXP-deijE.gif 17
www.facebook.com/Mandarin.exchange 14
www.facebook.com/beoneco/ 14
www.facebook.com/nimfamoney 14
www.facebook.com/exscudo 13
www.facebook.com/bitJobmarket/ 13
www.facebook.com/TrueFlip.io/ 13
www.facebook.com/fundyourselfnow/ 13
www.facebook.com/exscudo/ 13
www.facebook.com/CentraCard 13
www.facebook.com/groups/steemitnow/ 12
www.facebook.com/icoShowcase/ 11
www.facebook.com/bitquence/ 11
www.facebook.com/dentcoin 11
facebook.com/atlantplatform/ 11
www.facebook.com/kickicoplatform 10
www.facebook.com/bowheadhealth 10
www.facebook.com/taasfund 10
www.facebook.com/MinervaToken/ 10
www.facebook.com/groups/cryptocurrencycollectorsclub/ 9
www.facebook.com/PayPiePlatform 9
www.facebook.com/Anarchast/?f... 9
www.facebook.com/gilgames.platform 9
www.facebook.com/bitquence 9
www.facebook.com/Domraider-1432606216988548/ 9
www.facebook.com/groups/welovesteemit/ 9
www.facebook.com/Monaco-Card-1355426087883151/ 8
www.facebook.com/iconomi.net/ 8
facebook.com/LukeWeAreChange 8
www.facebook.com/iDiceIO/ 8
www.facebook.com/vibehubvr/ 8
www.facebook.com/relestio 8
www.facebook.com/minexcoin 8
www.facebook.com/crowdindicator 8
www.facebook.com/bitclave 8
m.facebook.com/MAGOS.io/ 8
www.facebook.com/coindash.io/ 8
www.facebook.com/immlaio/ 7

Top 50 Facebook user names

Here we have the top 50 Facebook user names order by number of unique authors.

url num_authors
facebook.com/steemitmarket 62
www.facebook.com/blocklancer 26
www.facebook.com/InsureX-1467549329975479 17
www.facebook.com/Mandarin.exchange 14
www.facebook.com/nimfamoney 14
www.facebook.com/exscudo 13
www.facebook.com/CentraCard 13
www.facebook.com/dentcoin 11
www.facebook.com/taasfund 10
www.facebook.com/bowheadhealth 10
www.facebook.com/kickicoplatform 10
www.facebook.com/gilgames.platform 9
www.facebook.com/PayPiePlatform 9
www.facebook.com/bitquence 9
www.facebook.com/bitclave 8
www.facebook.com/crowdindicator 8
www.facebook.com/minexcoin 8
facebook.com/LukeWeAreChange 8
www.facebook.com/relestio 8
www.facebook.com/lbryio 7
www.facebook.com/AlexanderEme... 7
www.facebook.com/powerledger 7
facebook.com/dentcoin 7
facebook.com/exscudo 7
www.facebook.com/Zappl-1564113593599270 7
www.facebook.com/Rivetz-1409224065995167 6
www.facebook.com/PawnHero.ph 6
www.facebook.com/RTnews 6
www.facebook.com/risevisionteam 6
www.facebook.com/steemit 6
www.facebook.com/iconomi.net 6
facebook.com/xfcfootballcoin 6
www.facebook.com/EgaasProject 6
www.facebook.com/joinindorse 6
www.facebook.com/orocrypt 6
www.facebook.com/vivacoin 5
www.facebook.com/profile.php?... 5
www.facebook.com/TED 5
www.facebook.com/steemitbc 5
facebook.com/RealityClash 5
www.facebook.com/Easymine.io 5
www.facebook.com/craig.freedom 5
facebook.com/TheTrendsCommunity 5
facebook.com/lewis.hilsenteger 5
work-12050764.facebook.com/ 5
facebook.com/dashingamandabjoh... 5
www.facebook.com/arkecosystem 5
www.facebook.com/propyinc 5
www.facebook.com/EventChain 5

The methodology

One great thing about the Steem blockchain is all the data is easily and publicly available. However, there are many ways to access that data and some work better for me than others. My approach was to process blockchain and in order to create two CSV's one for URL's and one for authors. I then analyzed the CSV's using Jupyter Notebooks and Pandas.

The URL's CSV contains the URL from every post along values such as author, votes, payout. The authors CSV contains account data from every post author such as balances and reputation. This way I could join the URL's and Account data to be able to analyze URL's based on reputation.

Iterating blocks with Steem-Python

build_urls_from_steemd.py
My first attempt was to use the Steem python client https://github.com/steemit/steem-python and to iterate through every block. This turned out to be extremely slow. It appears you have to request one block at a time, even though there are methods that allow you to request a range of blocks they are simple requesting individual blocks behind the scenes. My connection here is 100Mb's so i'm not really sure why it was so slow. Can any one comment a faster way to iterate through the blocks?

Enter SteemData.com

build_urls_from_mondodb.py
After realizing that my method for iterating through the blocks was too slow. I thought about using SteemData.com by @furion. SteemData allows one to access blockchain data via MongoDB, MySQL and WebAPI. I noticed the MongoDB has a collection Posts which contains every post. Perfect. All I needed to do then was iterate through every post, extract the URL's using a simple regex and then create a CSV, one line for each URL along with relevant values from the post.

Author data

url_authors_from_mongodb.py
Once I had the URL data, I could now build the Authors CSV by iterating each unique author in the URL's CSV and requesting the username from Accounts collection in MongoDB. This gave me the reputation values, and the current Steem/SBD/SP balances.

Time to analyze

Most mentioned websites.ipynb
With the data at hand I fired up Jupyter Notebook. Jupyter Notebook is a tool for doing literal programming loved by data scientists. It allows you to mix markdown and code while maintaining the program state as you write block by block. This allows for easy experimentation with datasets. Pandas is a fantastic python library for working with structured dataset such as CSV or Excel. It makes it really easy to load up a CSV and start slicing and dicing to produce to results you are looking for.

Have a look at the notebook file GitHub to see how I got these results. GitHub displays them almost exactly as they appear when working on them.

I start out by loading up the CSV's into a Pandas DataFrame's and then join the datasets using pd.merge to create a new url_with_author_data DataFrame. I then wrote a function to group that DataFrame allow with aggregations which provide the stats num_authors total_reputation avg_reputation total_votes avg_votes. Now I can group the data by URL's and domains and sort by one of the metrics to get the results you see in the tables above.

What's next?

Trends what has become more or less popular over time.
Tags most popular sites in different categories (tags)
Monthly Show what new websites have become popular for the current month.

Have your say Let me know in the comments what you would like to see next!


I'm an Australian entrepreneur currently in South Korea. I frequently travel between Australia, Bali, South East Asia and South Korea. I focus mainly on software based businesses and am excited by how social and business model innovation, blockchain tech and artificial intelligence are changing the world.

You can keep updated with what i am working on by following me on Steemit @codewithcheese

Sort:  

Coin Marketplace

STEEM 0.23
TRX 0.26
JST 0.040
BTC 97958.64
ETH 3474.00
USDT 1.00
SBD 3.26