SteemWorld ~ Weekly Support ~ #3
[EN]
This post is intended to cover the server costs for SteemWorld.org and to enable me to continue my development in the future.
In case you missed the first part:
SteemWorld ~ Weekly Support ~ #1
[DE]
Dieser Post ist dafür gedacht die Serverkosten für SteemWorld.org zu decken und mir in Zukunft weitere Entwicklungen zu ermöglichen.
Falls du den ersten Teil verpasst haben solltest:
SteemWorld ~ Weekly Support ~ #1
Decisions Made
I'm going to order a few new servers in the coming weeks, one of them in the next days already. The current server that is handling the requests from SteemWorld is definitely not sufficient for the things which I've planned in the near future.
The coming 'Post Finder' requires much more SSD memory than I currently have available because I need to index much more data and my SQLite databases would eat my server to 100%. I will order two new dedicated machines / Xeon E5 (4c @ 3.7GHz) with 2x480GB SSD (Raid), 64GB DDR4 ECC 2133 MHz.
The blockchain is growing fast and a full-text index on the body column for all posts in the chain comes with some crazy requirements. My local machine was dead after indexing only 20%. SSD full, HDD to slow (would take months). Even if a large part of the coding for the Post Finder is done already I can't really test it yet.
The good thing is: I've found a high quality hoster that is way cheaper than my current one. The bad thing is: I need to move my data and reconfigure the whole setup.
Step One: Witness
Many people asked me why I'm no witness yet and my answer has been something like "I won't run any software on my server that I don't fully trust/understand". Maybe I'm different than most witnesses who just started the job via kind of a 'start witness' button. There is no automated way when it comes to understanding the core and I want to be able to react to unforseeable misbehaviours by myself. Quality always needs time and experience.
I'm currently writing some handy shell scripts for my coming witness servers so that I can install, update and configure the dockerized steemd instances in a comfortable way. My goal is to have an own 'Steem-in-the-box' like solution with some more possibilities for setting up the node configuration (memory management for example). I'm going to make it open source and publish the scripts on GitHub, when all works fine and tests/optimizations have been made.
Main Menu -> Node Setup
Set node type -> Exchange
Set account name for tracking transfers -> 'exchange-name'
Main Menu -> Start Node
Soon ;)
Step Two: Post Finder
As the contract with my current hoster will still be active for a month from now, I'm going to move SteemWorld to the new server in about three weeks. After that I can begin implementing the Post Finder.
In Between: Improved Node Request Caching
The new caching feature for account operations will be activated in the coming days. It will improve loading times for repeated page visits by caching the operations data and storing the last received op index in a cookie.
In The Making
Post Finder
The following images show how the new feature could look like, but there are already a few changes planned that are not being shown in there. As mentioned, I'm going to index the body content of all posts on my new server, so that we finally have a way to search for posts by text/words very fast. This feature wasn't planned from the beginning and it increases the server requirements a lot but I have to think bigger here and I want to be prepared for future additions.
Default Image View
Zoomed Image View
Links
EN | What is SteemWorld?
-> Welcome to SteemWorld.org!
DE | Was ist SteemWorld?
-> Willkommen auf SteemWorld.org!
Weekly Tip
We have summer, dude!
The sun won't visit you in your basement... ^^
Thank you for supporting my work!
Positive thoughts create a positive world. It all begins with connecting our thoughts with emotions. We are the creators of our world.
Much Love,
Test
Good work, man! We are using #steemworld everyday and enjoy the tool a lot! :)
Indeed, well done @steemchiller! :)
It seems you're moving to a highload environment. On this road you should reconsider your tech stack choices. SQLite is deffinitely not an option. At least you will need Postgres.
Also decomposition to a set of microservices helps. E.G. your main current server doesn't need to run the same host or even environment that Post Finder. And on some point of time you will hit a wall by data volume and should decompose your data for hot and cold storage. For example Post Finder probably won't be used for old posts so we can move old texts to Sta HDD or even Hadoop storage.
You run a cool service, contact me if I could help - I will do it gladly. Here or at Telegram @br0nevik
Supported with full upvote.
lieber Chiller, @krnel ist ein sehr guter und bekannter steemian, der soeben einen tollen artikel über deine steemworld herausgebracht hat. schau mal vorbei. lg
https://steemit.com/steemworld/@krnel/steemworld-org-my-favorite-steemapp
Ich danke dir für die Info @pawos!
Dann haben wir ja bald alle 'Großen' mit an Bord... ^^
LG, Chiller
Thanks you for what is already the most useful support site available for Steemit. And it just keeps getting better!
Most useful stats site by far! You have my vote, and witness vote for that matter.
Now I have been wondering about running a witness, you mention one click witness lol that sounds like me. Most likely just be a backup witness all said and done. Wondering about that affordable host you mentioned, will it work for a witness? I have a lot to learn still but I am getting a name for myself as founder of #OneLoveDTube founder and would love to be the OneLove witness 😎
Posted using Partiko iOS
Thanks man!
That's a good question and we will know the answer soon... :) I've thought about all this for a while and maybe it's good when someone makes the test by trying alternatives.
I often read statements like 'keep in mind that even established hosters may not work for your witness node' and many Steem witnesses won't take the risk of trying something new. In the end it leads to a centralized bunch of witnesses all using the same service...
Soon we know ;)
I have been thinking the same thing about centralized witnesses, proof is in the effect on the network when dealing with an “attack”.
Definitely going to try keep up with your findings on this front.
Posted using Partiko iOS
Great work as always! Glad to hear you're actively looking into setting up a witness... and I like that you're going the independent route with it. That is quality.
Great work as always! You deserve all support there is!
I use SteemWorld every day, multiple times per day. I’d be lost without it. Looking forward to even more incredible and helpful features 🙌🏻
Posted using Partiko iOS
Glad you are considering becoming a witness. My vote is standing by.
Also glad to see you putting... something on GitHub ;) maybe someday.... anyway, as I said last week and the week before, thank you for SteemWorld.
Wow! I'm so happy to finally READ your post, @steemchiller. Opened it several times from the loading thingie when I visit SteemWorld, but never clicked over to read before this.
I enjoyed reading your plans for development and appreciate your steady short to long term vision and step by step method of building and testing your offerings until you get them the way you want to... then go again at evolving it all again.
Thank you.
ABSOLUTELY! This REALLY made me smile.
I LOVE SteemWorld. Didn't find out about it until about six or so weeks ago but I now use it every single day and couldn't imagine not having it. Mostly for mentions but also searches and VP. I know I'm not using it as much as I could but my understanding of what it offers will grow. ;)
I look forward to you declaring your Witness. You'll have my vote. And in the meantime, gave you 100% of the little juice I wield and will support these Weekly Support posts from now on. Bless you and all that you're doing. Resteeming.