Daily snapshots of Hivemind
If you don't have a private steemd, the initial sync. time of the Hivemind takes around 6-7 days. This is indeed quite a time to wait.
In order to make that process faster. I have decided to distribute daily Hivemind database snapshots. If you're interested in running a Hivemind node, then you can import this snapshot before running hive sync.
I have made a test install on a fresh server and it took 4 hours to catch up with the block production. (Includes download time, gunzipping, restoring, etc.)
Instructions
Update: See the detailed instructions to restore this snapshot.
Limitations (Important)
Dump file is compatible for PostgreSQL 10.
There is a simple Python script creates snapshots, every day at 12:30 CET. It takes around 1.5 hours to complete the backup. Therefore, if you want to download the file, check the state.txt on the server. If it says, 'backup in progress', wait until it's complete. Then proceed with downloading. Otherwise, what you download will be a corrupted file.
The snapshot includes an additional index on
posts_cachetable, onauthorcolumn.
Vote for me as a witness
I do my best to support the blockchain with my skills. If you like what I do, consider casting a vote on via Steemconnect or on steemit.com.
ǝɹǝɥ sɐʍ ɹoʇɐɹnƆ pɐW ǝɥ┴
What kind of resources / setup do you need in order to be able to run a full node?
Regarding ram, 16GB should do the job. I use 32.
Now I have to install postgres on one of my machines to test it!
_
This post has received a 13.11 % upvote from @boomerang.
Thanks for using @edensgarden!
You got a 16.03% upvote from @dailyupvotes courtesy of @steemium!
@dailyupvotes is the only bot with guaranteed ROI of at least 1%
About 38.42$ has been spent to promote this content.
Thanks for your help 👍🏻
Posted using Partiko Android
Not possible atm. My disk is not that big, yet. However decompressing shouldnt take that long. I have synced a fresh hive install in 4 hours including download, decompress, and restore.
I experienced the same as wehmoen, download took 10 minutes and decompress has been running for a good 7 hours now, pv says eta 7 hours. So uncompressing might actually take 14 hours.
I wonder if dumping the logs in the console isn't slowing the whole operation.
Might also be that I'm running on hdd and not ssds
Posted a detailed tutorial:
https://steemit.com/hivemind/@emrebeyler/steps-to-restore-a-hivemind-database-snapshot
Thank you so much :D I was syncing and it was taking forever downloading your dump now