The original post: /r/datahoarder by /u/Haunting_Group_5483 on 2024-12-04 22:46:10.

Hello everyone,

First of all, thank you for reading my post and perhaps guiding me to the proper way of solving my first personal data hoarding attempt.

After using Google Drive and some other cloud providers, I have decided to go a different route. Most cloud providers are limiting in bandwidth speed, total data transfer limiting or hard to ‘mirror’ and ‘sync’ properly for my use case.

Here’s my idea:

Setup a 24/7 personal mini-server using my pc hardware to constantly look for changes and sync bidirectional to a single SSD as a mirror backup.

Be able to access the filesystem and the backup ssd (2 Nvme drives) remotely via SSH or equivelant, so I can access my files and download them or upload to the ssd’s remotely using a laptop or another device.

Utilize the machine as a personal data storage for things like archived mail, attachements and pictures/media.

I am willing to start out slow and simple, using these specs and capacity. Note: I don’t have a lot of big files, just a lot of small files.

Please let me know if I’m doing something stupid or if I am overcomplicating stuff.

Disk 1 - C:/ is an nvme. 990 samsung pro ssd that has 2TB of storage and is using a windows 11 os with ± 1.8TB of space. This will be the main SSD and the active operating system.

Disk 2 - is the backup SSD using a 980 samsung 1TB ssd that currently mirrors a google drive filesystem, but will shortly be formated and empty to be used as the potential mirror drive. This will mirror the filesystem of Disk 1 excluding the system files. I don’t mind losing or corrupting the OS. I just want to have my data hoarding documents, media and mail etc. synced and backed up.

Disk 3 and 4 are 1TB Samsung SATA SSD’s. Potentially for expansion and/or extra storage/extra backup for most important files. To be sure if both nvme drives somehow die, we still have these for emergency recovery and backup.

I am considering using either Linux or Windows to setup the mirroring daemon or equivelant.

  1. What is the best software or method to do this? I am reading into rClone, rSync and some other software. I am willing to put in the effort to aquire the knowledge needed to set it up properly.
  2. Is this practical and/or often utilized or am I doing something stupid/unneccesary?
  3. What cloud storage as alternative to my mini-server is ‘worth’ it if we are talking about 5-10TB of data storage with frequenct small changes in files? Google Drive seems okayish but I still had some issues using ‘mirroring’.

Thanks in advance,

Eduard