After taking a break and stepping away for a bit, I realized that I was recreating an archiving system for websites and that there are existing solutions that do the same thing.
I found https://github.com/ArchiveBox/ArchiveBox/ which is a self hosted web archiving system. It covers most of my usecases (and I can extend it for additional functionality) so I am going to set this up and try it out.
I don't have to use curl, but in the past when I have setup something that opens browser instances it has usually been a bit unstable in the sense that it would crash intermittently.
I wanted something that I could kick-off as a daily cron job.
That's a good point. I use Linux where file names are Case Sensitive and the sync to Windows has problems when the files are copied over to an NTFS partition or to my Android phone. However, the rest of the files are updated even though some files have issues syncing.
There is no alert etc generated just a message in the interface that sync is not complete.
yeah, it really sucks that we improved security, reduced the risk of Man in the Middle Attacks, reduced impersonation risks by moving to a more secure protocol.
Actually, you don't need to manage certificates when we access sites over https as that is done on the server side. You just need to ensure that you are using the latest version of the SSL libraries when compiling systems.
Even then, most certificate providers give you ways to update certificates quickly and easily. If you do it correctly then you would only need to update them once a year. (you can set this to a longer duration)
Thanks for the hint. I just tried again after reading your comment. And it turns out it is due to high traffic. I totally missed the warning message at the bottom. It says:
"Currently at peak capacity. Sign in for priority."
The article specifically says that they "drilled down into the hill and collected core samples that allowed them to use radiocarbon dating techniques to learn the ages of the layers that make up the hill."
They didn't randomly pickup dirt from the base of the pyramid and date it as you seem to be implying, they used the standard method of taking core samples at various depths to find the dates of the various layers of the pyramid. Based on that they made the claim.
The radiocarbon date of the material used in the construction of the hill doesn’t change when it is pushed around to make a hill. That dirt was already old.
Syncthing works over mobile data as well. You need to enable the option to Run on mobile data in settings. In addition you will need to Enable Relaying and Global discovery on both ends (phone and server)
I have been using it to sync photos and other data from Phone -> Desktop for a few years now and it works fantastically.
The issue with CD/DVDs is that they degrade quickly over time. The CDs I burnt in early 2000s had tons of read errors when I tried restoring in 2022.
Personally, I think storing data on an external Harddrive is the most stable option. You can keep upgrading the setup as required and the bit rot is minimal.
I backup my data on multiple drives, along with redundant copies stored in multiple locations.
I have heard good things about Tapes as well but have no personal experience with them.
Like you I also dislike the Blocks editor, however the fix is easy. You can install the Classic Editor (https://wordpress.org/plugins/classic-editor/) plugin and get the old interface back.
You can switch between the two if you want, and can configure it to be the default.
I found https://github.com/ArchiveBox/ArchiveBox/ which is a self hosted web archiving system. It covers most of my usecases (and I can extend it for additional functionality) so I am going to set this up and try it out.
Thanks all for the help.