Home ยป Forum ยป Author Hangout

Forum: Author Hangout

Data Backup

Aiden Clover ๐Ÿšซ

So today I had a major setback. I go into more detail about it here:

https://storiesonline.net/ablog/mark-s-elias

But for those who don't feel like reading the blog, all my stuff has been kept on a USB drive and that USB drive just crashed this morning. It worked fine last night and today it's done for. Took it to several people and tried it on 4 different computers and it did the same thing. Doesn't even register in the computer.

So that got me to wondering, what is YOUR process for data backup and storage? Do you use just ONE computer? Or are you like me and use both a desktop and a laptop depending on where you are? Do you use cloud storage? I've always been hesitant to use cloud storage because I value privacy and I don't trust the cloud companies to keep my privacy, even though the convenience of cloud storage is REALLY overwhelming.

Someone (markva54) mentioned to me about Memeo Backup which I'm going to look into. I'm just curious what you guys use.

Switch Blayde ๐Ÿšซ
Updated:

@Aiden Clover

what is YOUR process for data backup and storage?

Thumb drives aren't that reliable to use for that.

I have one computer, a MacBook Pro laptop. My stuff is on my laptop's hard drive. I also have a thumb drive plugged in all the time and am constantly backing up to it as I make changes. With my spreadsheets, I back up every time I do the update. With my novels/stories, not as frequent (but still frequently).

But I don't trust the thumb drive as a reliable backup so I have an external hard drive also. It's not turned on all the time, but every once in a while I turn it on and copy files to it.

The problem I have is all three drives are on the same desk. If my house burns down, I don't have a backup.

The other problem is, once I copy to the external hard drive, I only have one version. I once deleted a chapter by accident, backed it up to my thumb drive, and then backed it up to my external hard drive. All three were missing the chapter.

My external hard drive is old. It was from my old Del PC. So it's not large enough to use Mac's Time Machine. When the pandemic is over I'm going to buy another external hard drive large enough to run Time Machine. Then I'll have versioning as well as another backup (as I said, my current external hard drive is old).

Replies:   markselias11
markselias11 ๐Ÿšซ

@Switch Blayde

Thumb drives aren't that reliable to use for that.

I have one computer

Part of me knew that they weren't BUT with how my writing style has developed it seemed like the most logical solution at the time. I write at different locations depending on where I am and what I'm doing. Sometimes I'll get my laptop and sit on the couch and write with something playing in the background (damn ADD). Sometimes I'll use the laptop and sit in bed or sit outside if the weather is nice. Then other times I'll get on my desktop. So the thumb drive seemed the best way to be able to do that.

Though I fully admit I should have started backing up everything to my desktop. That was my first mistake.

Mushroom ๐Ÿšซ

@markselias11

Part of me knew that they weren't BUT with how my writing style has developed it seemed like the most logical solution at the time. I write at different locations depending on where I am and what I'm doing. Sometimes I'll get my laptop and sit on the couch and write with something playing in the background (damn ADD). Sometimes I'll use the laptop and sit in bed or sit outside if the weather is nice. Then other times I'll get on my desktop. So the thumb drive seemed the best way to be able to do that.

Reverse that. Save all the data to the hard drive, then use the USB to transfer that to the other system. That way, you have the current and several older versions all saved.

Also, do you work as a single document, or multiple documents? Myself, each chapter is a different document. So at most, I lose only a chapter or two in the event of a crash.

Replies:   markselias11
markselias11 ๐Ÿšซ

@Mushroom

Also, do you work as a single document, or multiple documents? Myself, each chapter is a different document. So at most, I lose only a chapter or two in the event of a crash.

I started off working under multiple documents but switched to single once I started using Scrivener. It was so convenient to be able to navigate through an entire book to reference things I had already written. Scrivener does have the "Export" option as well as the "Compile" option. So for the future what I think I'm going to do is each time I make a change I'm going to export it which will put it all into multiple files. That way I can back up each chapter individually, but still have the convenience of Scrivener.

Switch Blayde ๐Ÿšซ

@markselias11

Sometimes I'll use the laptop โ€ฆ Then other times I'll get on my desktop. So the thumb drive seemed the best way to be able to do that.

I guess the best way to handle that is to have it on both computers' hard drives and after changing it on one, copy it to the thumb drive and copy it to the other computer from the thumb drive. Of course data sharing across devices is what the cloud is about (but I don't trust the cloud).

graysapien ๐Ÿšซ

@markselias11

I've had several external hard drives crash recently.
Part of the problem was that I ran into an issue with my Mac Mini; the computer was on when I used the remote monitor for my heart pacemaker to log in to the company that manufactured the pacemaker to send them the quarterly report of how it was functioning, something I never needed to do before covid.
Anyway, the remote monitor trigged the Mac's bluetooth search function and I couldn't shut that down. The computer wouldn't accept input from the keyboard OR the mouse, meaning that my small bluetooth keyboard's directional arrows didn't work either.
I finally got online and found a work-around, but after that the computer had issues when waking from sleep mode. It also kept dumping the external hard drives, including a three-month-old Western Digital Black unit.
I now have a replacement WD Black drive, but I also have cloud storage. Two accounts, one from Apple that costs a bit over a dollar a month, the other is a freebie that comes with Office 365.
That really helped when I started working on a book I put aside two years ago. Some of the chapters I'd written were on my iPad, others were on the Apple cloud account, so I think I got most of them back. PCBondsman, who edits for me, had some of them too, although he writes that he's had issues too.
Belt AND suspenders, gang; 'privacy' is overrated, not to mention that it no longer exists. Notice the articles about posts that were written, then immediately deleted?
Anything and everything is out there if someone wants to find it.

Replies:   Keet  richardshagrin
Keet ๐Ÿšซ

@graysapien

'privacy' is overrated

Sorry, but that is a plain stupid remark. Privacy is very important for everyone, it's part of who and what you are. That big business crushes it without any regard to who it will damage does not make it 'overrated'. It will still take some time but the likes of facebook et all will pay in time for their criminal behavior.

richardshagrin ๐Ÿšซ

@graysapien

Anything and everything is out there if someone wants to find it.

Except maybe ASSTR.

Ernest Bywater ๐Ÿšซ

@Aiden Clover

I've always had a number of back-up copies on extra drives, but that got screwed up by the Gestapo attack so I added a Cloud copy.

I have my main working copy on my main drive which is an SSD then I have two back-up copies on USB drives (one of which is a M.2 drive in a USB case), and about once a month I copy everything that's changed to my Dropbox account as an off-site back up. One of the USB drives goes in my pocket whenever I leave the house so I have a current copy should it burn down while I'm out.

Dominions Son ๐Ÿšซ

@Aiden Clover

So that got me to wondering, what is YOUR process for data backup and storage?

https://www.carbonite.com/

There are cloud backup services out there. Carbonite is just one of them. They aren't free, but if you have a lot of data, they can be worth it.

Plus I have two hard drives on my current computer. The main drive is an SSD, but I had the old platter drive from my previous computed installed in it rather than paying the shop I got the computer from to do a data transfer.

CB ๐Ÿšซ

@Aiden Clover

I simply mail my day or nights progress to my work email address. It had a 10gb limit and acts like a cloud account.

Replies:   Dominions Son
Dominions Son ๐Ÿšซ

@CB

I simply mail my day or nights progress to my work email address. It had a 10gb limit and acts like a cloud account.

You could get fired for misuse of company systems for that. Especially if you have stories from or for SOL in that.

Replies:   CB
CB ๐Ÿšซ

@Dominions Son

Fire myself? Why? even though I feel like it sometimes.

Quasirandom ๐Ÿšซ
Updated:

@Aiden Clover

I work in Google Docs now. I write on any of four devices, without worry about backups or syncing.

Until a few years ago, I transferred files between personal and work computers with a thumb drive, which acted as my backup, but I was getting really tired of the faffing about.

Replies:   markselias11
markselias11 ๐Ÿšซ

@Quasirandom

I work in Google Docs now. I write on any of four devices, without worry about backups or syncing.

For the time being I'm going to do that since I'm working on 2 short stories that are companion pieces to my main series. Once I start writing the next novel then I'm going to have to find a different route. I write my books in Scrivener. I could also upload the Scrivener file but I don't really want to do that.

Replies:   graysapien
graysapien ๐Ÿšซ

@markselias11

You don't need Scrivener to keep a manuscript file.
I write individual chapters, and after the first edit (I've got three SOL volunteers who help me with that) I post to a manuscript file, all in Word.
When the final chapter's written, I post that then start reading the MS from the beginning. The title page, copyright page, by-the-author page, and the table of contents are already there, making it easy to ensure that all chapters are present. I've got an instant word-count at the bottom of the page and doing a global search-and-replace is simple when I notice that 'Edna' somehow became 'Emma' later in the book.
Finish that final edit, still in word, and upload it to Amazon. By then, I'll have found a photo to use for the cover (most of them free, and the cover photo for one I took myself!) and creating a cover takes half an hour at most. Upload, write the blurb, finish Amazon's three pages or so of price information and such, hit send, and it's done.
The next day I'll reformat the manuscript. I will already have the print cover ready and uploaded, so uploading the print version of the MS is easy too. Hit send, and it's done too. One more thing to do, jump through ACX's hoops and send the MS to one of my Audiobook narrators. I'll need a different cover for that, but half an hour or so will see it finished.
Lazeez did me a huge favor when he kicked me out of the nest. Last year, that favor grossed $44,000 for me.
The new Mac Mini, ~$1500, to replace the one that was giving me fits? It's a business expense...

Mushroom ๐Ÿšซ

@Aiden Clover

So that got me to wondering, what is YOUR process for data backup and storage?

For my writing, they remain on my hard drive. But once a week or so I back those up to a USB drive (disk based not RAM). That way, I lose at most a week or so.

Grey Wolf ๐Ÿšซ

@Aiden Clover

Cloud for me. I agree with privacy concerns, but I'm a very, very small fish, and if they're frying me, they're frying a whole lot of people. Also, there are just too many vectors to get paranoid about privacy over. I'm fairly certain my passwords are sufficient that the loss of privacy will be from my cloud provider screwing me, not from my password being compromised.

While it can be a PITA to set up, for full backups I'm happy with Duplicacy. The GUI version isn't bad; the command line version is free and open source and will write encrypted backups to your cloud provider of choice, with your password/encryption key never in the hands of said cloud provider. I'm not using that for writing, I'm using straightforward cloud-provider folders, but I am using that for my system as a whole.

Duplicacy is somewhat geeky, though, and I don't use its biggest feature (deduplication). I used to love CrashPlan, but then they left the home market. Sigh.

Replies:   Ernest Bywater
Ernest Bywater ๐Ÿšซ

@Grey Wolf

Cloud for me. I agree with privacy concerns,

I hope you use more than just Cloud Service back-up as my concerns with Cloud Service back-up isn't privacy, per se, bu the fact that in the past several have gone belly up and taken all of their clients' data with them when they shut down at short notice so the clients could recover all of their data from the Cloud Service servers. Then you have the example of the millions of people who lost years of data when the US Media Mafia got the US DoJ to shut down Megaupload and their servers got wiped. Less than one hundredth of one percent of their clients were involved in copyright infractions yet millions of clients paid for the heavy-handed actions of the US Media Mafia and the US DoJ.

Replies:   Dominions Son  Grey Wolf
Dominions Son ๐Ÿšซ

@Ernest Bywater

I hope you use more than just Cloud Service back-up as my concerns with Cloud Service back-up isn't privacy, per se, bu the fact that in the past several have gone belly up and taken all of their clients' data with them when they shut down at short notice so the clients could recover all of their data from the Cloud Service servers.

You are misunderstanding cloud service backup. For the cloud back up services, backup is all they provide, they aren't like google docs or Microsoft one-drive. Your primary data is still local. Even if they do go under, you don't lose your primary data, just the backups.

The only lose everything scenario with cloud backup is you have a system crash at the same time your backup provider goes under.

Replies:   Ernest Bywater
Ernest Bywater ๐Ÿšซ

@Dominions Son

Even if they do go under, you don't lose your primary data, just the backups.

That's how they should be used and how I use them. However, the reality is the cloud services promote themselves as being the best main data storage to allow people to access from any location, and thus people regard them as the only storage they need due to the people not understanding the true level of risks involved and being mislead by the promotional material put out by the cloud services.

Replies:   Dominions Son
Dominions Son ๐Ÿšซ
Updated:

@Ernest Bywater

However, the reality is the cloud services promote themselves as being the best main data storage to allow people to access from any location

Those are separate companies from the backup services I am referring to.

There are services that offer cloud backup and cloud backup only. You get an app that backs up your files as a background process to their cloud servers and can be used to do a restore, but the cloud storage in question can't be accessed as live storage even if you wanted to.

Replies:   Ernest Bywater
Ernest Bywater ๐Ÿšซ

@Dominions Son

You get an app that backs up your files as a background process to their cloud servers and can be used to do a restore, but the cloud storage in question can't be accessed as live storage even if you wanted to.

Well, I've not yet seen any advertising for such limited services, but seen tons for the types that promote themselves as primary data storage in the cloud. I try to avoid ads now, so I do miss some that aren't heavilt promoted.

Replies:   Dominions Son
Dominions Son ๐Ÿšซ
Updated:

@Ernest Bywater

Well, I've not yet seen any advertising for such limited services, but seen tons for the types that promote themselves as primary data storage in the cloud.

I posted a link to the website for one of the bigger ones up thread.

ETA: I wouldn't call them limited. They are an entirely different thing from cloud storage services.

Replies:   Keet
Keet ๐Ÿšซ

@Dominions Son

I posted a link to the website for one of the bigger ones up thread.

ETA: I wouldn't call them limited. They are an entirely different thing from cloud storage services.

Real cloud backup is indeed something else. Another very good one is https://www.backblaze.com. Not free ($60/year), but very reliable. They are well known for their yearly report of HDD/SSD failure rates.

Grey Wolf ๐Ÿšซ

@Ernest Bywater

Two synced local copies (on two computers I write from), one local backup, one cloud backup.

The local backup is RAID6 (repeat after me: "RAID is not a backup" - but you can put backups on RAID :)).

No single point of failure. I've actually had the SSD in my laptop (my primary system) die in the past year and didn't lose anything (except a bunch of time restoring and reinstalling).

mimauk ๐Ÿšซ

@Aiden Clover

I have a 500GB SSD split into 2 drives - 100GB for OS and 400GB for data plus a 2TB HDD in my desktop. I use DriveImageXML - it's free for personal use - to back up the OS drive to the HDD every day at 4.30pm which takes about 10 minutes. You can still use the PC whilst the backup takes place. The drives - mainly storage - get backed up to external HDDs every week. All the daily files get copied to the other drives using copy and paste. All can be done whilst having a cup of tea ;-))

markselias11 ๐Ÿšซ

@Aiden Clover

After doing some research what I've ended up going with is Memeo Backup Premium. I have it installed on my desktop (which is where I do most of my work anyway). It will automatically backup to a cloud storage, an external SSD and a USB as well. The cloud storage came with 1gb free from Memeo, and at the moment that's really all I need for my writing. That should keep me from being in this position ever again. This way even if I lose something it's not like I've lost everything.

Emmeran ๐Ÿšซ
Updated:

@Aiden Clover

Well I'm pretty simple. I pay for full Microsoft service because as an IT dude I know a lot about it.

Actually I originally signed up because my middle school children changed email addresses pretty much weekly and I got sick of it. So I just paid for it.

I avoid Google and Apple because they admittedly suck your data. Microsoft wants the government contracts so they leave my shit alone. No ads, no suggestions, just my data sitting there.

Google will changes soon, they are about to experience the pain that Microsoft felt when the US & EU cracked down on them in the late 90's and 00's. The fines were deep into the billions and MS has walked carefully since. Google will be doing that in three years time at the most.

Replies:   Dominions Son
Dominions Son ๐Ÿšซ

@Emmeran

Microsoft wants the government contracts so they leave my shit alone.

Don't bet they aren't feeding your shit to the government.

Replies:   Emmeran
Emmeran ๐Ÿšซ

@Dominions Son

Don't bet they aren't feeding your shit to the government.

Well yeah but I was a career Jarhead with a high level security clearance there's not much chance I have any secrets from that bumbling mess we call a government.

Goldfisherman ๐Ÿšซ

@Aiden Clover

I completely left Microsoft in 2015 when I had 4 different security agents beside microsoft allegedly providing security. I bailed when one of my customers sent me copies of schematics and mechanical drawings as well as manuals that I had not even sent to the company proofreaders yet. these documents ETC... were released by 5 different competitors in the Phillippines, china, Korea, and USSR. I immediatly switched to Linux mint and have not had any further leaks with no other security.
On backups, O currently have 4 laptops and 2 desktops, all with SSD of minimal size in the 200 GB range, I have had no failures. Backups are ondecent flashdrives where I keep 90% of my moveable files, I thought I had a failure on one 6 months ago but I recovered it completely copied it into one of my laptops and reformatted into the Linux format from the 32 bit windows format. no further problems. I made sure all of my flash drives were in the Linux format. I had 4 crashes with my TB and 3 TB HDD mechanical backups. No more mechanicals.

Replies:   bk69
bk69 ๐Ÿšซ

@Goldfisherman

So you're running Linux on laptops? Is that simpler now? I remember trying to get laptops running most distros to be a total PITA back in the day.

Replies:   Keet
Keet ๐Ÿšซ

@bk69

So you're running Linux on laptops? Is that simpler now? I remember trying to get laptops running most distros to be a total PITA back in the day.

I've used Linux on laptops for many years now, even once threw an Ubuntu on and EEEPC, worked perfectly out of the box. It's only in rare cases that you have troubles finding the right driver for the touch pad or something. Once I had problems with recovering from sleep mode when opening the laptop but that too was solved pretty fast.
Nowadays it should run without any troubles, maybe if the laptop is really latest of the latest and specifically build for Windows (i.e. surface) you could have some problems but not likely. If there are problems it's mostly with NVidia graphics. Just use the official NVidia Linux drivers and never Nouveau.

Replies:   Tw0Cr0ws
Tw0Cr0ws ๐Ÿšซ

@Keet

maybe if the laptop is really latest of the latest

Then use something like MX Linux AHS ((Advanced Hardware Support). Made with newer kernel, newer firmware, newer drivers... Still based on Debian Stable.

Replies:   Keet
Keet ๐Ÿšซ

@Tw0Cr0ws

Still based on Debian Stable.

Good option, yes. I mostly use Debian Stable, very reliable.

mimauk ๐Ÿšซ
Updated:

@Aiden Clover

Download a Linux distro onto a thumb drive and boot up the laptop - you don't have to install it, it will run from the thumb drive. That will soon tell you if there will be any problems with that particular laptop.

graybyrd ๐Ÿšซ

@Aiden Clover

FWIW: For a couple of years I've been using a French cloud account. It's been rock solid. Being offshore and encrypted, it satisfies the lizard brain concern about domestic issues. The nice part is, they offer a free 25gb account; and a great many features.

https://hubic.com/en/offers/

Gray

Goldfisherman ๐Ÿšซ

@Aiden Clover

I switched to Linux Mint Cinnamon 64 in all my laptops with never a problem. As long as I had a minimum of a dual core 64 bit processor, 2+GB of RAM and at least a 30 GB HDD/SSD. I installed them from either a DVD I burned or from a Flash drive of at least 2GB. The laptops were built after 2006, and for the newest in 2020. I have installed LMDE4 but was not really happy with the utilities.
On single core ATOM 64 Processors, I use LMCE 64 and on single core atom 32 bit processors I use LMCE 32 up to version 19.3 or LMDE4 32 bit.
Of course for really old 32 bit processors with very small HDD or SSD less than 18 GB I use Puppy Linux or spearmint on a flashdrive of 64 GB or greater.
I even use Linux Mint 64 Cinnamon up to version 20.1on Apple MacBooks 1.0 with 4 GB Ram and SSD's. Of course there are only about 40,000 free Linux APPS. A full office suite is included in the basic install.

Replies:   Keet
Keet ๐Ÿšซ

@Goldfisherman

Of course there are only about 40,000 free Linux APPS. A full office suite is included in the basic install.

Great use of the different Linux distributions/desktops. Your minimum system requirements are a bit high, Linux can run very smoothly with a lot less depending on the desktop you choose.
You're also a bit low with the available programs (I hate the buzz word 'app'). The current repository for stable runs up to almost 55000 and for sid the number is over 60000 at the moment. And indeed, all free.

Back to Top

 

WARNING! ADULT CONTENT...

Storiesonline is for adult entertainment only. By accessing this site you declare that you are of legal age and that you agree with our Terms of Service and Privacy Policy.


Log In