{"id":236,"date":"2011-10-08T11:20:04","date_gmt":"2011-10-07T23:20:04","guid":{"rendered":"http:\/\/mdickinson.dnsalias.org\/php\/wordpress\/?p=236"},"modified":"2011-10-08T11:20:04","modified_gmt":"2011-10-07T23:20:04","slug":"ntfs-disks-under-linux-are-slow","status":"publish","type":"post","link":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/?p=236","title":{"rendered":"ntfs disks under linux are slow"},"content":{"rendered":"

I never really noticed before, but external disks formatted as ntfs are really slow to access under linux.<\/p>\n

I got a new 2TB external disk to use for backups as all my 1TB disks were around 90% full (I was mirroring all my clonezilla backups across three servers as we all do; so they were all full).<\/p>\n

Anyway copying almost 1TB of data from one ntfs disk to another ntfs disk has been going constantly for almost two days now… and is still going. “top” shows two mount.ntfs processes (one per disk I guess) are using all the cpu, nothing else is constraining the data copy. It is so slow.<\/p>\n

I had already decided to reformat the origional 1TB disk as ext4 once I got the data off and dedicate it to bacula backups. I will do a few write tests of a couple of hundred GB to it before I do, then a few after, to see what the difference is.<\/p>\n

Anyway with the new 2TB one I’m thinking I’ll store all my servers clonzilla backups on that only (and buy a seperate one to use for mirror copies); which will free up the 1TB disks on each server just for mirroring the virtual machine Hdisks and major projects I am working on… except one of those I have already earmarked as a dedicated bacula storage drive that will need to be mirrored and I wasn’t planning on backing up VM disks with bacula… sigh, I need more USB hubs\/disks\/power points.<\/p>\n

Or pheraps I need to rethink what I backup… no all backups of everything must be mirrored onto different physical disks, in the many years I have been playing with PC’s 99% of hardware failures are disk drives. And I definately need to keep more that just the ‘latest’ backup set as I know I have a corrupt ‘latest’ set for the server I had the last hard disk failure on and have been testing rebuild from the prior one.<\/p>\n

I just need more disks, which will need more disks to backup, a never ending cycle. It was much easier when PC disk drives were small and there wasn’t much to backup.<\/p>\n","protected":false},"excerpt":{"rendered":"

I never really noticed before, but external disks formatted as ntfs are really slow to access under linux. I got a new 2TB external disk to use for backups as all my 1TB disks were around 90% full (I was … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-236","post","type-post","status-publish","format-standard","hentry","category-my-nux-thoughts-and-notes"],"_links":{"self":[{"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/236","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=236"}],"version-history":[{"count":1,"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/236\/revisions"}],"predecessor-version":[{"id":237,"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/236\/revisions\/237"}],"wp:attachment":[{"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=236"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=236"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mdickinson.dyndns.org\/php\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=236"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}