SSD question-- compress drive?
-
@flabdablet said in SSD question-- compress drive?:
@Lorne-Kates If you put a slice of ham into a DVD player, it will show a short film about pigs.
https://www.youtube.com/watch?v=9G-UUhpkMkU
Also, Rifftrax:
-
@flabdablet said in SSD question-- compress drive?:
@blakeyrat said in SSD question-- compress drive?:
I'm sure a lot of shitty open source products claim to support NTFS but fucked it up and choke on compressed files
That's just your prejudice talking. The ntfs-3g suite, which is what every open source project that has anything to do with NTFS almost certainly relies on, has had read-only support for compression for at least ten years, and full read/write/append support (including sparse compressed files) for six.
I had serious performance issues with NTFS on Ubuntu, as recently as the 14.something version.
-
The Austin plant receptionist registers all visitors and makes special arrangements when boys like Brad and Greg write in.
so many upvotes
-
@fbmac said in SSD question-- compress drive?:
serious performance issues with NTFS on Ubuntu
Specifically with compression, or generally?
FUSE filesystems are never going to be speed demons, but I can't recall ever being seriously crimped by ntfs-3g. What was your use case?
-
-
@fbmac said in SSD question-- compress drive?:
something version
The last version of Ubuntu that started with an S is long since EOL'd
-
@ben_lubar Was that Screaming Squirrel or Shifty Shitweasel? I can't keep track of them any more.
-
@flabdablet said in SSD question-- compress drive?:
If you put a slice of ham into a DVD player, it will show a short film about pigs.
If you put a Xbox game DVD in a normal DVD player, it'll play a short video telling you to go out and buy an Xbox.
Trufax.
I haven't tried with 360 disks, that I can remember, and I don't even own any Blu-Ray devices I could try it with a Xbone disk. Other than my Xbone. Which obviously could read it correctly.
-
-
@blakeyrat said in SSD question-- compress drive?:
I don't even own any Blu-Ray devices I could try it with a Xbone disk
I have a PS3. The results could be-- interesting.
-
@ben_lubar Ah, that's right... Scrappy Scribble.
-
@flabdablet Stuffed Spyware?
-
@Onyx Don't be a silly sausage.
-
@flabdablet said in SSD question-- compress drive?:
Specifically with compression, or generally?
FUSE filesystems are never going to be speed demons, but I can't recall ever being seriously crimped by ntfs-3g. What was your use case?copying from one ntfs disk to another. slowed to an unusable speed, like a few kb/s. there is/was some serious issue with threading on this driver.
there was no compression.
-
@fbmac ewwww. I'll keep an eye out for that and see if it affects any of my Debian boxes as well.
-
@fbmac said in SSD question-- compress drive?:
copying from one ntfs disk to another.
Just to double-check, this wasn't between partitions on the same physical disk? That sort of thing is terribly slow because of the war for control over the disk heads…
-
@dkf said in SSD question-- compress drive?:
@fbmac said in SSD question-- compress drive?:
copying from one ntfs disk to another.
Just to double-check, this wasn't between partitions on the same physical disk? That sort of thing is terribly slow because of the war for control over the disk heads…
It still shouldn't be that bad unless it's operating completely un-cached and without any form of interface command queuing. A partition-to-partition file copy isn't going to perform as badly as a 4K random read/write test, and I'd expect the latter to still have about 1MB/s of throughput even on an older spinning metal disk.
-
@BaconBits said in SSD question-- compress drive?:
isn't going to perform as badly as a 4K random read/write test
Pray tell, why not?
-
@dkf It doesn't happen with other file systems or windows.
-
It depends on the controller. Some SSD controllers (particularly older SandForce models) already use compression at the hardware level to help reduce write amplification, so adding compression at the software level will not do anything useful.
-
@dkf said in SSD question-- compress drive?:
@BaconBits said in SSD question-- compress drive?:
isn't going to perform as badly as a 4K random read/write test
Pray tell, why not?
Well, 4K is the normal cluster size in NTFS (see
fsutil fsinfo ntfsinfo C:
for your actual cluster size), so it's the smallest effective file size as far as the file system is concerned. So a random 4K read/write is going to involve the maximum amount of head movement spent for the least amount of data reading and writing. In other words, 4K random read/write is the theoretical worst case scenario that demonstrates how well a disk head moves or how well NAND access data. That's why you see it under disk benchmarks. It maximizes the effects of disk head traversal and rotational speed overhead, or NAND page switching overhead (or whatever it's called... I've forgotten).If you're copying a large amount of data from one partition to another, however, it's unlikely that every file you're copying is 4K in size or less or that every file you're copying is maximally fragmented (i.e., every cluster is not sequentially adjacent to the next cluster location in a file) or that the disk you're writing to is also maximally fragmented (i.e., every odd cluster is occupied). None of that is realistic. So you'd be dealing with a significant amount of sequential read and write, which is much faster.
-
@flabdablet said in SSD question-- compress drive?:
OMG. That's... OMG. OMFG. Holy shit. There are just no words.
Filed under: just wait 'til the birthers get their hands on this info
-
@BaconBits said in SSD question-- compress drive?:
4K is the normal cluster size in NTFS (see fsutil fsinfo ntfsinfo C: for your actual cluster size), so it's the smallest effective file size as far as the file system is concerned. So a random 4K read/write is going to involve the maximum amount of head movement spent for the least amount of data reading and writing.
Never underestimate the power of code. If it isn't opening, seeking, reading, and closing the file each time it needs one line of text, it's not Enterprise™y enough.
-
@anotherusername said in SSD question-- compress drive?:
OMG. OMFG. Holy shit. There are just no words.
Nensense. There ere plenty ef werds. They're just e bit wreng, is ell. Ne bi9 deel.
-
@mott555 said in SSD question-- compress drive?:
It depends on the controller. Some SSD controllers (particularly older SandForce models) already use compression at the hardware level to help reduce write amplification, so adding compression at the software level will not do anything useful.
Worse, compress something already compressed can result in larger "compressed" size. Even if the algorithum is smart to detect such case and use "zero compression" instead, you still loss the space on headers (say, to store the uncompressed size and compression method used).
-
@Lorne-Kates said in SSD question-- compress drive?:
I have a PS3. The results could be-- interesting.
If you were in America, instead of America's hat, you could run down to the nearest Redbox and rent a disc for like $1.60 a night, and try it out.
(Assuming Redbox is in Canada, it's probably, what, Ł4[1]/night?)
[1] Ł, of course, is the symbol for Canadian Loony Funny Money.
-
@FrostCat said in SSD question-- compress drive?:
@Lorne-Kates said in SSD question-- compress drive?:
I have a PS3. The results could be-- interesting.
If you were in America, instead of America's hat, you could run down to the nearest Redbox and rent a disc for like $1.60 a night, and try it out.
(Assuming Redbox is in Canada, it's probably, what, Ł4[1]/night?)
[1] Ł, of course, is the symbol for Canadian Loony Funny Money.
There's RedBox. I haven't used one.
Also, Mr. Complicator, you forgot to scenario where I own a PS3 and an XBox and am too lazy to do this.
-
@Lorne-Kates said in SSD question-- compress drive?:
Also, Mr. Complicator, you forgot to scenario where I own a PS3 and an XBox and am too lazy to do this.
No, I just come up with idea. I said you could do it. Also, you don't actually need an Xbox to rent an Xbox disc, unless you need some kind of special Canadian license.
-
@cheong said in SSD question-- compress drive?:
compress something already compressed can result in larger "compressed" size.
I heard Jon Skeet invented a new compression algorithm that overcomes that limitation, and it works so well that after a few hundred rounds he now has a complete copy of War and Peace on a DIP switch.
-
-
@FrostCat said in SSD question-- compress drive?:
How many poles on that switch?
None. It doesn't need a plumber.