2013-02-14, 11:40 PM
Does anyone have any experience with storing a large amount of tiny files? I'm talking about 10-20 million files of 50KB or less. Right now I am taking the md5 hash, and sorting them into directories based on the first 3 charaters, so L:\a\e\5\ae565464984981681684984.jpg. This works perfectly and gives a nice balanced structure.
I guess I'm primarily looking at access speed and slack space. Since there are millions of files, I'm thinking NTFS formatted with an allocation size of 512B. Would ext4 handle this kind of thing in any better?
I guess I'm primarily looking at access speed and slack space. Since there are millions of files, I'm thinking NTFS formatted with an allocation size of 512B. Would ext4 handle this kind of thing in any better?