Divert disk device access based upon size etc...

Hi, I have two storage devices (say flash & disk) in my system. I want to divert the traffic to one of them based upon the file sizes. Say all files smaller than 4KB goes to device A while all other goes to device B. How can I achieve that? To be more specific the flash is in general good for small random transfers while the disk is good for large sequential transfers. Now if I want to put all the small files in the flash and all the large files in the disk. How can I do that? Also say a file was initially small when the user wrote it for the first time and i saved it to the flash. Now sometime later the size increased to several hundred MBs. Now I think this file needs to be saved to the disk. How can I do that? And also the reverse case where the file was huge initially but shrinked to a very small size later on.

Also is there a way to identify OS files Vs application files Vs user data?

Thank you.

If I understand you correctly, at the risk of stating the obvious, have
you considered how incredibly confusing and most assuredly dangerous (as
in lost data) this will be? I don’t mean to be critical, as it sounds
like this is personal project so whatever, but as I see it, minimally,
in order to find a file, you will have to know it’s (ballpark) current
size, which based on your scenarios sounds like they are going to vary.
For example, let’s say you edit a document on the removable, save it,
grab the flash disk and go to work, where you find that because it is
five bytes larger than yesterday, it is now sitting at home on the hard
drive. More problematic, let’s say you edit boot.ini, save it, and it
gets redirected to the flash drive, and you can no longer boot. This
shuffling will also possibly break shortcuts and definitely links, if
any. If nothing else, the error messages you will get in some
situations will just be incomprehensible, because Word, et. c. is still
going to make you specify a path to save a the file to, you redirect it,
there’s a problem on the other drive, and Word or whatever will
understandably assume that the string containing the file name it has in
memory is accurate.

I would advise you not to do this, but if you wish to, I would write an
application that did this rearrangement explicitly, so you would at
least know when it is happening.

Good luck,

mm

xxxxx@yahoo.com wrote:

Hi, I have two storage devices (say flash & disk) in my system. I want to divert the traffic to one of them based upon the file sizes. Say all files smaller than 4KB goes to device A while all other goes to device B. How can I achieve that? To be more specific the flash is in general good for small random transfers while the disk is good for large sequential transfers. Now if I want to put all the small files in the flash and all the large files in the disk. How can I do that? Also say a file was initially small when the user wrote it for the first time and i saved it to the flash. Now sometime later the size increased to several hundred MBs. Now I think this file needs to be saved to the disk. How can I do that? And also the reverse case where the file was huge initially but shrinked to a very small size later on.

Also is there a way to identify OS files Vs application files Vs user data?

Thank you.

thanks for the prompt response. Some more details which I missed: flash is the boot drive, and disk is the secondary drive. And both of them are not removable from the system.

Have you looked into hybrid drive technology? They seem to be going at this
problem from a more integrated and lower level approach that probably makes
what you are doing at best marginally better performing in some situations
while in general so vastly more complicated that it will be in most respects
inferior.

On Jan 24, 2008 8:27 PM, wrote:

> thanks for the prompt response. Some more details which I missed: flash is
> the boot drive, and disk is the secondary drive. And both of them are not
> removable from the system.
>
> —
> NTFSD is sponsored by OSR
>
> For our schedule debugging and file system seminars
> (including our new fs mini-filter seminar) visit:
> http://www.osr.com/seminars
>
> You are currently subscribed to ntfsd as: xxxxx@hollistech.com
> To unsubscribe send a blank email to xxxxx@lists.osr.com
>


Mark Roddy

Current Hybrid drives have very limited flash may be around 1GB, I think. But with this approach you can have a flash bigger than hybrid drive and smaller than the actual SSDs thus optimizing on both cost and performance. Also hybrid drives are currently supported only by Vista (using the Readydrive feature). With this approach you can improve the performance of other OS like XP too. Hybrid drive as we all know have been disappointing even the hybrid vendors ( I think Toshiba) publicly acknowledges this.

Does anyone has any more suggestions? I would really appreciate if anyone can provide some guidance here. Thanks.