transfert data directly to SCSI

Hello Everyone,

I am starting designing video acquisition board and the corresponding
device driver for Win2000. I would like to transfert the raw data directly
into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
sustained speed of 200MB/s. The PCI board and the raid are plugged on a
separete PCI bus (PCI 64/66). The système should work continously until
the disks are full.

I think using the DMA of the Raid controlleur to transfert the data from
the PCI BAR memory (window of about 1 MB).

Coul anyone tell me if it is possible in my device driver and how I can do
this.

Best regards,

Marc Roche

Use the user app, the usual SCSI miniport driver and the
DO_DIRECT_IO style of the video board driver.
The app must allocate a chunk of memory, then send the noncached
ReadFile to a video using this memory, then send WriteFile to the
on-disk file opened in noncached mode. This will give you the
zero-copy path from the video DMA to the SCSI HBA’s DMA.

Max

----- Original Message -----
From: “Marc ROCHE”
To: “NT Developers Interest List”
Sent: Tuesday, May 13, 2003 9:33 PM
Subject: [ntdev] transfert data directly to SCSI

> Hello Everyone,
>
> I am starting designing video acquisition board and the
corresponding
> device driver for Win2000. I would like to transfert the raw data
directly
> into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
> sustained speed of 200MB/s. The PCI board and the raid are plugged
on a
> separete PCI bus (PCI 64/66). The système should work continously
until
> the disks are full.
>
> I think using the DMA of the Raid controlleur to transfert the data
from
> the PCI BAR memory (window of about 1 MB).
>
> Coul anyone tell me if it is possible in my device driver and how I
can do
> this.
>
> Best regards,
>
> Marc Roche
>
> —
> You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com

Well it is still copy to host memory from video, copy from host memory to
scsi. I think the original poster wants to go directly from PCI VIDEO memory
to PCI SCSI adapter device memory using the SCSI adapter device DMA to
effect the transfer (PCI<->PCI.) I like your idea better, but I think he is
unlikely to get 200MBs xfer rates in either case.

-----Original Message-----
From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
Sent: Tuesday, May 13, 2003 2:26 PM
To: NT Developers Interest List
Subject: [ntdev] Re: transfert data directly to SCSI

Use the user app, the usual SCSI miniport driver and the
DO_DIRECT_IO style of the video board driver.
The app must allocate a chunk of memory, then send the
noncached ReadFile to a video using this memory, then send
WriteFile to the on-disk file opened in noncached mode. This
will give you the zero-copy path from the video DMA to the
SCSI HBA’s DMA.

Max

----- Original Message -----
From: “Marc ROCHE”
> To: “NT Developers Interest List”
> Sent: Tuesday, May 13, 2003 9:33 PM
> Subject: [ntdev] transfert data directly to SCSI
>
>
> > Hello Everyone,
> >
> > I am starting designing video acquisition board and the
> corresponding
> > device driver for Win2000. I would like to transfert the raw data
> directly
> > into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
> > sustained speed of 200MB/s. The PCI board and the raid are plugged
> on a
> > separete PCI bus (PCI 64/66). The syst?me should work continously
> until
> > the disks are full.
> >
> > I think using the DMA of the Raid controlleur to transfert the data
> from
> > the PCI BAR memory (window of about 1 MB).
> >
> > Coul anyone tell me if it is possible in my device driver and how I
> can do
> > this.
> >
> > Best regards,
> >
> > Marc Roche
> >
> > —
> > You are currently subscribed to ntdev as: xxxxx@storagecraft.com To
> > unsubscribe send a blank email to
> xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as:
> xxxxx@stratus.com To unsubscribe send a blank email to
> xxxxx@lists.osr.com
>

In X86 architecture, is it possible that bus master transfer between device
to device?

Regards,
Nike

----- Original Message -----
From: “Roddy, Mark”
To: “NT Developers Interest List”
Sent: Wednesday, May 14, 2003 4:35 AM
Subject: [ntdev] Re: transfert data directly to SCSI

Well it is still copy to host memory from video, copy from host memory to
scsi. I think the original poster wants to go directly from PCI VIDEO memory
to PCI SCSI adapter device memory using the SCSI adapter device DMA to
effect the transfer (PCI<->PCI.) I like your idea better, but I think he is
unlikely to get 200MBs xfer rates in either case.

> -----Original Message-----
> From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> Sent: Tuesday, May 13, 2003 2:26 PM
> To: NT Developers Interest List
> Subject: [ntdev] Re: transfert data directly to SCSI
>
>
> Use the user app, the usual SCSI miniport driver and the
> DO_DIRECT_IO style of the video board driver.
> The app must allocate a chunk of memory, then send the
> noncached ReadFile to a video using this memory, then send
> WriteFile to the on-disk file opened in noncached mode. This
> will give you the zero-copy path from the video DMA to the
> SCSI HBA’s DMA.
>
> Max
>
> ----- Original Message -----
> From: “Marc ROCHE”
> To: “NT Developers Interest List”
> Sent: Tuesday, May 13, 2003 9:33 PM
> Subject: [ntdev] transfert data directly to SCSI
>
>
> > Hello Everyone,
> >
> > I am starting designing video acquisition board and the
> corresponding
> > device driver for Win2000. I would like to transfert the raw data
> directly
> > into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
> > sustained speed of 200MB/s. The PCI board and the raid are plugged
> on a
> > separete PCI bus (PCI 64/66). The syst?me should work continously
> until
> > the disks are full.
> >
> > I think using the DMA of the Raid controlleur to transfert the data
> from
> > the PCI BAR memory (window of about 1 MB).
> >
> > Coul anyone tell me if it is possible in my device driver and how I
> can do
> > this.
> >
> > Best regards,
> >
> > Marc Roche
> >
> > —
> > You are currently subscribed to ntdev as: xxxxx@storagecraft.com To
> > unsubscribe send a blank email to
> xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as:
> xxxxx@stratus.com To unsubscribe send a blank email to
> xxxxx@lists.osr.com
>


You are currently subscribed to ntdev as: xxxxx@iei.com.tw
To unsubscribe send a blank email to xxxxx@lists.osr.com

Yes I want to transfert directly from the “PCI video” to “PCI raid 0” on the
PCI 64 bits/66MHz. If I use a buffer memory, I am not should to keep the
sustained data rate of 200MB/s because i will have 200MB/s to transfert PCI
video to memory and 200MB/s to transfert memory to PCI raid. So the total
sustained rate will be 400MB/s.

Do you think the raid is seen as a SCSI adapter DMA?

Do I use the SCSI adapter DMA in my device driver of the PCI video board?

Thanks in advance,

Marc Roche

-----Message d’origine-----
De : xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com]De la part de Roddy, Mark
Envoye : mardi 13 mai 2003 22:36
A : NT Developers Interest List
Objet : [ntdev] Re: transfert data directly to SCSI

Well it is still copy to host memory from video, copy from host memory to
scsi. I think the original poster wants to go directly from PCI VIDEO memory
to PCI SCSI adapter device memory using the SCSI adapter device DMA to
effect the transfer (PCI<->PCI.) I like your idea better, but I think he is
unlikely to get 200MBs xfer rates in either case.

-----Original Message-----
From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
Sent: Tuesday, May 13, 2003 2:26 PM
To: NT Developers Interest List
Subject: [ntdev] Re: transfert data directly to SCSI

Use the user app, the usual SCSI miniport driver and the
DO_DIRECT_IO style of the video board driver.
The app must allocate a chunk of memory, then send the
noncached ReadFile to a video using this memory, then send
WriteFile to the on-disk file opened in noncached mode. This
will give you the zero-copy path from the video DMA to the
SCSI HBA’s DMA.

Max

----- Original Message -----
From: “Marc ROCHE”
> To: “NT Developers Interest List”
> Sent: Tuesday, May 13, 2003 9:33 PM
> Subject: [ntdev] transfert data directly to SCSI
>
>
> > Hello Everyone,
> >
> > I am starting designing video acquisition board and the
> corresponding
> > device driver for Win2000. I would like to transfert the raw data
> directly
> > into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
> > sustained speed of 200MB/s. The PCI board and the raid are plugged
> on a
> > separete PCI bus (PCI 64/66). The système should work continously
> until
> > the disks are full.
> >
> > I think using the DMA of the Raid controlleur to transfert the data
> from
> > the PCI BAR memory (window of about 1 MB).
> >
> > Coul anyone tell me if it is possible in my device driver and how I
> can do
> > this.
> >
> > Best regards,
> >
> > Marc Roche
> >
> > —
> > You are currently subscribed to ntdev as: xxxxx@storagecraft.com To
> > unsubscribe send a blank email to
> xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as:
> xxxxx@stratus.com To unsubscribe send a blank email to
> xxxxx@lists.osr.com
>


You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
To unsubscribe send a blank email to xxxxx@lists.osr.com

Marc,

is this a very big problem to transfer the data from the PCI video to
memory (current frame) and to transfer from memory to PCI raid 0
(current-1 aka previous frame)? If I understand you have an concurrent PCI
buses and if the memory bandwidth will allow (400MB/sec is not a problem
for most machines equipped with PCI64 etc) you can build a pipeline and
you’ll still get 200MB/sec with the single copy mode.

Anton Kolomyeytsev

Yes I want to transfert directly from the “PCI video” to “PCI raid 0” on the
PCI 64 bits/66MHz. If I use a buffer memory, I am not should to keep the
sustained data rate of 200MB/s because i will have 200MB/s to transfert PCI
video to memory and 200MB/s to transfert memory to PCI raid. So the total
sustained rate will be 400MB/s.

Do you think the raid is seen as a SCSI adapter DMA?

Do I use the SCSI adapter DMA in my device driver of the PCI video board?

Thanks in advance,

Marc Roche

-----Message d’origine-----
De : xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com]De la part de Roddy, Mark
Envoye : mardi 13 mai 2003 22:36
A : NT Developers Interest List
Objet : [ntdev] Re: transfert data directly to SCSI

Well it is still copy to host memory from video, copy from host memory to
scsi. I think the original poster wants to go directly from PCI VIDEO memory
to PCI SCSI adapter device memory using the SCSI adapter device DMA to
effect the transfer (PCI<->PCI.) I like your idea better, but I think he is
unlikely to get 200MBs xfer rates in either case.

> -----Original Message-----
> From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> Sent: Tuesday, May 13, 2003 2:26 PM
> To: NT Developers Interest List
> Subject: [ntdev] Re: transfert data directly to SCSI
>
>
> Use the user app, the usual SCSI miniport driver and the
> DO_DIRECT_IO style of the video board driver.
> The app must allocate a chunk of memory, then send the
> noncached ReadFile to a video using this memory, then send
> WriteFile to the on-disk file opened in noncached mode. This
> will give you the zero-copy path from the video DMA to the
> SCSI HBA’s DMA.
>
> Max
>
> ----- Original Message -----
> From: “Marc ROCHE”
> > To: “NT Developers Interest List”
> > Sent: Tuesday, May 13, 2003 9:33 PM
> > Subject: [ntdev] transfert data directly to SCSI
> >
> >
> > > Hello Everyone,
> > >
> > > I am starting designing video acquisition board and the
> > corresponding
> > > device driver for Win2000. I would like to transfert the raw data
> > directly
> > > into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
> > > sustained speed of 200MB/s. The PCI board and the raid are plugged
> > on a
> > > separete PCI bus (PCI 64/66). The système should work continously
> > until
> > > the disks are full.
> > >
> > > I think using the DMA of the Raid controlleur to transfert the data
> > from
> > > the PCI BAR memory (window of about 1 MB).
> > >
> > > Coul anyone tell me if it is possible in my device driver and how I
> > can do
> > > this.
> > >
> > > Best regards,
> > >
> > > Marc Roche
> > >
> > > —
> > > You are currently subscribed to ntdev as: xxxxx@storagecraft.com To
> > > unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as:
> > xxxxx@stratus.com To unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
> To unsubscribe send a blank email to xxxxx@lists.osr.com

Anton,

I am sorry I have not understood what is the “pipeline solution”.

I know that during transfert 400MB/s will be easy to transfert but I should
consider that the tranfert will be made by page 1MB (or perhaps a little
more) so there will be latency between transfers to get the interrupt set
the event for the application and ask for a new transfer (read then write).

Marc Roche

-----Message d’origine-----
De : xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com]De la part de Anton
Kolomyeytsev
Envoyé : mercredi 14 mai 2003 14:34
À : NT Developers Interest List
Objet : [ntdev] Re: transfert data directly to SCSI

Marc,

is this a very big problem to transfer the data from the PCI video to
memory (current frame) and to transfer from memory to PCI raid 0
(current-1 aka previous frame)? If I understand you have an concurrent PCI
buses and if the memory bandwidth will allow (400MB/sec is not a problem
for most machines equipped with PCI64 etc) you can build a pipeline and
you’ll still get 200MB/sec with the single copy mode.

Anton Kolomyeytsev

Yes I want to transfert directly from the “PCI video” to “PCI raid 0” on
the
PCI 64 bits/66MHz. If I use a buffer memory, I am not should to keep the
sustained data rate of 200MB/s because i will have 200MB/s to transfert
PCI
video to memory and 200MB/s to transfert memory to PCI raid. So the total
sustained rate will be 400MB/s.

Do you think the raid is seen as a SCSI adapter DMA?

Do I use the SCSI adapter DMA in my device driver of the PCI video board?

Thanks in advance,

Marc Roche

-----Message d’origine-----
De : xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com]De la part de Roddy, Mark
Envoye : mardi 13 mai 2003 22:36
A : NT Developers Interest List
Objet : [ntdev] Re: transfert data directly to SCSI

Well it is still copy to host memory from video, copy from host memory to
scsi. I think the original poster wants to go directly from PCI VIDEO
memory
to PCI SCSI adapter device memory using the SCSI adapter device DMA to
effect the transfer (PCI<->PCI.) I like your idea better, but I think he
is
unlikely to get 200MBs xfer rates in either case.

> -----Original Message-----
> From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> Sent: Tuesday, May 13, 2003 2:26 PM
> To: NT Developers Interest List
> Subject: [ntdev] Re: transfert data directly to SCSI
>
>
> Use the user app, the usual SCSI miniport driver and the
> DO_DIRECT_IO style of the video board driver.
> The app must allocate a chunk of memory, then send the
> noncached ReadFile to a video using this memory, then send
> WriteFile to the on-disk file opened in noncached mode. This
> will give you the zero-copy path from the video DMA to the
> SCSI HBA’s DMA.
>
> Max
>
> ----- Original Message -----
> From: “Marc ROCHE”
> > To: “NT Developers Interest List”
> > Sent: Tuesday, May 13, 2003 9:33 PM
> > Subject: [ntdev] transfert data directly to SCSI
> >
> >
> > > Hello Everyone,
> > >
> > > I am starting designing video acquisition board and the
> > corresponding
> > > device driver for Win2000. I would like to transfert the raw data
> > directly
> > > into a RAID 0 with SCSI 320 hard drives. I would like to attemp a
> > > sustained speed of 200MB/s. The PCI board and the raid are plugged
> > on a
> > > separete PCI bus (PCI 64/66). The système should work continously
> > until
> > > the disks are full.
> > >
> > > I think using the DMA of the Raid controlleur to transfert the data
> > from
> > > the PCI BAR memory (window of about 1 MB).
> > >
> > > Coul anyone tell me if it is possible in my device driver and how I
> > can do
> > > this.
> > >
> > > Best regards,
> > >
> > > Marc Roche
> > >
> > > —
> > > You are currently subscribed to ntdev as: xxxxx@storagecraft.com To
> > > unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as:
> > xxxxx@stratus.com To unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
> To unsubscribe send a blank email to xxxxx@lists.osr.com


You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
To unsubscribe send a blank email to xxxxx@lists.osr.com

This is also possible by passing a DirectDraw surface via the ReadFile
call.

Max

----- Original Message -----
From: “Roddy, Mark”
To: “NT Developers Interest List”
Sent: Wednesday, May 14, 2003 12:35 AM
Subject: [ntdev] Re: transfert data directly to SCSI

> Well it is still copy to host memory from video, copy from host
memory to
> scsi. I think the original poster wants to go directly from PCI
VIDEO memory
> to PCI SCSI adapter device memory using the SCSI adapter device DMA
to
> effect the transfer (PCI<->PCI.) I like your idea better, but I
think he is
> unlikely to get 200MBs xfer rates in either case.
>
> > -----Original Message-----
> > From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> > Sent: Tuesday, May 13, 2003 2:26 PM
> > To: NT Developers Interest List
> > Subject: [ntdev] Re: transfert data directly to SCSI
> >
> >
> > Use the user app, the usual SCSI miniport driver and the
> > DO_DIRECT_IO style of the video board driver.
> > The app must allocate a chunk of memory, then send the
> > noncached ReadFile to a video using this memory, then send
> > WriteFile to the on-disk file opened in noncached mode. This
> > will give you the zero-copy path from the video DMA to the
> > SCSI HBA’s DMA.
> >
> > Max
> >
> > ----- Original Message -----
> > From: “Marc ROCHE”
> > To: “NT Developers Interest List”
> > Sent: Tuesday, May 13, 2003 9:33 PM
> > Subject: [ntdev] transfert data directly to SCSI
> >
> >
> > > Hello Everyone,
> > >
> > > I am starting designing video acquisition board and the
> > corresponding
> > > device driver for Win2000. I would like to transfert the raw
data
> > directly
> > > into a RAID 0 with SCSI 320 hard drives. I would like to attemp
a
> > > sustained speed of 200MB/s. The PCI board and the raid are
plugged
> > on a
> > > separete PCI bus (PCI 64/66). The système should work
continously
> > until
> > > the disks are full.
> > >
> > > I think using the DMA of the Raid controlleur to transfert the
data
> > from
> > > the PCI BAR memory (window of about 1 MB).
> > >
> > > Coul anyone tell me if it is possible in my device driver and
how I
> > can do
> > > this.
> > >
> > > Best regards,
> > >
> > > Marc Roche
> > >
> > > —
> > > You are currently subscribed to ntdev as: xxxxx@storagecraft.com
To
> > > unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as:
> > xxxxx@stratus.com To unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>

Why not? The PCI target does not know what master drives it.

Max

----- Original Message -----
From: “Nike Chen”
To: “NT Developers Interest List”
Sent: Wednesday, May 14, 2003 6:38 AM
Subject: [ntdev] Re: transfert data directly to SCSI

> In X86 architecture, is it possible that bus master transfer between
device
> to device?
>
> Regards,
> Nike
>
> ----- Original Message -----
> From: “Roddy, Mark”
> To: “NT Developers Interest List”
> Sent: Wednesday, May 14, 2003 4:35 AM
> Subject: [ntdev] Re: transfert data directly to SCSI
>
>
> Well it is still copy to host memory from video, copy from host
memory to
> scsi. I think the original poster wants to go directly from PCI
VIDEO memory
> to PCI SCSI adapter device memory using the SCSI adapter device DMA
to
> effect the transfer (PCI<->PCI.) I like your idea better, but I
think he is
> unlikely to get 200MBs xfer rates in either case.
>
> > -----Original Message-----
> > From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> > Sent: Tuesday, May 13, 2003 2:26 PM
> > To: NT Developers Interest List
> > Subject: [ntdev] Re: transfert data directly to SCSI
> >
> >
> > Use the user app, the usual SCSI miniport driver and the
> > DO_DIRECT_IO style of the video board driver.
> > The app must allocate a chunk of memory, then send the
> > noncached ReadFile to a video using this memory, then send
> > WriteFile to the on-disk file opened in noncached mode. This
> > will give you the zero-copy path from the video DMA to the
> > SCSI HBA’s DMA.
> >
> > Max
> >
> > ----- Original Message -----
> > From: “Marc ROCHE”
> > To: “NT Developers Interest List”
> > Sent: Tuesday, May 13, 2003 9:33 PM
> > Subject: [ntdev] transfert data directly to SCSI
> >
> >
> > > Hello Everyone,
> > >
> > > I am starting designing video acquisition board and the
> > corresponding
> > > device driver for Win2000. I would like to transfert the raw
data
> > directly
> > > into a RAID 0 with SCSI 320 hard drives. I would like to attemp
a
> > > sustained speed of 200MB/s. The PCI board and the raid are
plugged
> > on a
> > > separete PCI bus (PCI 64/66). The système should work
continously
> > until
> > > the disks are full.
> > >
> > > I think using the DMA of the Raid controlleur to transfert the
data
> > from
> > > the PCI BAR memory (window of about 1 MB).
> > >
> > > Coul anyone tell me if it is possible in my device driver and
how I
> > can do
> > > this.
> > >
> > > Best regards,
> > >
> > > Marc Roche
> > >
> > > —
> > > You are currently subscribed to ntdev as: xxxxx@storagecraft.com
To
> > > unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as:
> > xxxxx@stratus.com To unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@iei.com.tw
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>
>
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>

The SCSI DMA will be utilized automatically, just open the file in
noncached mode and write the buffer of your video card to it.

Max

----- Original Message -----
From: “Marc Roche”
To: “NT Developers Interest List”
Sent: Wednesday, May 14, 2003 10:46 AM
Subject: [ntdev] Re: transfert data directly to SCSI

> Yes I want to transfert directly from the “PCI video” to “PCI raid
0” on the
> PCI 64 bits/66MHz. If I use a buffer memory, I am not should to keep
the
> sustained data rate of 200MB/s because i will have 200MB/s to
transfert PCI
> video to memory and 200MB/s to transfert memory to PCI raid. So the
total
> sustained rate will be 400MB/s.
>
> Do you think the raid is seen as a SCSI adapter DMA?
>
> Do I use the SCSI adapter DMA in my device driver of the PCI video
board?
>
> Thanks in advance,
>
> Marc Roche
>
> -----Message d’origine-----
> De : xxxxx@lists.osr.com
> [mailto:xxxxx@lists.osr.com]De la part de Roddy, Mark
> Envoye : mardi 13 mai 2003 22:36
> A : NT Developers Interest List
> Objet : [ntdev] Re: transfert data directly to SCSI
>
>
> Well it is still copy to host memory from video, copy from host
memory to
> scsi. I think the original poster wants to go directly from PCI
VIDEO memory
> to PCI SCSI adapter device memory using the SCSI adapter device DMA
to
> effect the transfer (PCI<->PCI.) I like your idea better, but I
think he is
> unlikely to get 200MBs xfer rates in either case.
>
> > -----Original Message-----
> > From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> > Sent: Tuesday, May 13, 2003 2:26 PM
> > To: NT Developers Interest List
> > Subject: [ntdev] Re: transfert data directly to SCSI
> >
> >
> > Use the user app, the usual SCSI miniport driver and the
> > DO_DIRECT_IO style of the video board driver.
> > The app must allocate a chunk of memory, then send the
> > noncached ReadFile to a video using this memory, then send
> > WriteFile to the on-disk file opened in noncached mode. This
> > will give you the zero-copy path from the video DMA to the
> > SCSI HBA’s DMA.
> >
> > Max
> >
> > ----- Original Message -----
> > From: “Marc ROCHE”
> > To: “NT Developers Interest List”
> > Sent: Tuesday, May 13, 2003 9:33 PM
> > Subject: [ntdev] transfert data directly to SCSI
> >
> >
> > > Hello Everyone,
> > >
> > > I am starting designing video acquisition board and the
> > corresponding
> > > device driver for Win2000. I would like to transfert the raw
data
> > directly
> > > into a RAID 0 with SCSI 320 hard drives. I would like to attemp
a
> > > sustained speed of 200MB/s. The PCI board and the raid are
plugged
> > on a
> > > separete PCI bus (PCI 64/66). The système should work
continously
> > until
> > > the disks are full.
> > >
> > > I think using the DMA of the Raid controlleur to transfert the
data
> > from
> > > the PCI BAR memory (window of about 1 MB).
> > >
> > > Coul anyone tell me if it is possible in my device driver and
how I
> > can do
> > > this.
> > >
> > > Best regards,
> > >
> > > Marc Roche
> > >
> > > —
> > > You are currently subscribed to ntdev as: xxxxx@storagecraft.com
To
> > > unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as:
> > xxxxx@stratus.com To unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com

Might I suggest a fibre channel adapter to your RAID? When last I looked
those beasts were well over 2 Gbps.


Gary G. Little
Have Computer, will travel …
www.wd-3.com

Gotta re-think my suggestion. Where as Fc will indeed help to get the data
rates your talking about in a standard SCSIPORT driver, the FC will most
likely have to be pushing 6 Gbps. (That’s, I say, that’s an estimate son). I
managed to push a QLogic card and driver in test to about 87MBps by setting
NumberOfRequests to 16 and MaximumSGList to 255. Once I went to
Storagecraft’s VSPORT and a block size of 2 meg with 16 requests I was
pushing 90 MBps, measured on IoMeter.


Gary G. Little
Have Computer, will travel …
www.wd-3.com

Damn … faulty memory … the block size never exceeded 1 meg, and I did
find that 1/2 a meg was actually more efficient.


Gary G. Little
Have Computer, will travel …
www.wd-3.com

“Gary G. Little” wrote in message
news:xxxxx@ntdev…
>
> Gotta re-think my suggestion. Where as Fc will indeed help to get the data
> rates your talking about in a standard SCSIPORT driver, the FC will most
> likely have to be pushing 6 Gbps. (That’s, I say, that’s an estimate son).
I
> managed to push a QLogic card and driver in test to about 87MBps by
setting
> NumberOfRequests to 16 and MaximumSGList to 255. Once I went to
> Storagecraft’s VSPORT and a block size of 2 meg with 16 requests I was
> pushing 90 MBps, measured on IoMeter.
>
>
> –
> Gary G. Little
> Have Computer, will travel …
> www.wd-3.com
>
>
>
>

Hi Max

Could you tell me were you open the file in the device driver or in the user
app using CFile class of VC++ 6.0.

Thanks in advance,

Marc Roche

-----Message d’origine-----
De : xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com]De la part de Maxim S. Shatskih
Envoye : mercredi 14 mai 2003 15:11
A : NT Developers Interest List
Objet : [ntdev] Re: transfert data directly to SCSI

The SCSI DMA will be utilized automatically, just open the file in
noncached mode and write the buffer of your video card to it.

Max

----- Original Message -----
From: “Marc Roche”
To: “NT Developers Interest List”
Sent: Wednesday, May 14, 2003 10:46 AM
Subject: [ntdev] Re: transfert data directly to SCSI

> Yes I want to transfert directly from the “PCI video” to “PCI raid
0” on the
> PCI 64 bits/66MHz. If I use a buffer memory, I am not should to keep
the
> sustained data rate of 200MB/s because i will have 200MB/s to
transfert PCI
> video to memory and 200MB/s to transfert memory to PCI raid. So the
total
> sustained rate will be 400MB/s.
>
> Do you think the raid is seen as a SCSI adapter DMA?
>
> Do I use the SCSI adapter DMA in my device driver of the PCI video
board?
>
> Thanks in advance,
>
> Marc Roche
>
> -----Message d’origine-----
> De : xxxxx@lists.osr.com
> [mailto:xxxxx@lists.osr.com]De la part de Roddy, Mark
> Envoye : mardi 13 mai 2003 22:36
> A : NT Developers Interest List
> Objet : [ntdev] Re: transfert data directly to SCSI
>
>
> Well it is still copy to host memory from video, copy from host
memory to
> scsi. I think the original poster wants to go directly from PCI
VIDEO memory
> to PCI SCSI adapter device memory using the SCSI adapter device DMA
to
> effect the transfer (PCI<->PCI.) I like your idea better, but I
think he is
> unlikely to get 200MBs xfer rates in either case.
>
> > -----Original Message-----
> > From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> > Sent: Tuesday, May 13, 2003 2:26 PM
> > To: NT Developers Interest List
> > Subject: [ntdev] Re: transfert data directly to SCSI
> >
> >
> > Use the user app, the usual SCSI miniport driver and the
> > DO_DIRECT_IO style of the video board driver.
> > The app must allocate a chunk of memory, then send the
> > noncached ReadFile to a video using this memory, then send
> > WriteFile to the on-disk file opened in noncached mode. This
> > will give you the zero-copy path from the video DMA to the
> > SCSI HBA’s DMA.
> >
> > Max
> >
> > ----- Original Message -----
> > From: “Marc ROCHE”
> > To: “NT Developers Interest List”
> > Sent: Tuesday, May 13, 2003 9:33 PM
> > Subject: [ntdev] transfert data directly to SCSI
> >
> >
> > > Hello Everyone,
> > >
> > > I am starting designing video acquisition board and the
> > corresponding
> > > device driver for Win2000. I would like to transfert the raw
data
> > directly
> > > into a RAID 0 with SCSI 320 hard drives. I would like to attemp
a
> > > sustained speed of 200MB/s. The PCI board and the raid are
plugged
> > on a
> > > separete PCI bus (PCI 64/66). The syst?me should work
continously
> > until
> > > the disks are full.
> > >
> > > I think using the DMA of the Raid controlleur to transfert the
data
> > from
> > > the PCI BAR memory (window of about 1 MB).
> > >
> > > Coul anyone tell me if it is possible in my device driver and
how I
> > can do
> > > this.
> > >
> > > Best regards,
> > >
> > > Marc Roche
> > >
> > > —
> > > You are currently subscribed to ntdev as: xxxxx@storagecraft.com
To
> > > unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as:
> > xxxxx@stratus.com To unsubscribe send a blank email to
> > xxxxx@lists.osr.com
> >
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com


You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
To unsubscribe send a blank email to xxxxx@lists.osr.com

Better to use raw CreateFile then CFile class to ensure that noncached
flag is set.

Anyway CFile is crap. C runtime open()/read()/write() is more pleasant
IMHO :-)))

Max

----- Original Message -----
From: “Marc Roche”
To: “NT Developers Interest List”
Sent: Thursday, May 15, 2003 11:08 AM
Subject: [ntdev] Re: transfert data directly to SCSI

> Hi Max
>
> Could you tell me were you open the file in the device driver or in
the user
> app using CFile class of VC++ 6.0.
>
> Thanks in advance,
>
> Marc Roche
>
>
>
>
> -----Message d’origine-----
> De : xxxxx@lists.osr.com
> [mailto:xxxxx@lists.osr.com]De la part de Maxim S.
Shatskih
> Envoye : mercredi 14 mai 2003 15:11
> A : NT Developers Interest List
> Objet : [ntdev] Re: transfert data directly to SCSI
>
>
> The SCSI DMA will be utilized automatically, just open the file
in
> noncached mode and write the buffer of your video card to it.
>
> Max
>
> ----- Original Message -----
> From: “Marc Roche”
> To: “NT Developers Interest List”
> Sent: Wednesday, May 14, 2003 10:46 AM
> Subject: [ntdev] Re: transfert data directly to SCSI
>
>
> > Yes I want to transfert directly from the “PCI video” to “PCI raid
> 0” on the
> > PCI 64 bits/66MHz. If I use a buffer memory, I am not should to
keep
> the
> > sustained data rate of 200MB/s because i will have 200MB/s to
> transfert PCI
> > video to memory and 200MB/s to transfert memory to PCI raid. So
the
> total
> > sustained rate will be 400MB/s.
> >
> > Do you think the raid is seen as a SCSI adapter DMA?
> >
> > Do I use the SCSI adapter DMA in my device driver of the PCI video
> board?
> >
> > Thanks in advance,
> >
> > Marc Roche
> >
> > -----Message d’origine-----
> > De : xxxxx@lists.osr.com
> > [mailto:xxxxx@lists.osr.com]De la part de Roddy, Mark
> > Envoye : mardi 13 mai 2003 22:36
> > A : NT Developers Interest List
> > Objet : [ntdev] Re: transfert data directly to SCSI
> >
> >
> > Well it is still copy to host memory from video, copy from host
> memory to
> > scsi. I think the original poster wants to go directly from PCI
> VIDEO memory
> > to PCI SCSI adapter device memory using the SCSI adapter device
DMA
> to
> > effect the transfer (PCI<->PCI.) I like your idea better, but I
> think he is
> > unlikely to get 200MBs xfer rates in either case.
> >
> > > -----Original Message-----
> > > From: Maxim S. Shatskih [mailto:xxxxx@storagecraft.com]
> > > Sent: Tuesday, May 13, 2003 2:26 PM
> > > To: NT Developers Interest List
> > > Subject: [ntdev] Re: transfert data directly to SCSI
> > >
> > >
> > > Use the user app, the usual SCSI miniport driver and the
> > > DO_DIRECT_IO style of the video board driver.
> > > The app must allocate a chunk of memory, then send the
> > > noncached ReadFile to a video using this memory, then send
> > > WriteFile to the on-disk file opened in noncached mode. This
> > > will give you the zero-copy path from the video DMA to the
> > > SCSI HBA’s DMA.
> > >
> > > Max
> > >
> > > ----- Original Message -----
> > > From: “Marc ROCHE”
> > > To: “NT Developers Interest List”
> > > Sent: Tuesday, May 13, 2003 9:33 PM
> > > Subject: [ntdev] transfert data directly to SCSI
> > >
> > >
> > > > Hello Everyone,
> > > >
> > > > I am starting designing video acquisition board and the
> > > corresponding
> > > > device driver for Win2000. I would like to transfert the raw
> data
> > > directly
> > > > into a RAID 0 with SCSI 320 hard drives. I would like to
attemp
> a
> > > > sustained speed of 200MB/s. The PCI board and the raid are
> plugged
> > > on a
> > > > separete PCI bus (PCI 64/66). The système should work
> continously
> > > until
> > > > the disks are full.
> > > >
> > > > I think using the DMA of the Raid controlleur to transfert the
> data
> > > from
> > > > the PCI BAR memory (window of about 1 MB).
> > > >
> > > > Coul anyone tell me if it is possible in my device driver and
> how I
> > > can do
> > > > this.
> > > >
> > > > Best regards,
> > > >
> > > > Marc Roche
> > > >
> > > > —
> > > > You are currently subscribed to ntdev as:
xxxxx@storagecraft.com
> To
> > > > unsubscribe send a blank email to
> > > xxxxx@lists.osr.com
> > >
> > >
> > >
> > > —
> > > You are currently subscribed to ntdev as:
> > > xxxxx@stratus.com To unsubscribe send a blank email to
> > > xxxxx@lists.osr.com
> > >
> >
> >
> > —
> > You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
> > To unsubscribe send a blank email to
> xxxxx@lists.osr.com
> >
> >
> >
> > —
> > You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> > To unsubscribe send a blank email to
> xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@mvd-fpga.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>
>
>
> —
> You are currently subscribed to ntdev as: xxxxx@storagecraft.com
> To unsubscribe send a blank email to
xxxxx@lists.osr.com
>