Code coverage tools for drivers.

Hi All,

I want to know best code coverage tool available in the market.
I am currently evaluating BullseyeCoverage for windows. It seems very good, but I want suggestions from all of you. Please tell me various options and their advantages.

Thanks & Regards,
Amit.

Are you talking about hollerith code ? If so then you might not find the
answer here !.

What kind of code ?

-pro

On 8/31/07, xxxxx@yahoo.com
wrote:
>
> Hi All,
>
> I want to know best code coverage tool available in the market.
> I am currently evaluating BullseyeCoverage for windows. It seems very
> good, but I want suggestions from all of you. Please tell me various options
> and their advantages.
>
> Thanks & Regards,
> Amit.
>
> —
> NTDEV is sponsored by OSR
>
> For our schedule of WDF, WDM, debugging and other seminars visit:
> http://www.osr.com/seminars
>
> To unsubscribe, visit the List Server section of OSR Online at
> http://www.osronline.com/page.cfm?name=ListServer
>

I have spacified that it is driver code. ie. the source code written for driver module.

The COVERAGE_HIT macro with a small number after each opening brace and in
each “if” branch.

I use exactly this in my most important code paths, to be sure all special
cases were executed.


Maxim Shatskih, Windows DDK MVP
StorageCraft Corporation
xxxxx@storagecraft.com
http://www.storagecraft.com

wrote in message news:xxxxx@ntdev…
> Hi All,
>
> I want to know best code coverage tool available in the market.
> I am currently evaluating BullseyeCoverage for windows. It seems very good,
but I want suggestions from all of you. Please tell me various options and
their advantages.
>
> Thanks & Regards,
> Amit.
>

In your original post, I’ve not seen a word “driver” …

The best of the lot used to be the TureCoverage from Driver Studio ( this is
the suite with softice and other things). You can still download an
evaluation copy ( I think) and try it out. It is good up to windows XP.

-pro

On 8/31/07, Prokash Sinha wrote:
>
> Are you talking about hollerith code ? If so then you might not find the
> answer here !.
>
> What kind of code ?
>
> -pro
>
>
> On 8/31/07, xxxxx@yahoo.com
> wrote:
> >
> > Hi All,
> >
> > I want to know best code coverage tool available in the market.
> > I am currently evaluating BullseyeCoverage for windows. It seems very
> > good, but I want suggestions from all of you. Please tell me various options
> > and their advantages.
> >
> > Thanks & Regards,
> > Amit.
> >
> > —
> > NTDEV is sponsored by OSR
> >
> > For our schedule of WDF, WDM, debugging and other seminars visit:
> > http://www.osr.com/seminars
> >
> > To unsubscribe, visit the List Server section of OSR Online at
> > http://www.osronline.com/page.cfm?name=ListServer
> >
>
>

He means test coverage and analysis tools: tools that measure how completely
your test matrix exercises your source code. Static Driver Verifier attempts
to do this via static analysis, other tools instrument your source code and
then can report back metrics.

From: xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com] On Behalf Of Prokash Sinha
Sent: Saturday, September 01, 2007 2:53 AM
To: Windows System Software Devs Interest List
Subject: Re: [ntdev] Code coverage tools for drivers.

Are you talking about hollerith code ? If so then you might not find the
answer here !.

What kind of code ?

-pro

On 8/31/07, xxxxx@yahoo.com mailto:xxxxx > wrote:

Hi All,

I want to know best code coverage tool available in the market.
I am currently evaluating BullseyeCoverage for windows. It seems very good,
but I want suggestions from all of you. Please tell me various options and
their advantages.

Thanks & Regards,
Amit.


NTDEV is sponsored by OSR

For our schedule of WDF, WDM, debugging and other seminars visit:
http://www.osr.com/seminars

To unsubscribe, visit the List Server section of OSR Online at
http://www.osronline.com/page.cfm?name=ListServer

— NTDEV is sponsored by OSR For our schedule of WDF, WDM, debugging and
other seminars visit: http://www.osr.com/seminars To unsubscribe, visit the
List Server section of OSR Online at
http://www.osronline.com/page.cfm?name=ListServer</mailto:xxxxx>

“Prokash Sinha” wrote in message news:xxxxx@ntdev…
> In your original post, I’ve not seen a word “driver” …
>
> The best of the lot used to be the TureCoverage from Driver Studio ( this
> is
> the suite with softice and other things). You can still download an
> evaluation copy ( I think) and try it out. It is good up to windows XP.
>
> -pro
>
Sorry, but TrueCoverage was a pig compared to Bullseye. I have encountered
performance hits of 10+ times degradation on code with TrueCoverage which
meant the driver in essence did not work. Bullseye typically has a 10%
overhead.


Don Burn (MVP, Windows DDK)
Windows 2k/XP/2k3 Filesystem and Driver Consulting
Website: http://www.windrvr.com
Blog: http://msmvps.com/blogs/WinDrvr
Remove StopSpam to reply

It’s been a long while, but when I took the coverage data the env. was: A
protocol driver, an intermediate driver, and a miniport using ebx… type
samples on an intel pro card …

The coverage data was excellent, and there was not much of a performance
degradation. But granted I did not look thru the extra code added in the
instrumented version. The QA had a set of test programs to cover as much as
possible. Running them and getting the statistics was not much of a pain.
And it was pretty accurate.

-pro

On 9/1/07, Don Burn wrote:
>
>
> “Prokash Sinha” wrote in message news:xxxxx@ntdev…
> > In your original post, I’ve not seen a word “driver” …
> >
> > The best of the lot used to be the TureCoverage from Driver Studio (
> this
> > is
> > the suite with softice and other things). You can still download an
> > evaluation copy ( I think) and try it out. It is good up to windows XP.
> >
> > -pro
> >
> Sorry, but TrueCoverage was a pig compared to Bullseye. I have
> encountered
> performance hits of 10+ times degradation on code with TrueCoverage which
> meant the driver in essence did not work. Bullseye typically has a 10%
> overhead.
>
>
> –
> Don Burn (MVP, Windows DDK)
> Windows 2k/XP/2k3 Filesystem and Driver Consulting
> Website: http://www.windrvr.com
> Blog: http://msmvps.com/blogs/WinDrvr
> Remove StopSpam to reply
>
>
>
> —
> NTDEV is sponsored by OSR
>
> For our schedule of WDF, WDM, debugging and other seminars visit:
> http://www.osr.com/seminars
>
> To unsubscribe, visit the List Server section of OSR Online at
> http://www.osronline.com/page.cfm?name=ListServer
>

I agree with Don on this one; TrueCoverage is just horrendous. Unlike
Don, I was a long time user of SoftICE, and I still think TrueCoverage,
and all the various crap that Compuware packaged with SoftICE as their
“True” response to “Visual,” along the way more than doubling the price
and creating “DriverStudio,” deeply, deeply sucks. As I it “came
bundled,” I tried it several times, and then never used it again, not in
the seven years or so that it arrived with SoftICE.

mm

-----Original Message-----
From: xxxxx@lists.osr.com
[mailto:xxxxx@lists.osr.com] On Behalf Of Don Burn
Sent: Saturday, September 01, 2007 11:15
To: Windows System Software Devs Interest List
Subject: Re:[ntdev] Code coverage tools for drivers.

“Prokash Sinha” wrote in message
news:xxxxx@ntdev…
> In your original post, I’ve not seen a word “driver” …
>
> The best of the lot used to be the TureCoverage from Driver Studio (
this
> is
> the suite with softice and other things). You can still download an
> evaluation copy ( I think) and try it out. It is good up to windows
XP.
>
> -pro
>
Sorry, but TrueCoverage was a pig compared to Bullseye. I have
encountered
performance hits of 10+ times degradation on code with TrueCoverage
which
meant the driver in essence did not work. Bullseye typically has a 10%
overhead.


Don Burn (MVP, Windows DDK)
Windows 2k/XP/2k3 Filesystem and Driver Consulting
Website: http://www.windrvr.com
Blog: http://msmvps.com/blogs/WinDrvr
Remove StopSpam to reply


NTDEV is sponsored by OSR

For our schedule of WDF, WDM, debugging and other seminars visit:
http://www.osr.com/seminars

To unsubscribe, visit the List Server section of OSR Online at
http://www.osronline.com/page.cfm?name=ListServer

Maxim,

where is this macro defined. It sounds itneresting, but I cannot find it.

AB

On 9/1/07, Maxim S. Shatskih wrote:
>
> The COVERAGE_HIT macro with a small number after each opening brace and
> in
> each “if” branch.
>
> I use exactly this in my most important code paths, to be sure all
> special
> cases were executed.
>
> –
> Maxim Shatskih, Windows DDK MVP
> StorageCraft Corporation
> xxxxx@storagecraft.com
> http://www.storagecraft.com
>
> wrote in message news:xxxxx@ntdev…
> > Hi All,
> >
> > I want to know best code coverage tool available in the market.
> > I am currently evaluating BullseyeCoverage for windows. It seems very
> good,
> but I want suggestions from all of you. Please tell me various options and
> their advantages.
> >
> > Thanks & Regards,
> > Amit.
> >
>
>
> —
> NTDEV is sponsored by OSR
>
> For our schedule of WDF, WDM, debugging and other seminars visit:
> http://www.osr.com/seminars
>
> To unsubscribe, visit the List Server section of OSR Online at
> http://www.osronline.com/page.cfm?name=ListServer
>



- amitr0

Write it yourself, it is trivial.


Maxim Shatskih, Windows DDK MVP
StorageCraft Corporation
xxxxx@storagecraft.com
http://www.storagecraft.com

“amitr0” wrote in message news:xxxxx@ntdev…
> Maxim,
>
> where is this macro defined. It sounds itneresting, but I cannot find it.
>
> AB
>
>
> On 9/1/07, Maxim S. Shatskih wrote:
> >
> > The COVERAGE_HIT macro with a small number after each opening brace and
> > in
> > each “if” branch.
> >
> > I use exactly this in my most important code paths, to be sure all
> > special
> > cases were executed.
> >
> > –
> > Maxim Shatskih, Windows DDK MVP
> > StorageCraft Corporation
> > xxxxx@storagecraft.com
> > http://www.storagecraft.com
> >
> > wrote in message news:xxxxx@ntdev…
> > > Hi All,
> > >
> > > I want to know best code coverage tool available in the market.
> > > I am currently evaluating BullseyeCoverage for windows. It seems very
> > good,
> > but I want suggestions from all of you. Please tell me various options and
> > their advantages.
> > >
> > > Thanks & Regards,
> > > Amit.
> > >
> >
> >
> > —
> > NTDEV is sponsored by OSR
> >
> > For our schedule of WDF, WDM, debugging and other seminars visit:
> > http://www.osr.com/seminars
> >
> > To unsubscribe, visit the List Server section of OSR Online at
> > http://www.osronline.com/page.cfm?name=ListServer
> >
>
>
>
> –
>
> - amitr0
>

> I want to know best code coverage tool available in the market.

I can’t say what is “best”, but we have used Bullseye in the past and
were very happy with it as a product, with the support we received, and
the quick responses to problems that we ran into. We had used it in
both driver and non-driver code.

AFAIK Bullseye is the ONLY commercial code coverage tool available for
Windows drivers today and thankfully it is very good.

Bill M.

wrote in message news:xxxxx@ntdev…
> Hi All,
>
> I want to know best code coverage tool available in the market.
> I am currently evaluating BullseyeCoverage for windows. It seems very
> good, but I want suggestions from all of you. Please tell me various
> options and their advantages.
>
> Thanks & Regards,
> Amit.
>

Thanks to all who have replayed to this post.