Coverage reports for tests?

4 messages Options
Embed this post
Permalink
Alexander Limi

Coverage reports for tests?

Reply Threaded More More options
Print post
Permalink
Now that we're getting closer to our goal of having nightly performance test runs, I was curious about a similar thing we have spoken about in the past: Having unit test coverage numbers for our core modules.

I realize that this doesn't make sense for a lot of the older modules (unit tests vs. integration tests, etc), but is this something we should look into as part of our nightly test runs?

--
Alexander Limi · http://limi.net

------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Plone-developers mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-developers
Alexander Limi · http://limi.net

Martin Aspeli

Re: Coverage reports for tests?

Reply Threaded More More options
Print post
Permalink
Alexander Limi wrote:
> Now that we're getting closer to our goal of having nightly performance
> test runs, I was curious about a similar thing we have spoken about in
> the past: Having unit test coverage numbers for our core modules.
>
> I realize that this doesn't make sense for a lot of the older modules
> (unit tests vs. integration tests, etc), but is this something we should
> look into as part of our nightly test runs?

+1

This is a good way to encourage people to think about their test
coverage and strive for 100%.

Martin

--
Author of `Professional Plone Development`, a book for developers who
want to work with Plone. See http://martinaspeli.net/plone-book


------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Plone-developers mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-developers
Eric Steele (esteele)

Re: Coverage reports for tests?

Reply Threaded More More options
Print post
Permalink
In reply to this post by Alexander Limi
Some javascript/style in this post has been disabled (why?)
On Sep 29, 2009, at 10:55 PM, Alexander Limi wrote:

Now that we're getting closer to our goal of having nightly performance test runs, I was curious about a similar thing we have spoken about in the past: Having unit test coverage numbers for our core modules.

I realize that this doesn't make sense for a lot of the older modules (unit tests vs. integration tests, etc), but is this something we should look into as part of our nightly test runs?

-- 
Alexander Limi · http://limi.net


I'd definitely like to have this happen. We may want to do them on a weekly basis instead of nightly since they take so long. There's a nice diff option available that'll highlight changes from one run to the next.

Are we going to run into the same problems with tests not cleaning up after themselves, or is that moot since we only care about what lines of code are touched and not the results?

Eric

------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Plone-developers mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-developers
David Glick-2

Re: Coverage reports for tests?

Reply Threaded More More options
Print post
Permalink
Eric Steele wrote:

> On Sep 29, 2009, at 10:55 PM, Alexander Limi wrote:
>
>> Now that we're getting closer to our goal of having nightly
>> performance test runs, I was curious about a similar thing we have
>> spoken about in the past: Having unit test coverage numbers for our
>> core modules.
>>
>> I realize that this doesn't make sense for a lot of the older modules
>> (unit tests vs. integration tests, etc), but is this something we
>> should look into as part of our nightly test runs?
>>
>> --
>> Alexander Limi · http://limi.net <http://limi.net/>
>
>
> I'd definitely like to have this happen. We may want to do them on a
> weekly basis instead of nightly since they take so long. There's a nice
> diff option available that'll highlight changes from one run to the next.
>
> Are we going to run into the same problems with tests not cleaning up
> after themselves, or is that moot since we only care about what lines of
> code are touched and not the results?

I believe Andrew Burkhalter was once doing some work on running coverage
tests with buildbot.  Are you able to share any of that code, Andrew?

David

------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Plone-developers mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-developers