[freenet-dev] GSoC 2008

[Alberto Bacchelli]

Florent Daignière wrote:
> * Matthew Toseland <toad at amphibian.dyndns.org> [2008-02-28 12:24:12]:
>
>   
[CUT]
> Well even though the produced code wasn't up to our expectations it was
> good for the project on overall. Some of last year students are
> still around:
> 	- kryptos gave a talk at FOSS.IN
> 	- sback told me he would try to write some additional regression
> 	tests using some automated tools he is working on
>   
Hi,
 I get the occasion to tell you something about the reseach I've just ended.
In my Master thesis I compared the manual tests I did during my GSoC to
tests created last months using automatic test generation tools.

Making a long story short, I've found that the service JUnit Factory [0]
generates high quality regression tests in a few minutes.
I tried to use it on the same classes I've tested manually
and I compared the results using the mutation analysis [1].
This is the comparison http://sback.it/thesis/jesterReport-summary.pdf
where MS is the mutation score reached (100 is the maximum).

JUnit Factory is not a tool, it is a service: to generate tests you must
download
an Eclipse plugin. It permits you to specify classes you want to test
and upload them on Agitar server. In a few minutes you get the correspondant
unit tests back.
Those tests are based on JUnit but require a library you can download
freely from
junit factory site. You can integrate them in you Ant build (I did it
successfully).

I think it could be really worthy to integrate JUnit Factory tests in
Freenet.
The service is free (as in beer..) it is a service
so you don't see the code they use to generate tests,
but beside this there is no licence matters using it.

If you agree I could start testing classes in freenet.support
which aren't covered by tests yet.

Bye,

 Sback


[0] http://www.junitfactory.com/
[1] http://en.wikipedia.org/wiki/Mutation_testing