Statistical Testing User Requirements: Traceability
USER REQUIREMENT | TYPE | OOAD | CODE | UNIT TEST |
REFERENCES | DOCUMENTATION |
Comparing
one-dimensional distributions: two-sample problem |
||||||
UR 1.1 Chi-squared (Gamma function) |
Binned |
Design |
CVS Comparison/src ChisquaredComparisonAlgorithm Implemented ChisquaredQualityChecker Implemented |
CVS Comparison/unitTest testChi2ComparisonAlgorithm1 Test result: OK testChi2ComparisonAlgorithm2 Test result: OK testChi2QualityChecker Test result: OK testChisquaredTotal1 Test result: OK testChisquaredTotal2 Test result: OK |
K. Pearson (1900) D. Piccolo (book) W. E. Deming (book) |
Statistics
Reference
User Guide |
UR 1.2 Anderson-Darling |
Binned |
Design | CVS Comparison/src AndersonDarlingBinnedComparisonAlgorithm Implemented AndersonDarlingQualityChecker Implemented |
CVS Comparison/unitTest testAndersonDarlingBinnedComparisonAlgorithm1 Test result: OK testAndersonDarlingQualityChecker Test result: OK testAndersonDarlingBinnedTotal Test result: OK testAndersonDarlingBinnedTotal1 Test result: OK testAndersonDarlingBinnedTotal2 Test result: OK testAndersonDarlingBinnedTotal3 Test result: OK testAndersonDarlingBinnedTotal4 Test result: OK |
F. W. Scholz, M. A. Stephens (1987) | Statistics
Reference
User Guide |
UR 1.3 Cramer-von Mises |
Binned |
Design | CVS Comparison/src CramerVonMisesBinnedComparisonAlgorithm Implemented CramerVonMisesQualityChecker Implemented |
CVS Comparison/unitTest testCramerVonMisesBinnedComparisonAlgorithm1 Test result: OK testCramerVonMisesBinnedComparisonAlgorithm2 Test result: OK testCramerVonMisesBinnedComparisonAlgorithm3 Test result: OK testCramerVonMisesBinnedComparisonAlgorithm4 Test result: OK testCramerVonMisesQualityChecker Test result: OK testCramerVonMisesBinnedTotal Test result: OK testCramerVonMisesBinnedTotal1 Test result: OK |
M. Fisz (1960)
Conover (book) |
Statistics
Reference
User Guide |
UR 1.4 Tiku (CvM in a chi2 approximation) |
Binned |
Design | CVS Comparison/src TikuBinnedComparisonAlgorithm Implemented TikuBinnedQualityChecker Implemented |
CVS Comparison/unitTest testTikuBinnedComparisonAlgorithm Test result: OK testTikuBinnedComparisonAlgorithm2 Test result: OK testTikuBinnedQualityChecker Test result: OK testTikuBinnedTotal Test result: OK |
M. L. Tiku (1963) | Statistics
Reference
User Guide |
UR 1.5 Goodman (KS in a chi2 approximation) |
Unbinned |
Design | CVS Comparison/src KolmogorovSmirnovApproxComparisonAlgorithm Implemented KolmogorovSmirnovApproxQualityChecker Implemented |
CVS Comparison/unitTest testKolmogorovSmirnovApproxComparisonAlgorithm1 Test result: OK testKolmogorovSmirnovApproxComparisonAlgorithm2 Test result: OK testKolmogorovSmirnovApproxQualityChecker Test result: OK testKolmogorovSmirnovApproxTotal Test result: OK |
L. A.
Goodman (1954) S. Siegel (book) |
Statistics
Reference
User Guide |
UR 1.6 Kolmogorov-Smirnov |
Unbinned |
Design | CVS Comparison/src KolmogorovSmirnovComparisonAlgorithm Implemented KolmogorovSmirnovQualityChecker Implemented |
CVS Comparison/unitTest testKolmogorovSmirnovComparisonAlgorithm1 Test result: OK testKolmogorovSmirnovComparisonAlgorithm2 Test result: OK testKolmogorovSmirnovComparisonAlgorithm3 Test result: OK testKolmogorovSmirnovQualityChecker Test result: OK testKolmogorovSmirnovQualityChecker1 Test result: OK testKolmogorovSmirnovTotal Test result: OK testKolmogorovSmirnovTotal2 Test result: OK testKolmogorovSmirnovTotal3 Test result: OK testKolmogorovSmirnovTotal4 Test result: OK |
N. V.
Smirnov (1939) N. V. Smirnov (1948) |
Statistics
Reference
User Guide |
UR 1.7 Weighted KS (AD weighting function) |
Unbinned |
Design | CVS Comparison/src Weighted2KolmogorovSminovComparisonAlgorithm Implemented Weighted2KolmogorovSmirnovQualityChecker Implemented |
testWeighted2KolmogorovSmirnovComparisonAlgorithm1 Test result: OK testWeighted2KolmogorovSmirnovComparisonAlgorithm2 Test result: OK testWeighted2KolmogorovSmirnovComparisonAlgorithm3 Test result: OK testWeighted2KolmogorovSmirnovComparisonAlgorithm4 Test result: OK testWeighted2KolmogorovSmirnovComparisonAlgorithm5 Test result: OK testWeighted2KolmogorovSmirnovComparisonAlgorithm6 Test result: OK testWeighted2KolmogorovSmirnovComparisonAlgorithm7 Test result: OK testWeighted2KolmogorovSmirnovQualityChecker Test result: OK testWeighted2KolmogorovSmirnovTotal Test result: OK |
H.
Buning (2001) P. L. Canner (1975) |
To be documented |
UR 1.8 Weighted KS (Buning weighting function) |
Unbinned |
Design | CVS Comparison/src Weighted1KolmogorovSminovComparisonAlgorithm Implemented Weighted1KolmogorovSmirnovQualityChecker Implemented |
testWeighted1KolmogorovSmirnovComparisonAlgorithm1 Test result: OK testWeighted1KolmogorovSmirnovComparisonAlgorithm2 Test result: OK testWeighted1KolmogorovSmirnovComparisonAlgorithm3 Test result: OK testWeighted1KolmogorovSmirnovComparisonAlgorithm4 Test result: OK testWeighted1KolmogorovSmirnovComparisonAlgorithm5 Test result: OK testWeighted1KolmogorovSmirnovComparisonAlgorithm6 Test result: OK testWeighted1KolmogorovSmirnovComparisonAlgorithm7 Test result: OK testWeighted1KolmogorovSmirnovQualityChecker Test result: OK testWeighted1KolmogorovSmirnovTotal Test result: OK |
H. Buning (2001) | To be documented |
UR 1.9 Anderson-Darling |
Unbinned |
Design | CVS Comparison/src AndersonDarlingUnbinnedComparisonAlgorithm Implemented AndersonDarlingQualityChecker Implemented |
CVS Comparison/unitTest testAndersonDarlingUnbinnedComparisonAlgorithm1 Test result: OK testAndersonDarlingQualityChecker Test result: OK testAndersonDarlingUnbinnedTotal Test result: OK testAndersonDarlingUnbinnedTotal1 Test result: OK testAndersonDarlingUnbinnedTotal2 Test result: OK testAndersonDarlingUnbinnedTotal3 Test result: OK testAndersonDarlingUnbinnedTotal4 Test result: OK |
F. W. Scholz, M. A. Stephens (1987) | Statistics
Reference
User Guide |
UR 1.10 Cramer-von Mises |
Unbinned |
Design | CVS Comparison/src CramerVonMisesUnbinnedComparisonAlgorithm Implemented CramerVonMisesQualityChecker Implemented |
CVS Comparison/unitTest testCramerVonMisesUnbinnedComparisonAlgorithm1 Test result: OK testCramerVonMisesUnbinnedComparisonAlgorithm2 Test result: OK testCramerVonMisesUnbinnedComparisonAlgorithm3 Test result: OK testCramerVonMisesUnbinnedComparisonAlgorithm4 Test result: OK testCramerVonMisesUnbinnedComparisonAlgorithm5 Test result: OK testCramerVonMisesQualityChecker Test result: OK testCramerVonMisesUnbinnedTotal Test result: OK testCramerVonMisesUnbinnedTotal1 Test result: OK testCramerVonMisesUnbinnedTotal2 Test result: OK testCramerVonMisesUnbinnedTotal3 Test result: OK |
M. Fisz (1960) | Statistics
Reference
User Guide |
UR 1.11 Weighted CvM (Buning weighting function) |
Unbinned |
Design | CVS Comparison/src WeightedCramerVonMisesComparisonAlgorithm Implemented WeightedCramerVonMisesQualityChecker Implemented |
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm1 Test result: OK testWeightedCramerVonMisesUnbinnedComparisonAlgorithm2 Test result: OK testWeightedCramerVonMisesUnbinnedComparisonAlgorithm3 Test result: OK testWeightedCramerVonMisesUnbinnedComparisonAlgorithm4 Test result: OK testWeightedCramerVonMisesUnbinnedComparisonAlgorithm5 Test result: OK testWeightedCramerVonMisesUnbinnedComparisonAlgorithm6 Test result: OK testWeightedCramerVonMisesUnbinnedComparisonAlgorithm7 Test result: OK testWeightedCramerVonMisesQualityChecker Test result: OK testWeightedCramerVonMisesUnbinnedTotal Test result: OK |
H. Buning (2001) | To be documented |
UR 1.12 Kuiper |
Unbinned |
Design | CVS Comparison/src KuiperComparisonAlgorithm Implemented KuiperQualityChecker Implemented |
CVS Comparison/unitTest testKuiperComparisonAlgorithm Test result: OK testKuiperQualityChecker Test result: OK testKuiperTotal Test result: OK |
N. H.
Kuiper (1960) E. Batschelet (book) |
Statistics
Reference
User Guide |
UR 1.13 Tiku (CvM in a chi2 approximation) |
Unbinned |
Design | CVS Comparison/src TikuUnbinnedComparisonAlgorithm Implemented TikuUnbinnedQualityChecker Implemented |
CVS Comparison/unitTest testTikuUnbinnedComparisonAlgorithm Test result: OK testTikuUnbinnedQualityChecker Test result: OK testTikuUnbinnedTotal Test result: OK |
M. L. Tiku (1963) | Statistics
Reference
User Guide |
UR 1.14 Watson |
Unbinned |
Design | CVS Comparison/src WatsonComparisonAlgorithm Implemented WatsonQualityChecker Implemented |
CVS Comparison/unitTest testWatsonComparisonAlgorithm Test result: OK testWatsonQualityChecker Test result: OK testWatsonTotal Test result: OK |
G. S. Watson
(1961) E. Batschelet (book) |
To be documented |
UR 1.15 Fast Chi-squared (Incomplete gamma function) |
Binned |
Design | CVS Comparison/src Chi2FastComparisonAlgorithm Implemented Chi2FastQualityChecker Implemented |
CVS Comparison/unitTest testChi2FastComparisonAlgorithm1 Test result: OK testChi2FastComparisonAlgorithm2 Test result: OK testChi2FastQualityChecker Test result: OK testChi2FastTotal1 Test result: OK |
E. W. Weisstein (1999) |
To be documented |
UR
1.16 GSL Chi-squared |
Binned | Design | CVS Comparison/src Chi2GSLComparisonAlgorithm Implemented Chi2GSLQualityChecker Implemented |
CVS Comparison/unitTest testChi2GSLComparisonAlgorithm1 Test result: OK testChi2GSLComparisonAlgorithm2 Test result: OK testChi2GSLQualityChecker Test result: OK testChi2GSLTotal1 Test result: OK |
GNU
Scientific Library Reference Manual (2005)
|
To be documented |
UR 1.17 Fast Anderson-Darling (Approximated p-value) |
Binned |
Design | CVS Comparison/src AndersonDarlingBinnedFastComparisonAlgorithm Implemented AndersonDarlingFastQualityChecker Implemented |
CVS Comparison/unitTest testAndersonDarlingBinnedFastComparisonAlgorithm1 Test result: OK testAndersonDarlingFastQualityChecker Test result: OK testAndersonDarlingFastTotal Test result: OK |
C. D.
Sinclair, B. D. Spurr (1988) |
To be documented |
UR 1.18 Fast Anderson-Darling (Approximated p-value) |
Unbinned |
Design | CVS Comparison/src AndersonDarlingUnbinnedFastComparisonAlgorithm Implemented AndersonDarlingFastQualityChecker Implemented |
CVS Comparison/unitTest testAndersonDarlingUnbinnedFastComparisonAlgorithm1 Test result: OK testAndersonDarlingFastQualityChecker Test result: OK testAndersonDarlingUnbinnedFastTotal1 Test result: OK |
C. D.
Sinclair, B. D. Spurr (1988) |
To be documented |
UR 1.19 Girone |
Binned |
Design | CVS Comparison/src GironeComparisonAlgorithm Implemented GironeQualityChecker Implemented |
CVS Comparison/unitTest testGironeComparisonAlgorithm1 Test result: OK testGironeQualityChecker Test result: OK testGironeTotal Test result: OK |
C. D.
Sinclair, B. D. Spurr (1988) |
To be documented |
UR 1.20 Chi-squared for curves |
Curves |
Design | CVS Comparison/src ChisquaredCurvesComparisonAlgorithm Implemented ChisquaredQualityChecker Implemented |
CVS Comparison/unitTest testChi2CurvesComparisonAlgorithm1 Test result: OK testChi2CurvesComparisonAlgorithm2 Test result: OK testChi2CurvesQualityChecker1 Test result: OK testChi2CurvesQualityChecker2 Test result: OK testChisquaredCurvesTotal1 Test result: OK testChisquaredCurvesTotal2 Test result: OK |
K. Pearson (1900) D. Piccolo (book) W. E. Deming (book) |
Statistics
Reference
User Guide |
UR 1.21 Test selection |
Binned Unbinned Curves |
Design | CVS StatisticsTesting/examples exampleChi2 Implemented exampleKS Implemented More examples for other algorithms |
CVS StatisticsTesting/examples exampleChi2 Test result: OK exampleKS Test result: OK More examples for other algorithms |
no reference |
To be documented |
UR 1.22 Test appropriateness |
Binned Unbinned |
Design | CVS Comparison/src DistributionHelper Implemented |
CVS Comparison/unitTest testDistributionHelper Test result: OK |
no reference | To be documented |
Comparing one-dimensional distributions: one-sample problem | ||||||
UR 2.1 Chi-squared |
Binned |
To be
designed |
To be
implemented |
To be
tested |
K. Pearson (1900) D. Piccolo (book) W. E. Deming (book) |
To
be documented |
UR 2.2 Conover (KS discrete) |
Binned |
To be
designed |
To be
implemented |
To be
tested |
W.
J. Conover (1972) A. N. Pettitt, M. A. Stephens (1977) |
To
be documented |
UR 2.3 Anderson-Darling |
Binned |
To be
designed |
To be
implemented |
To be
tested |
T. W. Anderson, D. A. Darling (1954) | To
be documented |
UR 2.4 Cramer-von Mises |
Binned |
To be
designed |
To be
implemented |
To be
tested |
Cramer (1928), von Mises (1931) | To
be documented |
UR 2.5 Tiku (CvM in a chi2 approximation) |
Binned |
To be
designed |
To be
implemented |
To be
tested |
M. L. Tiku (1963) | To
be documented |
UR 2.6 Kolmogorov |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
A. N. Kolmogorov (1933) | To
be documented |
UR 2.7 Weighted Kolmogorov (AD weighting funcion) |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
P. L. Canner (1975) | To
be documented |
UR 2.8 Anderson-Darling |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
T. W. Anderson, D. A. Darling (1954) | To
be documented |
UR 2.9 Cramer-von Mises |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
Cramer (1928), von Mises (1931) | To
be documented |
UR 2.10 Kuiper |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
N. H. Kuiper (1960) | To
be documented |
UR 2.11 Tiku (CvM in a chi2 approximation) |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
M. L. Tiku (1963) | To
be documented |
UR 2.12 Lilliefors |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
H. Lilliefors (1967) | To
be documented |
UR 2.13 Watson |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
G.
S. Watson (1961) |
To
be documented |
UR 2.14 Chi-squared for curves |
Curves |
To be
designed |
To be
implemented |
To be
tested |
K. Pearson (1900) D. Piccolo (book) W. E. Deming (book) |
To
be documented |
UR 2.15 Test selection |
Binned Unbinned Curves |
To be
designed |
To be
implemented |
To be
tested |
no reference | To
be documented |
UR 2.16 Test appropriateness |
Binned Unbinned |
To be
designed |
To be
implemented |
To be
tested |
no reference | To
be documented |
Comparing one-dimensional distributions: k-sample problem | ||||||
UR 3.1 Anderson-Darling |
Binned |
To be
designed |
To be
implemented |
To be
tested |
F. W. Scholz, M. A. Stephens (1987) | To
be documented |
UR 3.2 Anderson-Darling |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
F. W. Scholz, M. A. Stephens (1987) | To
be documented |
UR 3.3 Birnbaum-Hall |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
Z. W. Birnbaum, R. A. Hall (1960) Conover (book) Landenna (book) |
To
be documented |
UR 3.4 Kiefer |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
J. Kiefer (1959) Landenna (book) |
To
be documented |
Comparing two-dimensional distributions: two-sample problem | ||||||
UR 4.1 Chi-squared |
Binned |
To be
designed |
To be
implemented |
To be
tested |
To be found | To
be documented |
UR 4.2 Kolmogorov-Smirnov |
Binned |
To be
designed |
To be
implemented |
To be
tested |
R. H. Smallwood (1996) | To
be documented |
UR 4.3 Kolmogorov-Smirnov |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
S. A.
Metchev, J. E. Grindlay (2002) J. H. Friedman, L. C. Rafsky (1979) A. Justel, D. Pena, R. Zamar (1997) |
To
be documented |
UR 4.4 Anderson-Darling |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
J. R. Picke (2003) | To
be documented |
UR 4.5 Minimum energy test |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
G. Zech, B. Aslan (2003) | To
be documented |
UR 4.6 Discriminant function test |
Binned |
To be
designed |
To be
implemented |
To be
tested |
J. L. Loudin, H. E. Miettinen (2003) | To
be documented |
Comparing two-dimensional distributions: one-sample problem | ||||||
UR 5.1 Chi-squared |
Binned |
To be
designed |
To be
implemented |
To be
tested |
To be found | To
be documented |
UR 5.2 Kolmogorov |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
To be found | To
be documented |
UR 5.3 Anderson-Darling |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
J. R. Pycke (2003)
|
To
be documented |
Comparing multi-dimensional distributions: two-sample problem | ||||||
UR 6.1 Chi-squared |
Binned |
To be
designed |
To be
implemented |
To be
tested |
To be found | To
be documented |
UR 6.2 Kolmogorov-Smirnov |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
A. Justel, D. Pena, R. Zamar (1997) P. J. Bickel (1969) J. H. Friedman, L. C. Rafsky (1979) |
To
be documented |
UR 6.3 Minimum energy test |
Unbinned |
To be
designed |
To be
implemented |
To be
tested |
G. Zech, B. Aslan (2003) | To
be documented |
Converting distributions |
||||||
UR 7.1 | To be
designed |
To be
implemented |
To be tested | To
be found |
To be documented | |
UR 7.2 | To be
designed |
To be
implemented |
To
be
tested |
To be found | To be documented | |
Confidence levels |
||||||
UR 8.1 | To be designed | To be implemented | To
be
tested |
To be found | To be documented | |
UR 8.2 | To be designed | To
be
implemented |
To
be
tested |
To be found | To be documented | |
Handling distributions |
||||||
UR 9.1 | To
be
designed |
To
be
implemented |
To be tested | To be found | To be documented | |
UR 9.2 | To be designed | To
be
implemented |
To
be
tested |
To be found | To be documented | |
UR 9.3 | To
be
designed |
To be implemented | To be tested | To be found | To be documented | |
UR 9.4 | To
be
designed |
To be implemented | To be tested | To be found | To be documented | |
UR 9.5 | To be designed | To be implemented | To
be
tested |
To be found | To be documented | |
UR 9.6 | To be designed | To
be
implemented |
To be tested | To be found | To be documented | |
UR 9.7 | To
be
designed |
To be implemented | To
be
tested |
To be found | To be documented | |
UR 9.8 | To be designed | To be implemented | To
be
tested |
To be found | To be documented | |
UR 9.9 | To be designed | To
be
implemented |
To be tested | To be found | To be documented | |
Treatment of errors |
||||||
UR 10.1 | To be
designed |
To be implemented | To be tested | To be found | To be documented | |
UR 10.2 | To be
designed |
To be implemented | To be tested | To be found | To be documented | |
Plotting |
||||||
UR 11.1 | To be
designed |
To be implemented | To be tested | To be found | To be documented | |
UR 11.2 | To be designed | To be implemented | To be tested | To be found | To be documented | |
UR 11.3 | To be
designed |
To be implemented | To
be
tested |
To be found | To be documented | |
UR 11.4 | To be designed | To be implemented | To be tested | To be found | To be documented |
History |
||
14 Jan 2003 | S.Donadio, B.Mascialino | Created |
13 Apr 2003 | B.Mascialino | Updated Chi2, KSG, KS, CVMB |
28 May 2003 | S.Donadio, B.Mascialino | Updated Chi2-curves, AD ,CVM |
14 March 2004 | S.Donadio, B.Mascialino, P.Viarengo | Updated Tiku algorithm |
22
February 2006 |
B.
Mascialino |
Updated
document |