Statistical Testing User Requirements: Traceability

 

USER REQUIREMENT TYPE OOAD CODE UNIT TEST
REFERENCES DOCUMENTATION

Comparing one-dimensional distributions: two-sample problem

UR 1.1
Chi-squared
(Gamma function)
Binned
Design

CVS
Comparison/src
ChisquaredComparisonAlgorithm
Implemented
ChisquaredQualityChecker
Implemented
CVS
Comparison/unitTest
testChi2ComparisonAlgorithm1
Test result: OK
testChi2ComparisonAlgorithm2
Test result: OK
testChi2QualityChecker
Test result: OK
testChisquaredTotal1
Test result: OK
testChisquaredTotal2
Test result: OK
K. Pearson (1900)
D. Piccolo (book)
W. E. Deming (book)
Statistics Reference

User Guide

UR 1.2
Anderson-Darling
Binned
Design CVS
Comparison/src
AndersonDarlingBinnedComparisonAlgorithm
Implemented
AndersonDarlingQualityChecker
Implemented
CVS
Comparison/unitTest
testAndersonDarlingBinnedComparisonAlgorithm1
Test result: OK
testAndersonDarlingQualityChecker
Test result: OK
testAndersonDarlingBinnedTotal
Test result: OK
testAndersonDarlingBinnedTotal1
Test result: OK
testAndersonDarlingBinnedTotal2
Test result: OK
testAndersonDarlingBinnedTotal3
Test result: OK
testAndersonDarlingBinnedTotal4
Test result: OK
F. W. Scholz, M. A. Stephens (1987) Statistics Reference

User Guide

UR 1.3
Cramer-von Mises
Binned
Design CVS
Comparison/src
CramerVonMisesBinnedComparisonAlgorithm
Implemented
CramerVonMisesQualityChecker
Implemented
CVS
Comparison/unitTest
testCramerVonMisesBinnedComparisonAlgorithm1
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm2
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm3
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm4
Test result: OK
testCramerVonMisesQualityChecker
Test result: OK
testCramerVonMisesBinnedTotal
Test result: OK
testCramerVonMisesBinnedTotal1
Test result: OK
M. Fisz (1960)
Conover (book)
Statistics Reference

User Guide

UR 1.4
Tiku
(CvM in a chi2 approximation)

Binned
Design CVS
Comparison/src
TikuBinnedComparisonAlgorithm
Implemented
TikuBinnedQualityChecker
Implemented
CVS
Comparison/unitTest
testTikuBinnedComparisonAlgorithm
Test result: OK
testTikuBinnedComparisonAlgorithm2
Test result: OK
testTikuBinnedQualityChecker
Test result: OK
testTikuBinnedTotal
Test result: OK
M. L. Tiku (1963) Statistics Reference

User Guide

UR 1.5
Goodman
(KS in a chi2 approximation)
Unbinned
Design CVS
Comparison/src
KolmogorovSmirnovApproxComparisonAlgorithm
Implemented
KolmogorovSmirnovApproxQualityChecker
Implemented
CVS
Comparison/unitTest
testKolmogorovSmirnovApproxComparisonAlgorithm1
Test result: OK
testKolmogorovSmirnovApproxComparisonAlgorithm2
Test result: OK
testKolmogorovSmirnovApproxQualityChecker
Test result: OK
testKolmogorovSmirnovApproxTotal
Test result: OK
L. A. Goodman (1954)
S. Siegel (book)
Statistics Reference

User Guide

UR 1.6
Kolmogorov-Smirnov
Unbinned
Design CVS
Comparison/src
KolmogorovSmirnovComparisonAlgorithm
Implemented
KolmogorovSmirnovQualityChecker

Implemented
CVS
Comparison/unitTest
testKolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testKolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testKolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testKolmogorovSmirnovQualityChecker
Test result: OK
testKolmogorovSmirnovQualityChecker1
Test result: OK
testKolmogorovSmirnovTotal
Test result: OK
testKolmogorovSmirnovTotal2
Test result: OK
testKolmogorovSmirnovTotal3
Test result: OK
testKolmogorovSmirnovTotal4
Test result: OK
N. V. Smirnov (1939)
N. V. Smirnov (1948)
Statistics Reference

User Guide

UR 1.7
Weighted KS
(AD weighting function)
Unbinned
Design CVS
Comparison/src
Weighted2KolmogorovSminovComparisonAlgorithm
Implemented
Weighted2KolmogorovSmirnovQualityChecker
Implemented
testWeighted2KolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm4
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm5
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm6
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm7
Test result: OK
testWeighted2KolmogorovSmirnovQualityChecker
Test result: OK
testWeighted2KolmogorovSmirnovTotal
Test result: OK
H. Buning (2001)
P. L. Canner (1975)
To be documented
UR 1.8
Weighted KS
(Buning weighting function)
Unbinned
Design CVS
Comparison/src
Weighted1KolmogorovSminovComparisonAlgorithm
Implemented
Weighted1KolmogorovSmirnovQualityChecker
Implemented

testWeighted1KolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm4
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm5
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm6
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm7
Test result: OK
testWeighted1KolmogorovSmirnovQualityChecker
Test result: OK
testWeighted1KolmogorovSmirnovTotal
Test result: OK
H. Buning (2001) To be documented
UR 1.9
Anderson-Darling
Unbinned
Design CVS
Comparison/src
AndersonDarlingUnbinnedComparisonAlgorithm
Implemented
AndersonDarlingQualityChecker
Implemented 
CVS
Comparison/unitTest
testAndersonDarlingUnbinnedComparisonAlgorithm1
Test result: OK
testAndersonDarlingQualityChecker
Test result: OK
testAndersonDarlingUnbinnedTotal
Test result: OK
testAndersonDarlingUnbinnedTotal1
Test result: OK
testAndersonDarlingUnbinnedTotal2
Test result: OK
testAndersonDarlingUnbinnedTotal3
Test result: OK
testAndersonDarlingUnbinnedTotal4
Test result: OK
F. W. Scholz, M. A. Stephens (1987) Statistics Reference

User Guide

UR 1.10
Cramer-von Mises
Unbinned
Design CVS
Comparison/src
CramerVonMisesUnbinnedComparisonAlgorithm
Implemented
CramerVonMisesQualityChecker
Implemented
CVS
Comparison/unitTest
testCramerVonMisesUnbinnedComparisonAlgorithm1
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm2
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm3
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm4
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm5
Test result: OK
testCramerVonMisesQualityChecker
Test result: OK
testCramerVonMisesUnbinnedTotal
Test result: OK
testCramerVonMisesUnbinnedTotal1
Test result: OK
testCramerVonMisesUnbinnedTotal2
Test result: OK
testCramerVonMisesUnbinnedTotal3
Test result: OK
M. Fisz (1960) Statistics Reference

User Guide

UR 1.11
Weighted CvM
(Buning weighting function)
Unbinned
Design CVS
Comparison/src
WeightedCramerVonMisesComparisonAlgorithm
Implemented
WeightedCramerVonMisesQualityChecker
Implemented
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm1
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm2
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm3
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm4
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm5
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm6
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm7
Test result: OK
testWeightedCramerVonMisesQualityChecker
Test result: OK
testWeightedCramerVonMisesUnbinnedTotal
Test result: OK
H. Buning (2001) To be documented
UR 1.12
Kuiper
Unbinned
Design CVS
Comparison/src
KuiperComparisonAlgorithm
Implemented
KuiperQualityChecker
Implemented
CVS
Comparison/unitTest
testKuiperComparisonAlgorithm
Test result: OK
testKuiperQualityChecker
Test result: OK
testKuiperTotal
Test result: OK
N. H. Kuiper (1960)
E. Batschelet (book)
Statistics Reference

User Guide

UR 1.13
Tiku
(CvM in a chi2 approximation)
Unbinned
Design CVS
Comparison/src
TikuUnbinnedComparisonAlgorithm
Implemented
TikuUnbinnedQualityChecker
Implemented
CVS
Comparison/unitTest
testTikuUnbinnedComparisonAlgorithm
Test result: OK
testTikuUnbinnedQualityChecker
Test result: OK
testTikuUnbinnedTotal
Test result: OK
M. L. Tiku (1963) Statistics Reference

User Guide

UR 1.14
Watson
Unbinned
Design CVS
Comparison/src
WatsonComparisonAlgorithm
Implemented
WatsonQualityChecker
Implemented
CVS
Comparison/unitTest
testWatsonComparisonAlgorithm
Test result: OK
testWatsonQualityChecker
Test result: OK
testWatsonTotal
Test result: OK
G. S. Watson (1961)
E. Batschelet (book)
To be documented
UR 1.15
Fast Chi-squared
(Incomplete gamma function)
Binned
Design CVS
Comparison/src
Chi2FastComparisonAlgorithm

Implemented
Chi2FastQualityChecker
Implemented
CVS
Comparison/unitTest

testChi2FastComparisonAlgorithm1
Test result: OK
testChi2FastComparisonAlgorithm2
Test result: OK
testChi2FastQualityChecker
Test result: OK
testChi2FastTotal1
Test result: OK
E. W. Weisstein (1999)
To be documented
UR 1.16
 GSL Chi-squared
Binned Design CVS
Comparison/src
Chi2GSLComparisonAlgorithm

Implemented
Chi2GSLQualityChecker
Implemented
CVS
Comparison/unitTest

testChi2GSLComparisonAlgorithm1
Test result: OK
testChi2GSLComparisonAlgorithm2
Test result: OK
testChi2GSLQualityChecker
Test result: OK
testChi2GSLTotal1
Test result: OK

GNU Scientific Library Reference Manual (2005)

To be documented
UR 1.17
Fast Anderson-Darling
(Approximated p-value)
Binned
Design CVS
Comparison/src
AndersonDarlingBinnedFastComparisonAlgorithm
Implemented
AndersonDarlingFastQualityChecker
Implemented
CVS
Comparison/unitTest

testAndersonDarlingBinnedFastComparisonAlgorithm1
Test result: OK
testAndersonDarlingFastQualityChecker
Test result: OK
testAndersonDarlingFastTotal
Test result: OK
C. D. Sinclair, B. D. Spurr (1988)
To be documented
UR 1.18
Fast Anderson-Darling
(Approximated p-value)
Unbinned
Design CVS
Comparison/src
AndersonDarlingUnbinnedFastComparisonAlgorithm
Implemented
AndersonDarlingFastQualityChecker

Implemented
CVS
Comparison/unitTest

testAndersonDarlingUnbinnedFastComparisonAlgorithm1
Test result: OK
testAndersonDarlingFastQualityChecker
Test result: OK
testAndersonDarlingUnbinnedFastTotal1
Test result: OK
C. D. Sinclair, B. D. Spurr (1988)
To be documented
UR 1.19
Girone
Binned
Design CVS
Comparison/src
GironeComparisonAlgorithm
Implemented
GironeQualityChecker
Implemented
CVS
Comparison/unitTest
testGironeComparisonAlgorithm1
Test result: OK
testGironeQualityChecker
Test result: OK
testGironeTotal
Test result: OK
C. D. Sinclair, B. D. Spurr (1988)
To be documented
UR 1.20
Chi-squared for curves
Curves
Design CVS
Comparison/src
ChisquaredCurvesComparisonAlgorithm
Implemented
ChisquaredQualityChecker
Implemented
CVS
Comparison/unitTest
testChi2CurvesComparisonAlgorithm1
Test result: OK
testChi2CurvesComparisonAlgorithm2
Test result: OK
testChi2CurvesQualityChecker1
Test result: OK
testChi2CurvesQualityChecker2
Test result: OK
testChisquaredCurvesTotal1
Test result: OK
testChisquaredCurvesTotal2
Test result: OK
K. Pearson (1900)
D. Piccolo (book)
W. E. Deming (book)
Statistics Reference

User Guide

UR 1.21
Test selection
Binned
Unbinned
Curves
Design CVS
StatisticsTesting/examples
exampleChi2
Implemented
exampleKS
Implemented
More examples for other algorithms
CVS
StatisticsTesting/examples
exampleChi2
Test result: OK
exampleKS
Test result: OK
More examples for other algorithms
no reference
To be documented
UR 1.22
Test  appropriateness
Binned
Unbinned
Design CVS
Comparison/src
DistributionHelper
Implemented
CVS
Comparison/unitTest
testDistributionHelper
Test result: OK
no reference To be documented
Comparing one-dimensional distributions: one-sample problem
UR 2.1
Chi-squared
Binned
To be designed
To be implemented
To be tested
K. Pearson (1900)
D. Piccolo (book)
W. E. Deming (book)
To be documented
UR 2.2
Conover
(KS discrete)
Binned
To be designed
To be implemented
To be tested
W. J. Conover (1972)
A. N. Pettitt, M. A. Stephens (1977)
To be documented
UR 2.3
Anderson-Darling
Binned
To be designed
To be implemented
To be tested
T. W. Anderson, D. A. Darling (1954) To be documented
UR 2.4
Cramer-von Mises
Binned
To be designed
To be implemented
To be tested
Cramer (1928), von Mises (1931) To be documented
UR 2.5
Tiku
(CvM in a chi2 approximation)
Binned
To be designed
To be implemented
To be tested
M. L. Tiku (1963) To be documented
UR 2.6
Kolmogorov
Unbinned
To be designed
To be implemented
To be tested
A. N. Kolmogorov (1933) To be documented
UR 2.7
Weighted Kolmogorov
(AD weighting funcion)
Unbinned
To be designed
To be implemented
To be tested
P. L. Canner (1975) To be documented
UR 2.8
Anderson-Darling
Unbinned
To be designed
To be implemented
To be tested
T. W. Anderson, D. A. Darling (1954) To be documented
UR 2.9
Cramer-von Mises
Unbinned
To be designed
To be implemented
To be tested
Cramer (1928), von Mises (1931) To be documented
UR 2.10
Kuiper
Unbinned
To be designed
To be implemented
To be tested
N. H. Kuiper (1960) To be documented
UR 2.11
Tiku
(CvM in a chi2 approximation)
Unbinned
To be designed
To be implemented
To be tested
M. L. Tiku (1963) To be documented
UR 2.12
Lilliefors
Unbinned
To be designed
To be implemented
To be tested
H. Lilliefors (1967) To be documented
UR 2.13
Watson
Unbinned
To be designed
To be implemented
To be tested
G. S. Watson (1961)
To be documented
UR 2.14
Chi-squared for curves
Curves
To be designed
To be implemented
To be tested
K. Pearson (1900)
D. Piccolo (book)
W. E. Deming (book)
To be documented
UR 2.15
Test selection
Binned
Unbinned
Curves
To be designed
To be implemented
To be tested
no reference To be documented
UR 2.16
Test appropriateness
Binned
Unbinned
To be designed
To be implemented
To be tested
no reference To be documented
Comparing one-dimensional distributions: k-sample problem
UR 3.1
Anderson-Darling
Binned
To be designed
To be implemented
To be tested
F. W. Scholz, M. A. Stephens (1987) To be documented
UR 3.2
Anderson-Darling
Unbinned
To be designed
To be implemented
To be tested
F. W. Scholz, M. A. Stephens (1987) To be documented
UR 3.3
Birnbaum-Hall
Unbinned
To be designed
To be implemented
To be tested
Z. W. Birnbaum, R. A. Hall (1960)
Conover (book)
Landenna (book)
To be documented
UR 3.4
Kiefer
Unbinned
To be designed
To be implemented
To be tested
J. Kiefer (1959)
Landenna (book)
To be documented
Comparing two-dimensional distributions: two-sample problem
UR 4.1
Chi-squared
Binned
To be designed
To be implemented
To be tested
To be found To be documented
UR 4.2
Kolmogorov-Smirnov
Binned
To be designed
To be implemented
To be tested
R. H. Smallwood (1996) To be documented
UR 4.3
Kolmogorov-Smirnov
Unbinned
To be designed
To be implemented
To be tested
S. A. Metchev, J. E. Grindlay (2002)
J. H. Friedman, L. C. Rafsky (1979)
A. Justel, D. Pena, R. Zamar (1997)
To be documented
UR 4.4
Anderson-Darling
Unbinned
To be designed
To be implemented
To be tested
J. R. Picke (2003) To be documented
UR 4.5
Minimum energy test
Unbinned
To be designed
To be implemented
To be tested
G. Zech, B. Aslan (2003) To be documented
UR 4.6
Discriminant function test
Binned
To be designed
To be implemented
To be tested
J. L. Loudin, H. E. Miettinen (2003) To be documented
Comparing two-dimensional distributions: one-sample problem
UR 5.1
Chi-squared
Binned
To be designed
To be implemented
To be tested
To be found To be documented
UR 5.2
Kolmogorov
Unbinned
To be designed
To be implemented
To be tested
To be found To be documented
UR 5.3
Anderson-Darling
Unbinned
To be designed
To be implemented
To be tested
J. R. Pycke (2003)
To be documented
Comparing multi-dimensional distributions: two-sample problem
UR 6.1
Chi-squared
Binned
To be designed
To be implemented
To be tested
To be found To be documented
UR 6.2
Kolmogorov-Smirnov
Unbinned
To be designed
To be implemented
To be tested
A. Justel, D. Pena, R. Zamar (1997)
 P. J. Bickel (1969)
 J. H. Friedman, L. C. Rafsky (1979)
To be documented
UR 6.3
Minimum energy test
Unbinned
To be designed
To be implemented
To be tested
G. Zech, B. Aslan (2003) To be documented

Converting distributions

UR 7.1
To be designed
To be implemented
To be tested To be found
To be documented
UR 7.2
To be designed
To be implemented
To be tested
To be found To be documented

Confidence levels

UR 8.1
 To be designed  To be implemented To be tested
To be found To be documented
UR 8.2
 To be designed To be implemented
To be tested
To be found To be documented

Handling distributions

UR 9.1
To be designed
To be implemented
 To be tested To be found To be documented
UR 9.2
 To be designed To be implemented
To be tested
To be found To be documented
UR 9.3
To be designed
 To be implemented  To be tested To be found To be documented
UR 9.4
To be designed
 To be implemented  To be tested To be found To be documented
UR 9.5
 To be designed  To be implemented To be tested
To be found To be documented
UR 9.6
 To be designed To be implemented
 To be tested To be found To be documented
UR 9.7
To be designed
 To be implemented To be tested
To be found To be documented
UR 9.8
 To be designed  To be implemented To be tested
To be found To be documented
UR 9.9
 To be designed To be implemented
 To be tested To be found To be documented

Treatment of errors

UR 10.1
To be designed
 To be implemented To be tested To be found To be documented
UR 10.2
To be designed
 To be implemented  To be tested To be found To be documented

Plotting

UR 11.1
To be designed
 To be implemented To be tested To be found To be documented
UR 11.2
 To be designed  To be implemented  To be tested To be found To be documented
UR 11.3
To be designed
 To be implemented To be tested
To be found To be documented
UR 11.4
 To be designed To be implemented  To be tested To be found To be documented

 

History

14 Jan 2003 S.Donadio, B.Mascialino Created
13 Apr 2003 B.Mascialino Updated Chi2, KSG, KS, CVMB
28 May 2003 S.Donadio, B.Mascialino Updated Chi2-curves, AD ,CVM
14 March 2004 S.Donadio, B.Mascialino, P.Viarengo Updated Tiku algorithm
22 February 2006
B. Mascialino
Updated document