Statistical Testing User Requirements: Traceability

 

USER REQUIREMENT TYPE OOAD CODE UNIT TEST
REFERENCES DOCUMENTATION

Comparing one-dimensional distributions: two-sample problem

UR 1.1
Chi-squared
(Gamma function)
Binned
Design

CVS
Comparison/src
ChisquaredComparisonAlgorithm
Implemented
ChisquaredQualityChecker
Implemented
CVS
Comparison/unitTest
testChi2ComparisonAlgorithm1
Test result: OK
testChi2ComparisonAlgorithm2
Test result: OK
testChi2QualityChecker
Test result: OK
testChisquaredTotal1
Test result: OK
testChisquaredTotal2
Test result: OK
K. Pearson (1900)
D. Piccolo (book)
W. E. Deming (book)
Statistics Reference

User Guide

UR 1.2
Anderson-Darling
Binned
Design CVS
Comparison/src
AndersonDarlingBinnedComparisonAlgorithm
Implemented
AndersonDarlingQualityChecker
Implemented
CVS
Comparison/unitTest
testAndersonDarlingBinnedComparisonAlgorithm1
Test result: OK
testAndersonDarlingQualityChecker
Test result: OK
testAndersonDarlingBinnedTotal
Test result: OK
testAndersonDarlingBinnedTotal1
Test result: OK
testAndersonDarlingBinnedTotal2
Test result: OK
testAndersonDarlingBinnedTotal3
Test result: OK
testAndersonDarlingBinnedTotal4
Test result: OK
F. W. Scholz, M. A. Stephens (1987) Statistics Reference

User Guide

UR 1.3
Cramer-von Mises
Binned
Design CVS
Comparison/src
CramerVonMisesBinnedComparisonAlgorithm
Implemented
CramerVonMisesQualityChecker
Implemented
CVS
Comparison/unitTest
testCramerVonMisesBinnedComparisonAlgorithm1
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm2
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm3
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm4
Test result: OK
testCramerVonMisesQualityChecker
Test result: OK
testCramerVonMisesBinnedTotal
Test result: OK
testCramerVonMisesBinnedTotal1
Test result: OK
M. Fisz (1960)
Conover (book)
Statistics Reference

User Guide

UR 1.4
Tiku
(CvM in a chi2 approximation)

Binned
Design CVS
Comparison/src
TikuBinnedComparisonAlgorithm
Implemented
TikuBinnedQualityChecker
Implemented
CVS
Comparison/unitTest
testTikuBinnedComparisonAlgorithm
Test result: OK
testTikuBinnedComparisonAlgorithm2
Test result: OK
testTikuBinnedQualityChecker
Test result: OK
testTikuBinnedTotal
Test result: OK
M. L. Tiku (1963) Statistics Reference

User Guide

UR 1.5
Goodman
(KS in a chi2 approximation)
Unbinned
Design CVS
Comparison/src
KolmogorovSmirnovApproxComparisonAlgorithm
Implemented
KolmogorovSmirnovApproxQualityChecker
Implemented
CVS
Comparison/unitTest
testKolmogorovSmirnovApproxComparisonAlgorithm1
Test result: OK
testKolmogorovSmirnovApproxComparisonAlgorithm2
Test result: OK
testKolmogorovSmirnovApproxQualityChecker
Test result: OK
testKolmogorovSmirnovApproxTotal
Test result: OK
L. A. Goodman (1954)
S. Siegel (book)
Statistics Reference

User Guide

UR 1.6
Kolmogorov-Smirnov
Unbinned
Design CVS
Comparison/src
KolmogorovSmirnovComparisonAlgorithm
Implemented
KolmogorovSmirnovQualityChecker

Implemented
CVS
Comparison/unitTest
testKolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testKolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testKolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testKolmogorovSmirnovQualityChecker
Test result: OK
testKolmogorovSmirnovQualityChecker1
Test result: OK
testKolmogorovSmirnovTotal
Test result: OK
testKolmogorovSmirnovTotal2
Test result: OK
testKolmogorovSmirnovTotal3
Test result: OK
testKolmogorovSmirnovTotal4
Test result: OK
N. V. Smirnov (1939)
N. V. Smirnov (1948)
Statistics Reference

User Guide

UR 1.7
Weighted KS
(AD weighting function)
Unbinned
Design CVS
Comparison/src
Weighted2KolmogorovSminovComparisonAlgorithm
Implemented
Weighted2KolmogorovSmirnovQualityChecker
Implemented
testWeighted2KolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm4
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm5
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm6
Test result: OK
testWeighted2KolmogorovSmirnovComparisonAlgorithm7
Test result: OK
testWeighted2KolmogorovSmirnovQualityChecker
Test result: OK
testWeighted2KolmogorovSmirnovTotal
Test result: OK
H. Buning (2001)
P. L. Canner (1975)
To be documented
UR 1.8
Weighted KS
(Buning weighting function)
Unbinned
Design CVS
Comparison/src
Weighted1KolmogorovSminovComparisonAlgorithm
Implemented
Weighted1KolmogorovSmirnovQualityChecker
Implemented

testWeighted1KolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm4
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm5
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm6
Test result: OK
testWeighted1KolmogorovSmirnovComparisonAlgorithm7
Test result: OK
testWeighted1KolmogorovSmirnovQualityChecker
Test result: OK
testWeighted1KolmogorovSmirnovTotal
Test result: OK
H. Buning (2001) To be documented
UR 1.9
Anderson-Darling
Unbinned
Design CVS
Comparison/src
AndersonDarlingUnbinnedComparisonAlgorithm
Implemented
AndersonDarlingQualityChecker
Implemented 
CVS
Comparison/unitTest
testAndersonDarlingUnbinnedComparisonAlgorithm1
Test result: OK
testAndersonDarlingQualityChecker
Test result: OK
testAndersonDarlingUnbinnedTotal
Test result: OK
testAndersonDarlingUnbinnedTotal1
Test result: OK
testAndersonDarlingUnbinnedTotal2
Test result: OK
testAndersonDarlingUnbinnedTotal3
Test result: OK
testAndersonDarlingUnbinnedTotal4
Test result: OK
F. W. Scholz, M. A. Stephens (1987) Statistics Reference

User Guide

UR 1.10
Cramer-von Mises
Unbinned
Design CVS
Comparison/src
CramerVonMisesUnbinnedComparisonAlgorithm
Implemented
CramerVonMisesQualityChecker
Implemented
CVS
Comparison/unitTest
testCramerVonMisesUnbinnedComparisonAlgorithm1
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm2
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm3
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm4
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm5
Test result: OK
testCramerVonMisesQualityChecker
Test result: OK
testCramerVonMisesUnbinnedTotal
Test result: OK
testCramerVonMisesUnbinnedTotal1
Test result: OK
testCramerVonMisesUnbinnedTotal2
Test result: OK
testCramerVonMisesUnbinnedTotal3
Test result: OK
M. Fisz (1960) Statistics Reference

User Guide

UR 1.11
Weighted CvM
(Buning weighting function)
Unbinned
Design CVS
Comparison/src
WeightedCramerVonMisesComparisonAlgorithm
Implemented
WeightedCramerVonMisesQualityChecker
Implemented
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm1
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm2
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm3
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm4
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm5
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm6
Test result: OK
testWeightedCramerVonMisesUnbinnedComparisonAlgorithm7
Test result: OK
testWeightedCramerVonMisesQualityChecker
Test result: OK
testWeightedCramerVonMisesUnbinnedTotal
Test result: OK
H. Buning (2001) To be documented
UR 1.12
Kuiper
Unbinned
Design CVS
Comparison/src
KuiperComparisonAlgorithm
Implemented
KuiperQualityChecker
Implemented
CVS
Comparison/unitTest
testKuiperComparisonAlgorithm
Test result: OK
testKuiperQualityChecker
Test result: OK
testKuiperTotal
Test result: OK
N. H. Kuiper (1960)
E. Batschelet (book)
Statistics Reference

User Guide

UR 1.13
Tiku
(CvM in a chi2 approximation)
Unbinned
Design CVS
Comparison/src
TikuUnbinnedComparisonAlgorithm
Implemented
TikuUnbinnedQualityChecker
Implemented
CVS
Comparison/unitTest
testTikuUnbinnedComparisonAlgorithm
Test result: OK
testTikuUnbinnedQualityChecker
Test result: OK
testTikuUnbinnedTotal
Test result: OK
M. L. Tiku (1963) Statistics Reference

User Guide

UR 1.14
Watson
Unbinned
Design CVS
Comparison/src
WatsonComparisonAlgorithm
Implemented
WatsonQualityChecker
Implemented
CVS
Comparison/unitTest
testWatsonComparisonAlgorithm
Test result: OK
testWatsonQualityChecker
Test result: OK
testWatsonTotal
Test result: OK
G. S. Watson (1961)
E. Batschelet (book)
To be documented
UR 1.15
Fast Chi-squared
(Incomplete gamma function)
Binned
Design CVS
Comparison/src
Chi2FastComparisonAlgorithm
Implemented
Chi2FastQualityChecker
Implemented
CVS
Comparison/unitTest

testChi2FastComparisonAlgorithm1
Test result: OK
testChi2FastComparisonAlgorithm2
Test result: OK
testChi2FastQualityChecker
Test result: OK
testChi2FastTotal1
Test result: OK
E. W. Weisstein (1999) To be documented
UR 1.16
GSL Chi-squared

Binned Design CVS
Comparison/src
Chi2GSLComparisonAlgorithm
Implemented
Chi2GSLQualityChecker
Implemented
CVS
Comparison/unitTest

testChi2GSLComparisonAlgorithm1
Test result: OK
testChi2GSLComparisonAlgorithm2
Test result: OK
testChi2GSLQualityChecker
Test result: OK
testChi2GSLTotal1
Test result: OK

GNU Scientific Library Reference Manual (2005)

To be documented
UR 1.17
Fast Anderson-Darling
(Approximated p-value)
Binned
Design CVS
Comparison/src
AndersonDarlingBinnedFastComparisonAlgorithm
Implemented
AndersonDarlingFastQualityChecker
Implemented
CVS
Comparison/unitTest

testAndersonDarlingBinnedFastComparisonAlgorithm1
Test result: OK
testAndersonDarlingFastQualityChecker
Test result: OK
testAndersonDarlingFastTotal
Test result: OK
C. D. Sinclair, B. D. Spurr (1988)
To be documented
UR 1.18
Fast Anderson-Darling
(Approximated p-value)
Unbinned
Design CVS
Comparison/src
AndersonDarlingUnbinnedFastComparisonAlgorithm
Implemented
AndersonDarlingFastQualityChecker
Implemented
CVS
Comparison/unitTest

testAndersonDarlingUnbinnedFastComparisonAlgorithm1
Test result: OK
testAndersonDarlingFastQualityChecker
Test result: OK
testAndersonDarlingUnbinnedFastTotal1
Test result: OK
C. D. Sinclair, B. D. Spurr (1988)
To be documented
UR 1.19
Girone
Binned
Design CVS
Comparison/src
GironeComparisonAlgorithm
Implemented
GironeQualityChecker
Implemented
CVS
Comparison/unitTest

testGironeComparisonAlgorithm1
Test result: OK
testGironeQualityChecker
Test result: OK
testGironeTotal
Test result: OK
C. D. Sinclair, B. D. Spurr (1988)
To be documented
UR 1.20
Chi-squared for curves
Curves
Design CVS
Comparison/src
ChisquaredCurvesComparisonAlgorithm
Implemented
ChisquaredQualityChecker
Implemented
CVS
Comparison/unitTest
testChi2CurvesComparisonAlgorithm1
Test result: OK
testChi2CurvesComparisonAlgorithm2
Test result: OK
testChi2CurvesQualityChecker1
Test result: OK
testChi2CurvesQualityChecker2
Test result: OK
testChisquaredCurvesTotal1
Test result: OK
testChisquaredCurvesTotal2
Test result: OK
K. Pearson (1900)
D. Piccolo (book)
W. E. Deming (book)
Statistics Reference

User Guide

UR 1.21
Test selection
Binned
Unbinned
Curves
Design CVS
StatisticsTesting/examples
exampleChi2
Implemented
exampleKS
Implemented
More examples for other algorithms
CVS
StatisticsTesting/examples
exampleChi2
Test result: OK
exampleKS
Test result: OK
More examples for other algorithms
no reference
To be documented
UR 1.22
Test  appropriateness
Binned
Unbinned
Design CVS
Comparison/src
DistributionHelper
Implemented
CVS
Comparison/unitTest
testDistributionHelper
Test result: OK
no reference To be documented

 

History

14 Jan 2003 S.Donadio, B.Mascialino Created
13 Apr 2003 B.Mascialino Updated Chi2, KSG, KS, CVMB
28 May 2003 S.Donadio, B.Mascialino Updated Chi2-curves, AD ,CVM
14 March 2004 S.Donadio, B.Mascialino, P.Viarengo Updated Tiku algorithm
22 February 2006
B. Mascialino
Updated document