Statistical Testing User Requirements: Traceability

USER REQUIREMENT TYPE OOAD CODE UNIT TEST
DOCUMENTATION

Comparing one-dimensional distributions: two-sample problem

UR 1.1
Chi-squared
(Gamma function)
Binned
Design

CVS
Comparison/src
ChisquaredIntegratingComparisonAlgorithm
Implemented
ChisquaredIntegratingQualityChecker
Implemented
CVS
Comparison/unitTest
testChi2IntegratingComparisonAlgorithm1
Test result: OK
testChi2IntegratingComparisonAlgorithm2
Test result: OK
testChi2IntegratingQualityChecker
Test result: OK
testChisquaredIntegratingTotal1
Test result: OK
testChisquaredIntegratingTotal2
Test result: OK
Statistics Reference

User Guide

UR 1.2
Anderson-Darling
Binned
Design CVS
Comparison/src
AndersonDarlingBinnedComparisonAlgorithm
Implemented
AndersonDarlingQualityChecker
Implemented
CVS
Comparison/unitTest
testAndersonDarlingBinnedComparisonAlgorithm1
Test result: OK
testAndersonDarlingQualityChecker
Test result: OK
testAndersonDarlingBinnedTotal
Test result: OK
testAndersonDarlingBinnedTotal1
Test result: OK
testAndersonDarlingBinnedTotal2
Test result: OK
testAndersonDarlingBinnedTotal3
Test result: OK
testAndersonDarlingBinnedTotal4
Test result: OK
Statistics Reference

User Guide

UR 1.3
Cramer-von Mises
Binned
Design CVS
Comparison/src
CramerVonMisesBinnedComparisonAlgorithm
Implemented
CramerVonMisesQualityChecker
Implemented
CVS
Comparison/unitTest
testCramerVonMisesBinnedComparisonAlgorithm1
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm2
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm3
Test result: OK
testCramerVonMisesBinnedComparisonAlgorithm4
Test result: OK
testCramerVonMisesQualityChecker
Test result: OK
testCramerVonMisesBinnedTotal
Test result: OK
testCramerVonMisesBinnedTotal1
Test result: OK
Statistics Reference

User Guide

UR 1.4
Tiku
(CvM in a chi2 approximation)

Binned
Design CVS
Comparison/src
TikuBinnedComparisonAlgorithm
Implemented
TikuBinnedQualityChecker
Implemented
CVS
Comparison/unitTest
testTikuBinnedComparisonAlgorithm
Test result: OK
testTikuBinnedComparisonAlgorithm2
Test result: OK
testTikuBinnedQualityChecker
Test result: OK
testTikuBinnedTotal
Test result: OK
Statistics Reference

User Guide

UR 1.5
Goodman
(KS in a chi2 approximation)
Unbinned
Design CVS
Comparison/src
KolmogorovSmirnovApproximatedComparisonAlgorithm
Implemented
KolmogorovSmirnovApproximatedQualityChecker
Implemented
CVS
Comparison/unitTest
testKolmogorovSmirnovApproximatedComparisonAlgorithm1
Test result: OK
testKolmogorovSmirnovApproximatedComparisonAlgorithm2
Test result: OK
testKolmogorovSmirnovApproximatedQualityChecker
Test result: OK
testKolmogorovSmirnovApproximatedTotal
Test result: OK
Statistics Reference

User Guide

UR 1.6
Kolmogorov-Smirnov
Unbinned
Design CVS
Comparison/src
KolmogorovSmirnovComparisonAlgorithm
Implemented
KolmogorovSmirnovQualityChecker

Implemented
CVS
Comparison/unitTest
testKolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testKolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testKolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testKolmogorovSmirnovQualityChecker
Test result: OK
testKolmogorovSmirnovQualityChecker1
Test result: OK
testKolmogorovSmirnovTotal
Test result: OK
testKolmogorovSmirnovTotal2
Test result: OK
testKolmogorovSmirnovTotal3
Test result: OK
testKolmogorovSmirnovTotal4
Test result: OK
Statistics Reference

User Guide

UR 1.7
Weighted KS
(AD weighting function)
Unbinned
Design CVS
Comparison/src
WeightedADKolmogorovSminovComparisonAlgorithm
Implemented
WeightedADKolmogorovSmirnovQualityChecker
Implemented
testWeightedADKolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testWeightedADKolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testWeightedADKolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testWeightedADKolmogorovSmirnovComparisonAlgorithm4
Test result: OK
testWeightedADKolmogorovSmirnovComparisonAlgorithm5
Test result: OK
testWeightedADKolmogorovSmirnovComparisonAlgorithm6
Test result: OK
testWeightedADKolmogorovSmirnovComparisonAlgorithm7
Test result: OK
testWeightedADKolmogorovSmirnovQualityChecker
Test result: OK
testWeightedADKolmogorovSmirnovTotal
Test result: OK
Statistics Reference

User Guide

UR 1.8
Weighted KS
(Buning weighting function)
Unbinned
Design CVS
Comparison/src
WeightedBuningKolmogorovSminovComparisonAlgorithm
Implemented
WeightedBuningKolmogorovSmirnovQualityChecker
Implemented

testWeightedBuningKolmogorovSmirnovComparisonAlgorithm1
Test result: OK
testWeightedBuningKolmogorovSmirnovComparisonAlgorithm2
Test result: OK
testWeightedBuningKolmogorovSmirnovComparisonAlgorithm3
Test result: OK
testWeightedBuningKolmogorovSmirnovComparisonAlgorithm4
Test result: OK
testWeightedBuningKolmogorovSmirnovComparisonAlgorithm5
Test result: OK
testWeightedBuningKolmogorovSmirnovComparisonAlgorithm6
Test result: OK
testWeightedBuningKolmogorovSmirnovComparisonAlgorithm7
Test result: OK
testWeightedBuningKolmogorovSmirnovQualityChecker
Test result: OK
testWeightedBuningKolmogorovSmirnovTotal
Test result: OK
Statistics Reference

User Guide

UR 1.9
Anderson-Darling
Unbinned
Design CVS
Comparison/src
AndersonDarlingUnbinnedComparisonAlgorithm
Implemented
AndersonDarlingQualityChecker
Implemented
CVS
Comparison/unitTest
testAndersonDarlingUnbinnedComparisonAlgorithm1
Test result: OK
testAndersonDarlingQualityChecker
Test result: OK
testAndersonDarlingUnbinnedTotal
Test result: OK
testAndersonDarlingUnbinnedTotal1
Test result: OK
testAndersonDarlingUnbinnedTotal2
Test result: OK
testAndersonDarlingUnbinnedTotal3
Test result: OK
testAndersonDarlingUnbinnedTotal4
Test result: OK
Statistics Reference

User Guide

UR 1.10
Cramer-von Mises
Unbinned
Design CVS
Comparison/src
CramerVonMisesUnbinnedComparisonAlgorithm
Implemented
CramerVonMisesQualityChecker
Implemented
CVS
Comparison/unitTest
testCramerVonMisesUnbinnedComparisonAlgorithm1
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm2
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm3
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm4
Test result: OK
testCramerVonMisesUnbinnedComparisonAlgorithm5
Test result: OK
testCramerVonMisesQualityChecker
Test result: OK
testCramerVonMisesUnbinnedTotal
Test result: OK
testCramerVonMisesUnbinnedTotal1
Test result: OK
testCramerVonMisesUnbinnedTotal2
Test result: OK
testCramerVonMisesUnbinnedTotal3
Test result: OK
Statistics Reference

User Guide

UR 1.11
Weighted CvM
(Buning weighting function)
Unbinned
Design CVS
Comparison/src
WeightedBuningCramerVonMisesComparisonAlgorithm
Implemented
WeightedCramerVonMisesQualityChecker
Implemented
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm1
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm2
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm3
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm4
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm5
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm6
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedComparisonAlgorithm7
Test result: OK
testWeightedCramerVonMisesQualityChecker
Test result: OK
testWeightedBuningCramerVonMisesUnbinnedTotal
Test result: OK
Statistics Reference

User Guide

UR 1.12
Kuiper
Unbinned
Design CVS
Comparison/src
KuiperComparisonAlgorithm
Implemented
KuiperQualityChecker
Implemented
CVS
Comparison/unitTest
testKuiperComparisonAlgorithm
Test result: OK
testKuiperQualityChecker
Test result: OK
testKuiperTotal
Test result: OK
Statistics Reference

User Guide

UR 1.13
Tiku
(CvM in a chi2 approximation)
Unbinned
Design CVS
Comparison/src
TikuUnbinnedComparisonAlgorithm
Implemented
TikuUnbinnedQualityChecker
Implemented
CVS
Comparison/unitTest
testTikuUnbinnedComparisonAlgorithm
Test result: OK
testTikuUnbinnedQualityChecker
Test result: OK
testTikuUnbinnedTotal
Test result: OK
Statistics Reference

User Guide

UR 1.14
Watson
Unbinned
Design CVS
Comparison/src
WatsonComparisonAlgorithm
Implemented
WatsonQualityChecker
Implemented
CVS
Comparison/unitTest
testWatsonComparisonAlgorithm
Test result: OK
testWatsonQualityChecker
Test result: OK
testWatsonTotal
Test result: OK
Statistics Reference

User Guide

UR 1.15
Approximated Chi-squared
(Incomplete gamma function)
Binned
Design CVS
Comparison/src
Chi2ApproximatedComparisonAlgorithm
Implemented
Chi2ApproximatedQualityChecker
Implemented
CVS
Comparison/unitTest

testChi2ApproximatedComparisonAlgorithm1
Test result: OK
testChi2ApproximatedComparisonAlgorithm2
Test result: OK
testChi2ApproximatedQualityChecker
Test result: OK
testChi2ApproximatedTotal1
Test result: OK
Statistics Reference

User Guide

UR 1.16
Chi-squared
(GSL)
Binned Design CVS
Comparison/src
Chi2ComparisonAlgorithm
Implemented
Chi2QualityChecker
Implemented
CVS
Comparison/unitTest

testChi2ComparisonAlgorithm1
Test result: OK
testChi2ComparisonAlgorithm2
Test result: OK
testChi2QualityChecker
Test result: OK
testChi2Total1
Test result: OK
Statistics Reference

User Guide

UR 1.17
Anderson-Darling
(Approximated p-value)
Binned
Design CVS
Comparison/src
AndersonDarlingBinnedApproximatedComparisonAlgorithm
Implemented
AndersonDarlingApproximatedQualityChecker
Implemented
CVS
Comparison/unitTest

testAndersonDarlingBinnedApproximatedComparisonAlgorithm1
Test result: OK
testAndersonDarlingApproximatedQualityChecker
Test result: OK
testAndersonDarlingApproximatedTotal
Test result: OK
Statistics Reference

User Guide

UR 1.18
Anderson-Darling
(Approximated p-value)
Unbinned
Design CVS
Comparison/src
AndersonDarlingUnbinnedApproximatedComparisonAlgorithm
Implemented
AndersonDarlingApproximatedQualityChecker
Implemented
CVS
Comparison/unitTest

testAndersonDarlingUnbinnedApproximatedComparisonAlgorithm1
Test result: OK
testAndersonDarlingApproximatedQualityChecker
Test result: OK
testAndersonDarlingUnbinnedApproximatedTotal1
Test result: OK
Statistics Reference

User Guide

UR 1.19
Girone
Unbinned
Design CVS
Comparison/src
GironeComparisonAlgorithm
Implemented
GironeQualityChecker
Implemented
CVS
Comparison/unitTest

testGironeComparisonAlgorithm1
Test result: OK
testGironeQualityChecker
Test result: OK
testGironeTotal
Test result: OK
Statistics Reference

User Guide

UR 1.20
Test selection
Binned
Unbinned
Curves
Design CVS
StatisticsTesting/examples
exampleChi2
Implemented
exampleKS
Implemented

CVS
StatisticsTesting/examples
exampleChi2
Test result: OK
exampleKS
Test result: OK


UR 1.21
Test appropriateness
Binned
Unbinned
Design CVS
Comparison/src
DistributionHelper
Implemented
CVS
Comparison/unitTest
testDistributionHelper
Test result: OK

History

14 Jan 2003 S.Donadio, B.Mascialino Created
13 Apr 2003 B.Mascialino Updated Chi2, KSG, KS, CVMB
28 May 2003 S.Donadio, B.Mascialino Updated Chi2-curves, AD ,CVM
14 March 2004 S.Donadio, B.Mascialino, P.Viarengo Updated Tiku algorithm
22 February 2006
B. Mascialino
Updated document
10 April 2006
B. Mascialino
Modified names of tests for 2nd release