mxnet.test_utils.verify_generator¶
-
mxnet.test_utils.
verify_generator
(generator, buckets, probs, nsamples=1000000, nrepeat=5, success_rate=0.25, alpha=0.05)[source]¶ Verify whether the generator is correct using chi-square testing.
- The test is repeated for “nrepeat” times and we check if the success rate is
above the threshold (25% by default).
- Parameters
generator (function) –
- A function that is assumed to generate i.i.d samples from a specific distribution.
generator(N) should generate N random samples.
buckets (list of tuple or list of number) –
- The buckets to run the chi-square the test. Make sure that the buckets cover
the whole range of the distribution. Also, the buckets must be in ascending order and have no intersection
probs (list or tuple) – The ground-truth probability of the random value fall in a specific bucket.
nsamples (int) – The number of samples to generate for the testing
nrepeat (int) – The times to repeat the test
success_rate (float) – The desired success rate
alpha (float) – The desired threshold for type-I error i.e. when a true null hypothesis is rejected
- Returns
cs_ret_l – The p values of the chi-square test.
- Return type
list