ESTIMATION OF THE FROCINI CRITERIA AND OMEGA SQUARE CRITERIA STATISTICS BY THE STATISTICAL TESTS METHOD FOR A MIXTURE OF NORMAL DISTRIBUTIONS

Толық мәтін

Introduction. One of the tasks of the initial processing of experimental observations is the choice of Подпись: k k f (x, a, m) = åm j × f j (x, aj ), åm j = 1, the distribution law, which adequately describes the j =1 j =1 random variable for the observed sample. A great number of sets of subjects and objects in biology, industry, management can be divided into a number of classes, each of which corresponds to a specific component of the distribution mix. In biological populations, it is possible to distinguish objects with average values of indicators, objects - indicators which are higher than average (“lead- ers”) and objects - indicators that are lower than average (“outsiders”) [1]. The dynamics of mass transfer processes of chemical technology depends on the size distribution of the raw materials, which is also determined by a mixture of distributions [2-4]. When analyzing a mixture of distributions, it is necessary to estimate its parameters (task 1) and to evaluate the compliance of empirical and theoretical distribution functions (task 2). To solve the first problem, usually numerical algorithms are used that implement the method of moments [5] and the maximum likelihood method [6-8]. The peculiarity of this problem solution by the maximum likelihood method for a mixture of distributions is the presence of several local extrema. In this paper, the problem of estimating the distribution parameters is solved by minimizing the agreement criterion by Quasi- Newton methods in MathCad [9] and MATLAB [10] environments. n The second problem is solved by comparing the empirical and theoretical distribution functions by one or several statistical criteria of agreement [5; 11]. Statistics of the distribution of these criteria depends on the sample size, the method of forming data and estimating distribution parameters [12]. The paper examines the criteria of consent Frocini [13; 14] where x - random value; а, m- distribution parameters; mj - the proportion of the j-th component in the mixture. For a mixture of normal distributions, the probability density of the j-th component is determined by the expression j ,0 1 æ 1 æ x - a ö2 ö ç 2 è a j ,1 ø ÷ f j (x, aj ) = × expç - ç ÷ ÷ , è ø where aj,0, aj,1 - estimates of expected value and standard deviation. The computer approach developed in the works of B. Yu. Lemeshko makes it possible to evaluate the statistics of the compliance criteria when testing various complex hypotheses [10; 16]. When conducting statistical tests, it is necessary to take into account the repetition period of the generated pseudo-random numbers. In the MathCad system, this period for a generator of normally distributed random variables is 784.4·106 [17]. For sample size n = 1000, this allows to conduct 7 · 105 statistical tests. At the level of significance α Î [0.001; 0.999], the maximum error in estimating the statistics of the criteria under consideration does not exceed 0.0005 [14]. Results of computational experiments. The paper discusses the application of the Frocini criteria [18] and omega-square in estimating the distribution parameters for the analyzed sample by minimizing the calculated value of the corresponding criterion. In each computational experiment for evaluating the statistics of the compliance criteria, 50000 statistical tests were conducted. Fr( Xv, a) = 1 × å F ( Xv , a) - i - 0.5 , Подпись: i In fig. 1 the experimental errors in determining the i=1 n and omega square (Kramer - Mises - Smirnov) [15; 16] hydrodynamic quality of the whip beams with a limited buoyancy margin are shown [19] (sample size n = 240), in fig. 2 distribution functions that approximate the 12n ç i KMC(Xv, a) = 1 + ån æ F ( Xv , a) i - 0.5 ö2 n ÷ , empirical data with a mixture of two normal distributions are presented; in tab. 1, estimates of distribution i=1 è ø where Xv - variational series of random variable Х; n - sample size; i - number of the element of the variation series; а - distribution parameters; F(Xvi, a) - the value of the integral distribution function for the element of a variational series Xvi. The probability density function for a mixture of distributions consisting of K components has the form: parameters obtained by minimizing the Frocini criterion and omega-square are presented. The maximum deviation between the integral func- tions of the mixture of distributions, the parameters of which are obtained by minimizing the Frocini criteria and the omega-square is 0.001 for x = -0.13, and between the probability density functions is 0.0078 for x = 0.10. Fig. 1. Experimental errors in determining the hydrodynamic quality of whip beams with a limited buoyancy margin [19] Рис. 1. Ошибки экспериментов при определении гидродинамического качества хлыстовых пучков с ограниченным запасом плавучести [19] Fig. 2. Empirical and theoretical function of normal distributions mixture Рис. 2. Эмпирическая и теоретическая функции смеси нормальных распределений Table 1 The optimal values of the parameters of the mixture of distributions and their estimates obtained by statistical testing (M = 5000, n = 240) by minimizing the Frocini criterion and omega-square Parameter Optimal value Expected value Median Borders of 95 % Confidence Interval lower upper a1.0 * ** -0.574 -0.576 -0.569 -0.574 -0.575 -0.580 -0.672 -0.671 -0.437 -0.450 a 2 1.1 * ** 0.0566 0.0549 0.0588 0.0545 0.0556 0.0510 0.0279 0.0249 0.112 0.105 a2.0 * ** 0.322 0.318 0.318 0.317 0.320 0.318 0.198 0.199 0.438 0.434 a 2 2.1 * ** 0.104 0.103 0.119 0.118 0.116 0.116 0.067 0.068 0.191 0.188 m1 * ** 0.361 0.357 0.367 0.353 0.366 0.349 0.243 0.231 0.514 0.483 *Calculations by Frocini criterion; **calculations based on the omega-square test. Table 2 Calculated and critical values of the Frocini and omega-square criteria for a mixture of 2 normal distributions with a sample size of n = 240 Goodness measure Calculated values Critical value at significance level α 0.05 0.10 0.15 0.20 0.25 0.30 Frocini * ** 0.0776 0.0785 0.146 0.136 0.130 0.125 0.121 0.118 Omega-square * ** 0.0104 0.0102 0.0348 0.0301 0.0277 0.0257 0.0241 0.0229 Distribution parameters obtained by minimizing the criteria: * Frocini; **omega-square. Fig. 3. The results of testing the hypothesis of compliance with the empirical distribution function and the mixture function of two normal distributions by Frocini and omega-square criteria Рис. 3. Результаты проверки гипотезы соответствия эмпирической функции распределения и функции смеси двух нормальных распределений по критериям Фроцини и омега-квадрат The calculated and critical values of the Frocini and omega-square criteria for a mixture of 2 normal distributions with a sample size of n = 240 are presented in tab. 2. The visualization of the results of testing the hypothesis of compliance with the empirical distribution function with the mixture function of two normal distributions according to the Frocini and omega-square criteria is presented in fig. 3. The simulation modeling results allow to evaluate the statistics of the parameters of the distributions mixture. In fig. 4-6 the results of the evaluation of the distribution of the parameters of the first and second components of the mixture, obtained from the results of statistical tests for the Frocini and omega-square agreement criteria, are presented. Conclusion. The results of computational experiments allow to conclude about the effectiveness of obtaining estimates of distributions mixture parameters, minimizing the calculated values of the goodness measures. The use of different goodness measures allows improving the quality of the found estimates. The differences in the estimates of the parameters of the mixture of two normal distributions, obtained by minimizing the Frocini and omega-square criteria for experimental samples, did not exceed 1 %. Evaluation of the distribution parameters in combination with the simulation method for evaluating the statistics of the goodness measure allows to test the complex hypothesis of consistency between the empirical and theoretical distribution functions. A related result of this task is an assessment of the statistics of the distribution parameters and confidence intervals of their change. The choice of the minimum number of components of a distributions mixture is determined by the condition of accepting the hypothesis of compliance with the empirical and theoretical distribution functions. Fig. 4. Estimates of the distribution functions of expected values and dispersions of the mixture components Рис. 4. Оценки функций распределения математических ожиданий и дисперсий компонентов смеси Fig. 5. Estimates of the distribution of the parameters of the first and second components of the mixture Рис. 5. Оценки распределения параметров первой и второй компоненты смеси Fig. 6. Estimates of the distribution of the mathematical expectation of the first and the second components and the proportion of the first component in the mixture Рис. 6. Оценки распределения математических ожиданий первой и второй компоненты и доли первой компоненты смеси

Авторлар туралы

S. Ushanov

Reshetnev Siberian State University of Science and Technology

Email: ushanov_sv@mail.ru
31, Krasnoyarsky Rabochy Av., Krasnoyarsk, 660037, Russian Federation

D. Ogurtsov

Reshetnev Siberian State University of Science and Technology

31, Krasnoyarsky Rabochy Av., Krasnoyarsk, 660037, Russian Federation

Әдебиет тізімі

Қосымша файлдар