You conducted an A/B test and found out that the new product is selling more than the old product. So if i accept 0.05 as a reasonable cutoff I should accept their interpretation? However, in each group, I have few measurements for each individual. :9r}$vR%s,zcAT?K/):$J!.zS6v&6h22e-8Gk!z{%@B;=+y -sW] z_dtC_C8G%tC:cU9UcAUG5Mk>xMT*ggVf2f-NBg[U>{>g|6M~qzOgk`&{0k>.YO@Z'47]S4+u::K:RY~5cTMt]Uw,e/!`5in|H"/idqOs&y@C>T2wOY92&\qbqTTH *o;0t7S:a^X?Zo Z]Q@34C}hUzYaZuCmizOMSe4%JyG\D5RS> ~4>wP[EUcl7lAtDQp:X ^Km;d-8%NSV5 Is it correct to use "the" before "materials used in making buildings are"? F Box plots. For most visualizations, I am going to use Pythons seaborn library. It only takes a minute to sign up. When comparing three or more groups, the term paired is not apt and the term repeated measures is used instead. Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. An independent samples t-test is used when you want to compare the means of a normally distributed interval dependent variable for two independent groups. %PDF-1.4 Also, a small disclaimer: I write to learn so mistakes are the norm, even though I try my best. One-way ANOVA however is applicable if you want to compare means of three or more samples. Interpret the results. A very nice extension of the boxplot that combines summary statistics and kernel density estimation is the violin plot. The Compare Means procedure is useful when you want to summarize and compare differences in descriptive statistics across one or more factors, or categorical variables. The main advantage of visualization is intuition: we can eyeball the differences and intuitively assess them. Quantitative variables represent amounts of things (e.g. Rename the table as desired. b. Revised on December 19, 2022. Here we get: group 1 v group 2, P=0.12; 1 v 3, P=0.0002; 2 v 3, P=0.06. Note 2: the KS test uses very little information since it only compares the two cumulative distributions at one point: the one of maximum distance. As you have only two samples you should not use a one-way ANOVA. Quantitative variables are any variables where the data represent amounts (e.g. x>4VHyA8~^Q/C)E zC'S(].x]U,8%R7ur t P5mWBuu46#6DJ,;0 eR||7HA?(A]0 We use the ttest_ind function from scipy to perform the t-test. plt.hist(stats, label='Permutation Statistics', bins=30); Chi-squared Test: statistic=32.1432, p-value=0.0002, k = np.argmax( np.abs(df_ks['F_control'] - df_ks['F_treatment'])), y = (df_ks['F_treatment'][k] + df_ks['F_control'][k])/2, Kolmogorov-Smirnov Test: statistic=0.0974, p-value=0.0355. Non-parametric tests are "distribution-free" and, as such, can be used for non-Normal variables. Thus the proper data setup for a comparison of the means of two groups of cases would be along the lines of: DATA LIST FREE / GROUP Y. What has actually been done previously varies including two-way anova, one-way anova followed by newman-keuls, "SAS glm". There are some differences between statistical tests regarding small sample properties and how they deal with different variances. To determine which statistical test to use, you need to know: Statistical tests make some common assumptions about the data they are testing: If your data do not meet the assumptions of normality or homogeneity of variance, you may be able to perform a nonparametric statistical test, which allows you to make comparisons without any assumptions about the data distribution. lGpA=`> zOXx0p #u;~&\E4u3k?41%zFm-&q?S0gVwN6Bw.|w6eevQ h+hLb_~v 8FW| Difference between which two groups actually interests you (given the original question, I expect you are only interested in two groups)? 13 mm, 14, 18, 18,6, etc And I want to know which one is closer to the real distances. $\endgroup$ - RY[1`Dy9I RL!J&?L$;Ug$dL" )2{Z-hIn ib>|^n MKS! B+\^%*u+_#:SneJx* Gh>4UaF+p:S!k_E I@3V1`9$&]GR\T,C?r}#>-'S9%y&c"1DkF|}TcAiu-c)FakrB{!/k5h/o":;!X7b2y^+tzhg l_&lVqAdaj{jY XW6c))@I^`yvk"ndw~o{;i~ We will use two here. What's the difference between a power rail and a signal line? Do new devs get fired if they can't solve a certain bug? Connect and share knowledge within a single location that is structured and easy to search. For this example, I have simulated a dataset of 1000 individuals, for whom we observe a set of characteristics. Significance is usually denoted by a p-value, or probability value. How to compare two groups of empirical distributions? 0000003544 00000 n %PDF-1.3 % But while scouts and media are in agreement about his talent and mechanics, the remaining uncertainty revolves around his size and how it will translate in the NFL. For simplicity, we will concentrate on the most popular one: the F-test. The aim of this work was to compare UV and IR laser ablation and to assess the potential of the technique for the quantitative bulk analysis of rocks, sediments and soils. You could calculate a correlation coefficient between the reference measurement and the measurement from each device. njsEtj\d. For example, using the hsb2 data file, say we wish to test whether the mean for write is the same for males and females. In the experiment, segment #1 to #15 were measured ten times each with both machines. 2) There are two groups (Treatment and Control) 3) Each group consists of 5 individuals. The colors group statistical tests according to the key below: Choose Statistical Test for 1 Dependent Variable, Choose Statistical Test for 2 or More Dependent Variables, Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Click OK. Click the red triangle next to Oneway Analysis, and select UnEqual Variances. o*GLVXDWT~! To subscribe to this RSS feed, copy and paste this URL into your RSS reader. For testing, I included the Sales Region table with relationship to the fact table which shows that the totals for Southeast and Southwest and for Northwest and Northeast match the Selected Sales Region 1 and Selected Sales Region 2 measure totals. By clicking Post Your Answer, you agree to our terms of service, privacy policy and cookie policy. Multiple nonlinear regression** . column contains links to resources with more information about the test. Lastly, lets consider hypothesis tests to compare multiple groups. brands of cereal), and binary outcomes (e.g. 0000045790 00000 n %H@%x YX>8OQ3,-p(!LlA.K= height, weight, or age). Like many recovery measures of blood pH of different exercises. Reveal answer I added some further questions in the original post. A t -test is used to compare the means of two groups of continuous measurements. How to compare the strength of two Pearson correlations? You must be a registered user to add a comment. 3) The individual results are not roughly normally distributed. This page was adapted from the UCLA Statistical Consulting Group. Compare two paired groups: Paired t test: Wilcoxon test: McNemar's test: . If the value of the test statistic is more extreme than the statistic calculated from the null hypothesis, then you can infer a statistically significant relationship between the predictor and outcome variables. The p-value of the test is 0.12, therefore we do not reject the null hypothesis of no difference in means across treatment and control groups. Do new devs get fired if they can't solve a certain bug? 37 63 56 54 39 49 55 114 59 55. The p-value is below 5%: we reject the null hypothesis that the two distributions are the same, with 95% confidence. A more transparent representation of the two distributions is their cumulative distribution function. One of the easiest ways of starting to understand the collected data is to create a frequency table. Differently from all other tests so far, the chi-squared test strongly rejects the null hypothesis that the two distributions are the same. The most intuitive way to plot a distribution is the histogram. Nevertheless, what if I would like to perform statistics for each measure? 18 0 obj << /Linearized 1 /O 20 /H [ 880 275 ] /L 95053 /E 80092 /N 4 /T 94575 >> endobj xref 18 22 0000000016 00000 n Ist. Doubling the cube, field extensions and minimal polynoms. In practice, we select a sample for the study and randomly split it into a control and a treatment group, and we compare the outcomes between the two groups. When it happens, we cannot be certain anymore that the difference in the outcome is only due to the treatment and cannot be attributed to the imbalanced covariates instead. where the bins are indexed by i and O is the observed number of data points in bin i and E is the expected number of data points in bin i. As the name suggests, this is not a proper test statistic, but just a standardized difference, which can be computed as: Usually, a value below 0.1 is considered a small difference. As for the boxplot, the violin plot suggests that income is different across treatment arms. The idea of the Kolmogorov-Smirnov test is to compare the cumulative distributions of the two groups. If your data do not meet the assumption of independence of observations, you may be able to use a test that accounts for structure in your data (repeated-measures tests or tests that include blocking variables). We can now perform the actual test using the kstest function from scipy. The primary purpose of a two-way repeated measures ANOVA is to understand if there is an interaction between these two factors on the dependent variable. 2 7.1 2 6.9 END DATA. The test statistic for the two-means comparison test is given by: Where x is the sample mean and s is the sample standard deviation. ANOVA and MANOVA tests are used when comparing the means of more than two groups (e.g., the average heights of children, teenagers, and adults). February 13, 2013 . Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type. Paired t-test. Use strip charts, multiple histograms, and violin plots to view a numerical variable by group. In order to have a general idea about which one is better I thought that a t-test would be ok (tell me if not): I put all the errors of Device A together and compare them with B. 2.2 Two or more groups of subjects There are three options here: 1. Alternatives. The aim of this study was to evaluate the generalizability in an independent heterogenous ICH cohort and to improve the prediction accuracy by retraining the model. t-test groups = female(0 1) /variables = write. aNWJ!3ZlG:P0:E@Dk3A+3v6IT+&l qwR)1 ^*tiezCV}}1K8x,!IV[^Lzf`t*L1[aha[NHdK^idn6I`?cZ-vBNe1HfA.AGW(`^yp=[ForH!\e}qq]e|Y.d\"$uG}l&+5Fuc What sort of strategies would a medieval military use against a fantasy giant? Types of categorical variables include: Choose the test that fits the types of predictor and outcome variables you have collected (if you are doing an experiment, these are the independent and dependent variables). Has 90% of ice around Antarctica disappeared in less than a decade? There is also three groups rather than two: In response to Henrik's answer: Direct analysis of geological reference materials was performed by LA-ICP-MS using two Nd:YAG laser systems operating at 266 nm and 1064 nm. Third, you have the measurement taken from Device B. Should I use ANOVA or MANOVA for repeated measures experiment with two groups and several DVs? In the first two columns, we can see the average of the different variables across the treatment and control groups, with standard errors in parenthesis. There is no native Q-Q plot function in Python and, while the statsmodels package provides a qqplot function, it is quite cumbersome. In the Power Query Editor, right click on the table which contains the entity values to compare and select Reference . The effect is significant for the untransformed and sqrt dv. one measurement for each). The best answers are voted up and rise to the top, Not the answer you're looking for? Some of the methods we have seen above scale well, while others dont. Categorical variables are any variables where the data represent groups. 0000001480 00000 n Making statements based on opinion; back them up with references or personal experience. o^y8yQG} ` #B.#|]H&LADg)$Jl#OP/xN\ci?jmALVk\F2_x7@tAHjHDEsb)`HOVp Use the paired t-test to test differences between group means with paired data. The reason lies in the fact that the two distributions have a similar center but different tails and the chi-squared test tests the similarity along the whole distribution and not only in the center, as we were doing with the previous tests. A Dependent List: The continuous numeric variables to be analyzed. Again, the ridgeline plot suggests that higher numbered treatment arms have higher income. 4 0 obj << Making statements based on opinion; back them up with references or personal experience. You need to know what type of variables you are working with to choose the right statistical test for your data and interpret your results. ; The Methodology column contains links to resources with more information about the test. 6.5.1 t -test. Independent groups of data contain measurements that pertain to two unrelated samples of items. An alternative test is the MannWhitney U test. Key function: geom_boxplot() Key arguments to customize the plot: width: the width of the box plot; notch: logical.If TRUE, creates a notched box plot. Note: the t-test assumes that the variance in the two samples is the same so that its estimate is computed on the joint sample. We thank the UCLA Institute for Digital Research and Education (IDRE) for permission to adapt and distribute this page from our site. In the photo above on my classroom wall, you can see paper covering some of the options. Use MathJax to format equations. This study focuses on middle childhood, comparing two samples of mainland Chinese (n = 126) and Australian (n = 83) children aged between 5.5 and 12 years. There are two issues with this approach. Where F and F are the two cumulative distribution functions and x are the values of the underlying variable. 0000001134 00000 n For information, the random-effect model given by @Henrik: is equivalent to a generalized least-squares model with an exchangeable correlation structure for subjects: As you can see, the diagonal entry corresponds to the total variance in the first model: and the covariance corresponds to the between-subject variance: Actually the gls model is more general because it allows a negative covariance. 0000001906 00000 n What is the point of Thrower's Bandolier? The boxplot scales very well when we have a number of groups in the single-digits since we can put the different boxes side-by-side. What is the difference between quantitative and categorical variables? Stack Exchange network consists of 181 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers. (afex also already sets the contrast to contr.sum which I would use in such a case anyway). Comparing multiple groups ANOVA - Analysis of variance When the outcome measure is based on 'taking measurements on people data' For 2 groups, compare means using t-tests (if data are Normally distributed), or Mann-Whitney (if data are skewed) Here, we want to compare more than 2 groups of data, where the Last but not least, a warm thank you to Adrian Olszewski for the many useful comments! In the two new tables, optionally remove any columns not needed for filtering. Browse other questions tagged, Start here for a quick overview of the site, Detailed answers to any questions you might have, Discuss the workings and policies of this site. If you've already registered, sign in. For nonparametric alternatives, check the table above. Choose this when you want to compare . To learn more, see our tips on writing great answers. Example Comparing Positive Z-scores. Your home for data science. The only additional information is mean and SEM. \}7. There is data in publications that was generated via the same process that I would like to judge the reliability of given they performed t-tests. Resources and support for statistical and numerical data analysis, This table is designed to help you choose an appropriate statistical test for data with, Hover your mouse over the test name (in the. Given that we have replicates within the samples, mixed models immediately come to mind, which should estimate the variability within each individual and control for it. ncdu: What's going on with this second size column? here is a diagram of the measurements made [link] (. I know the "real" value for each distance in order to calculate 15 "errors" for each device. @StphaneLaurent I think the same model can only be obtained with. There are two steps to be remembered while comparing ratios. [2] F. Wilcoxon, Individual Comparisons by Ranking Methods (1945), Biometrics Bulletin. For this approach, it won't matter whether the two devices are measuring on the same scale as the correlation coefficient is standardised. The issue with kernel density estimation is that it is a bit of a black box and might mask relevant features of the data. ; The How To columns contain links with examples on how to run these tests in SPSS, Stata, SAS, R and . 1xDzJ!7,U&:*N|9#~W]HQKC@(x@}yX1SA pLGsGQz^waIeL!`Mc]e'Iy?I(MDCI6Uqjw r{B(U;6#jrlp,.lN{-Qfk4>H 8`7~B1>mx#WG2'9xy/;vBn+&Ze-4{j,=Dh5g:~eg!Bl:d|@G Mdu] BT-\0OBu)Ni_0f0-~E1 HZFu'2+%V!evpjhbh49 JF By clicking Accept all cookies, you agree Stack Exchange can store cookies on your device and disclose information in accordance with our Cookie Policy. dPW5%0ndws:F/i(o}#7=5yQ)ngVnc5N6]I`>~ In both cases, if we exaggerate, the plot loses informativeness. @Ferdi Thanks a lot For the answers. If a law is new but its interpretation is vague, can the courts directly ask the drafters the intent and official interpretation of their law? W{4bs7Os1 s31 Kz !- bcp*TsodI`L,W38X=0XoI!4zHs9KN(3pM$}m4.P] ClL:.}> S z&Ppa|j$%OIKS5;Tl3!5se!H The best answers are voted up and rise to the top, Not the answer you're looking for? t test example. The Anderson-Darling test and the Cramr-von Mises test instead compare the two distributions along the whole domain, by integration (the difference between the two lies in the weighting of the squared distances). I trying to compare two groups of patients (control and intervention) for multiple study visits. These "paired" measurements can represent things like: A measurement taken at two different times (e.g., pre-test and post-test score with an intervention administered between the two time points) A measurement taken under two different conditions (e.g., completing a test under a "control" condition and an "experimental" condition) This ignores within-subject variability: Now, it seems to me that because each individual mean is an estimate itself, that we should be less certain about the group means than shown by the 95% confidence intervals indicated by the bottom-left panel in the figure above. BEGIN DATA 1 5.2 1 4.3 . Goals. A t test is a statistical test that is used to compare the means of two groups. Use MathJax to format equations. What are the main assumptions of statistical tests? Is it a bug? 0000048545 00000 n For example, let's use as a test statistic the difference in sample means between the treatment and control groups. Regarding the first issue: Of course one should have two compute the sum of absolute errors or the sum of squared errors. Yes, as long as you are interested in means only, you don't loose information by only looking at the subjects means. higher variance) in the treatment group, while the average seems similar across groups. The boxplot is a good trade-off between summary statistics and data visualization. Consult the tables below to see which test best matches your variables. Objectives: DeepBleed is the first publicly available deep neural network model for the 3D segmentation of acute intracerebral hemorrhage (ICH) and intraventricular hemorrhage (IVH) on non-enhanced CT scans (NECT). Research question example. sns.boxplot(x='Arm', y='Income', data=df.sort_values('Arm')); sns.violinplot(x='Arm', y='Income', data=df.sort_values('Arm')); Individual Comparisons by Ranking Methods, The generalization of Students problem when several different population variances are involved, On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other, The Nonparametric Behrens-Fisher Problem: Asymptotic Theory and a Small-Sample Approximation, Sulla determinazione empirica di una legge di distribuzione, Wahrscheinlichkeit statistik und wahrheit, Asymptotic Theory of Certain Goodness of Fit Criteria Based on Stochastic Processes, Goodbye Scatterplot, Welcome Binned Scatterplot, https://www.linkedin.com/in/matteo-courthoud/, Since the two groups have a different number of observations, the two histograms are not comparable, we do not need to make any arbitrary choice (e.g. Following extensive discussion in the comments with the OP, this approach is likely inappropriate in this specific case, but I'll keep it here as it may be of some use in the more general case. I also appreciate suggestions on new topics! For a specific sample, the device with the largest correlation coefficient (i.e., closest to 1), will be the less errorful device. [9] T. W. Anderson, D. A. We can now perform the test by comparing the expected (E) and observed (O) number of observations in the treatment group, across bins. We would like them to be as comparable as possible, in order to attribute any difference between the two groups to the treatment effect alone. Hello everyone! Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. Learn more about Stack Overflow the company, and our products. The measurements for group i are indicated by X i, where X i indicates the mean of the measurements for group i and X indicates the overall mean. XvQ'q@:8" One of the least known applications of the chi-squared test is testing the similarity between two distributions. To open the Compare Means procedure, click Analyze > Compare Means > Means. Simplified example of what I'm trying to do: Let's say I have 3 data points A, B, and C. I run KMeans clustering on this data and get 2 clusters [(A,B),(C)].Then I run MeanShift clustering on this data and get 2 clusters [(A),(B,C)].So clearly the two clustering methods have clustered the data in different ways. The p-value estimates how likely it is that you would see the difference described by the test statistic if the null hypothesis of no relationship were true. Ratings are a measure of how many people watched a program. However, the issue with the boxplot is that it hides the shape of the data, telling us some summary statistics but not showing us the actual data distribution. We've added a "Necessary cookies only" option to the cookie consent popup. Jared scored a 92 on a test with a mean of 88 and a standard deviation of 2.7. A first visual approach is the boxplot. So you can use the following R command for testing. Volumes have been written about this elsewhere, and we won't rehearse it here. Since investigators usually try to compare two methods over the whole range of values typically encountered, a high correlation is almost guaranteed. This is a measurement of the reference object which has some error. We also have divided the treatment group into different arms for testing different treatments (e.g. As I understand it, you essentially have 15 distances which you've measured with each of your measuring devices, Thank you @Ian_Fin for the patience "15 known distances, which varied" --> right. ANOVA and MANOVA tests are used when comparing the means of more than two groups (e.g., the average heights of children, teenagers, and adults). The same 15 measurements are repeated ten times for each device. Objective: The primary objective of the meta-analysis was to determine the combined benefit of ET in adult patients with . vegan) just to try it, does this inconvenience the caterers and staff? /Length 2817 I will first take you through creating the DAX calculations and tables needed so end user can compare a single measure, Reseller Sales Amount, between different Sale Region groups. 3G'{0M;b9hwGUK@]J< Q [*^BKj^Xt">v!(,Ns4C!T Q_hnzk]f The test statistic is asymptotically distributed as a chi-squared distribution. Create the measures for returning the Reseller Sales Amount for selected regions. These effects are the differences between groups, such as the mean difference. They can be used to: Statistical tests assume a null hypothesis of no relationship or no difference between groups. I'm testing two length measuring devices. So far we have only considered the case of two groups: treatment and control. For example, lets say you wanted to compare claims metrics of one hospital or a group of hospitals to another hospital or group of hospitals, with the ability to slice on which hospitals to use on each side of the comparison vs doing some type of segmentation based upon metrics or creating additional hierarchies or groupings in the dataset. Therefore, the boxplot provides both summary statistics (the box and the whiskers) and direct data visualization (the outliers). [8] R. von Mises, Wahrscheinlichkeit statistik und wahrheit (1936), Bulletin of the American Mathematical Society. The ANOVA provides the same answer as @Henrik's approach (and that shows that Kenward-Rogers approximation is correct): Then you can use TukeyHSD() or the lsmeans package for multiple comparisons: Thanks for contributing an answer to Cross Validated! Is it suspicious or odd to stand by the gate of a GA airport watching the planes? Air pollutants vary in potency, and the function used to convert from air pollutant . I was looking a lot at different fora but I could not find an easy explanation for my problem. Asking for help, clarification, or responding to other answers. The closer the coefficient is to 1 the more the variance in your measurements can be accounted for by the variance in the reference measurement, and therefore the less error there is (error is the variance that you can't account for by knowing the length of the object being measured). So if I instead perform anova followed by TukeyHSD procedure on the individual averages as shown below, I could interpret this as underestimating my p-value by about 3-4x? Example #2. >j To learn more, see our tips on writing great answers. Attuar.. [7] H. Cramr, On the composition of elementary errors (1928), Scandinavian Actuarial Journal. Secondly, this assumes that both devices measure on the same scale. However, sometimes, they are not even similar. For simplicity's sake, let us assume that this is known without error. Two test groups with multiple measurements vs a single reference value, Compare two unpaired samples, each with multiple proportions, Proper statistical analysis to compare means from three groups with two treatment each, Comparing two groups of measurements with missing values. The second task will be the development and coding of a cascaded sigma point Kalman filter to enable multi-agent navigation (i.e, navigation of many robots). The Tamhane's T2 test was performed to adjust for multiple comparisons between groups within each analysis. Background. As a reference measure I have only one value. I would like to be able to test significance between device A and B for each one of the segments, @Fed So you have 15 different segments of known, and varying, distances, and for each measurement device you have 15 measurements (one for each segment)? I post once a week on topics related to causal inference and data analysis. Bed topography and roughness play important roles in numerous ice-sheet analyses. Hb```V6Ad`0pT00L($\MKl]K|zJlv{fh` k"9:1p?bQ:?3& q>7c`9SA'v GW &020fbo w% endstream endobj 39 0 obj 162 endobj 20 0 obj << /Type /Page /Parent 15 0 R /Resources 21 0 R /Contents 29 0 R /MediaBox [ 0 0 612 792 ] /CropBox [ 0 0 612 792 ] /Rotate 0 >> endobj 21 0 obj << /ProcSet [ /PDF /Text ] /Font << /TT2 26 0 R /TT4 22 0 R /TT6 23 0 R /TT8 30 0 R >> /ExtGState << /GS1 34 0 R >> /ColorSpace << /Cs6 28 0 R >> >> endobj 22 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 121 /Widths [ 250 0 0 0 0 0 778 0 333 333 0 0 250 0 250 0 0 500 500 0 0 0 0 0 0 500 278 0 0 0 0 0 0 722 667 667 0 0 556 722 0 0 0 722 611 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 444 0 444 500 444 0 0 0 0 0 0 278 0 500 500 500 0 333 389 278 0 0 0 0 500 ] /Encoding /WinAnsiEncoding /BaseFont /KNJJNE+TimesNewRoman /FontDescriptor 24 0 R >> endobj 23 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 118 /Widths [ 250 0 0 0 0 0 0 0 0 0 0 0 0 0 250 0 0 0 0 0 0 0 0 0 0 0 333 0 0 0 0 0 0 611 0 0 0 0 0 0 0 333 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 500 0 444 500 444 0 500 500 278 0 0 0 722 500 500 0 0 389 389 278 500 444 ] /Encoding /WinAnsiEncoding /BaseFont /KNJKAF+TimesNewRoman,Italic /FontDescriptor 27 0 R >> endobj 24 0 obj << /Type /FontDescriptor /Ascent 891 /CapHeight 0 /Descent -216 /Flags 34 /FontBBox [ -568 -307 2028 1007 ] /FontName /KNJJNE+TimesNewRoman /ItalicAngle 0 /StemV 0 /FontFile2 32 0 R >> endobj 25 0 obj << /Type /FontDescriptor /Ascent 905 /CapHeight 718 /Descent -211 /Flags 32 /FontBBox [ -665 -325 2028 1006 ] /FontName /KNJJKD+Arial /ItalicAngle 0 /StemV 94 /XHeight 515 /FontFile2 33 0 R >> endobj 26 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 146 /Widths [ 278 0 0 0 0 0 0 0 333 333 0 0 278 333 278 278 0 556 556 556 556 556 0 556 0 0 278 278 0 0 0 0 0 667 667 722 722 0 611 0 0 278 0 0 556 833 722 778 0 0 722 667 611 0 667 944 667 0 0 0 0 0 0 0 0 556 556 500 556 556 278 556 556 222 0 500 222 833 556 556 556 556 333 500 278 556 500 722 500 500 500 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 222 ] /Encoding /WinAnsiEncoding /BaseFont /KNJJKD+Arial /FontDescriptor 25 0 R >> endobj 27 0 obj << /Type /FontDescriptor /Ascent 891 /CapHeight 0 /Descent -216 /Flags 98 /FontBBox [ -498 -307 1120 1023 ] /FontName /KNJKAF+TimesNewRoman,Italic /ItalicAngle -15 /StemV 83.31799 /FontFile2 37 0 R >> endobj 28 0 obj [ /ICCBased 35 0 R ] endobj 29 0 obj << /Length 799 /Filter /FlateDecode >> stream