Skip to content
CO:RE
pexels-anna-nekrashevich-6801648.jpg
Resource Methods Toolkit wp6-tuni Published: 12 May 2022

Non-parametric analysis

Through the usage of non-parametric statistics, an additional set of statistical methods can be applied to external determining factors or parameters found outside of a normal distribution. The data can be drawn from an ordinal scale, where there are qualitative differences (that do not perfectly align) to quantitative criteria. An ordinal scale could, for instance, represent a participants’ preference such as gender or location, which constitutes an independent variable for the study. This allows for greater freedom in the usage of an ordinal scale, providing the perception of freedom. Non-parametric have flexible parameters and thus differ from parametric who have fixed parameters. A further advantage that parametric statistics offer, is the ability to distill quantitative and qualitative data derived from observations. A non-parametric dataset, in contrast, allows us the ability to capture more elusive human behaviours which are frequently more complex to obtain, thus allowing for further insight and studies; an example of which could be the analysis of digital environments.  Non-parametric methods additionally require less assumptions to be made about the data, however this culminates in weaker explanatory power when interpreting the results.

Criteria for non-parametric analysis

Non-parametric analysis draws upon a combination of statistical models and tests. The most frequently used nonparametric tests are McNemar-test, Kruskal-Wallis –test, Wilcoxon signed-rank test, and Mann-Whitney U test. MacNemar is used upon paired nominal datasets such as 2x2 contingency tables or dichotomies. Kruskal-Wallis is a one-way analysis of variance calculated on rank-transformed data, it is utilised for testing if samples originate from a similar distribution. It can be used to determine the comparisons between various different sample sizes and structures. Wilcoxon signed-rank –test is used when there are two sets of data drawn from a non-normal distribution and produces an equivalent result to that of a t-test. However, the results have greater statistical power than that of a t-test and it is more likely to produce statistically significant results. Mann-Whitney u –test is to test if random values from A or B are different from each other. 

The term "non-parametric" is not meant to imply that the tests (or the model behind them) are without parameter assumptions, it is that the requirements placed upon them are more relaxed. Consequently, the parameters are not fixed, because they provide explanatory logic to the test. Researcher(s) using a non-parametric test can make the assumptions of an identically shaped and scaled distribution which does not require normal distribution. This differs from other statistical methods such as ANOVA, Pearson's correlation, t-test and others which do not make assumptions and which utilise samples from a normal distribution. Participant’s preferences and similar behaviours are considered to culminate in the development of a normal distributed dataset, but rarely do, as the data generation process relies on self-construction. 

Interpretation of the results

As non-parametric statistics result in less assumptions being drawn from the data sample, this results in greater application than parametric statistics. However, in certain cases, parametric testing are more appropriate, while non-parametric methods will be less efficient. This is because non-parametric statistics do not utilise certain information within the dataset. Non-parametric statistics correspond better to natural phenomenon allowing for easier to use and validation. Thus, the removal or relaxation of parameters thresholds, result in more data becoming available for testing and applicable to a larger variety of tests. 

Key considerations

Parametric and non-parametric methods are often used on different types of data. Parametric statistics generally require interval or ratio data. An example of this type of data is age, income, height, and weight in which the values are continuous and the intervals between values have meaning. Also the interval between the values are proportional, not only qualitative.  Non-parametric statistics are typically used on data that nominal or ordinal. Nominal variables are variables for which the values have not quantitative value. Common nominal variables in social science research, for example, include sex, whose possible values are discrete categories, "boy" and "girl."' Ordinal variables are those in which the value suggests some order. An example of an ordinal variable would be if a survey respondent asked a question and the answer is given on 5-point Likert scale from agree to disagree.

  1. Altman, D. G., & Bland, J. M. (2009). Parametric v non-parametric methods for data analysis. Bmj, 338.

  2. Brodsky, E., & Darkhovsky, B. S. (2000). Non-parametric statistical diagnosis: problems and methods (Vol. 509). Springer Science & Business Media.

  3. Härdle, W., & Linton, O. (1994). Applied nonparametric methods. Handbook of econometrics, 4, 2295-2339.

  4. Kraska-Miller, M. (2013). Nonparametric statistics for social and behavioral sciences. CRC Press.

  5. Pesaran, M. H., & Timmermann, A. (1992). A simple nonparametric test of predictive performance. Journal of Business & Economic Statistics, 10(4), 461-465.

Share this post:

Authors

TAU_Iiris_Tuvi.jpg
Team member, CO:RE at TUNI

Iiris Tuvi

Iiris Tuvi, PhD, is a post-doctoral Research Fellow a the Faculty of Information Technology and Communication Sciences of Tampere University. She has long experience in experimental psychology and methods involving psychometrics and data analysis. Currently working on methods used to research children in digital environment. Iiris is a member of Work Package 6 team.

Tampere University
Tampere University
CO:RE at TUNI
Methods

The team at the Faculty of Information Technology and Communication of TUNI identifies, develops and provides access to resources on qualitative, quantitative and mixed research methods together with evaluating their validity in research practice.

These resources are collated in the CO:RE methods toolkit that cross-reference resources from the evidence base, the compass for research ethics, and the theory toolkit, to give users tools to apply to their individual research contexts.

Leave a comment

Required fields are marked with a *
Your email address will not be published.
Leave a comment

Cookie preferences

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.