QUANTITATIVE TECHNIQUES WITH SMALL SAMPLE SIZES: AN EDUCATIONAL SUMMER CAMP EXAMPLE

TitleQUANTITATIVE TECHNIQUES WITH SMALL SAMPLE SIZES: AN EDUCATIONAL SUMMER CAMP EXAMPLE
Publication TypeJournal Article
Year of Publication2024
AuthorsKilty, TJ, Kilty, KT, Burrows Borowczak, A. C., Borowczak, M
JournalProblems of Education in the 21st Century
Volume82
Issue4
Start Page507-520
PaginationContinuous
Date PublishedAugust/2024
Type of ArticleOriginal article
ISSN1822-7864
Other NumbersE-ISSN 2538-7111
Keywordslikelihood ratio, multinomial probability model, quantitative analysis, small sample study, summer camp, survey research
Abstract

A computer science camp for pre-collegiate students was operated during the summers of 2022 and 2023. The effect the camp had on attitudes was quantitatively assessed using a survey instrument. However, enrollment at the summer camp was small, which meant the well-known Pearson's Chi-Squared to measure the significance of results was not applied. Thus, a quantitative analysis method using a multinomial probability distribution as a model of a multilevel Likert scale survey was used. Exact calculations of a multinomial probability model with likelihood ratio were performed to quantitatively analyze the results of questionnaires administered to participants in two cohort groups (combined N=17). Probabilities per Likert categories were determined from the data itself using Bayes theorem with a Dirichlet prior. Each cohort functioned as part of a homogenous sample, thus allowing cohorts to be pooled. Post-test revealed significant changes in participants’ attitudes after camp completion. Using this technique has implications for studies with small sample sizes. Using exact calculation of the multinomial probability model with the use of likelihood ratio as a statistical test of evidence has advantages: a) it is an exact value that can be used on any size sample, although it offers a quantitative analysis option for small sample size studies; b) depends only on what was observed during a study; c) does not require advanced calculation; d) modern spreadsheet and statistical package programs can calculate the analysis; and e) likelihood ratio employed in Bayes theorem can update prior beliefs according to evidence. Utilizing small sample size quantitative analysis can strengthen insights into data trends and showcase the importance of this quantitative technique.

URLhttps://oaji.net/articles/2023/457-1723303067.pdf
DOI10.33225/pec/24.82.507
Refereed DesignationRefereed
Full Text