Analysis Reporting and Handling Nonresponse in Sports Marketing Articles

Document Type : Original Article

Authors

1 Department of Physical Education and Sports Science, University of Kurdistan, Sanandaj, Iran

2 Ph.D student of sport management, University of Kurdistan sanandaj, Iran

3 Phd Student of Sport Management University of Kurdistan, sanandaj, Iran

https://www.doi.org/10.34785/J021.2021.533

Abstract

Given that many sports organizations can use research results, proper sampling and prevention of possible biases play an important role in the proper application of research. In this regard, it seems that the efforts of sports management researchers to accurately evaluate the methods used in research is a necessary step to increase the quality of research in the field of sports management. One of these methods is to try to increase the response rate and reduce the bias of the samples without answering the questionnaire. Sample bias without answering the questionnaire should be checked in the samples, then this bias should be reduced as much as possible in the results of the final study. Otherwise, the conclusion of the study may be distorted. In most cases, there is little knowledge about sample bias without answering the questionnaire, so it is difficult to assess their impact on the final analysis of the data. This study aimed to analyze the reporting and management Nonresponse in sport marketing management articles published in the Journal of Sport Management. The specific objectives of this research include the following: Objective 1: To study the sampling method and the method of data collection used. Objective 2: To evaluate the response rate to the questionnaire and the strategy to increase the response rate. Objective 3: Review the strategies used for unanswered management.
The study population consisted of all articles published from the first issue of 2016 to the end of 2016 (N = 431) were analyzed by a coding sheet. All articles published in the field of sports marketing in sports management journals were analyzed using content analysis method, which is a systematic technique (Berger, 2000). Qualitative content analysis is appropriate when existing theories or research literature are limited to a phenomenon (hsieh & Shannon, 2005). The instrument used in this study was based on previous research (linder et al., 2001; miller & smith, 1983). Thus, the data collection tool in this study includes a coding sheet that the data were collected according to the following instructions. The validity of coding sheet was measured by ten of sport marketing and management experts specializing in the analysis of content. Using Scott test, the coefficient of agreement between coders was more than 90%. The results showed that a small number of articles published (5% of the articles) have pointed to the response rate As well as any articles Nonresponse as a threat to external validity. Not refer How to control and manage Non respons. As mentioned, samples without answering the questionnaire and their management was the main motivation for the current research.
The findings show that non-questionnaire samples have not been an important issue and concern for the vast majority of authors of sports marketing articles. Of the 431 articles published that should have considered unanswered bias (given a response rate of less than 85%), none of the articles referred to bias of unanswered samples as a threat to external credibility, so pursuing management and They have not been in control of this bias either. Also, out of the total number of published articles, only 25 articles mentioned the response rate.
This indicates that sports management researchers are unaware of this and are not concerned, but this (bias of samples without answering the questionnaire) may be a threat to external credibility. Therefore, if in a study the response rate to the questionnaire was less than 85%, there may be a bias of samples without answering the questionnaire, in which case this bias should be controlled. In general it can be said that researchers reporting the response rate to the questionnaire, if the response rate was less than 85% using of one of the three methods (Comparison of Early to Late Respondents, Using “Days to Respond” as a Regression Variable and Comparison of Respondents to Nonrespondents) to control and manage Non respons. If through this research we conclude that these methods are effective in controlling bias without response, then as much as possible these methods will be applied in future research of sports management to control one of the most important errors that are less considered. Finally, according to the materials and results obtained from the present study, which showed that both researchers and reviewers of sports management journals, especially in the field of sports marketing, do not pay much attention to the appropriate response rate (above 85%). Therefore, in most of the reviewed articles, they do not mention the response rate. Due to this, research that has a response rate lower than 85% is at risk of unanswered bias. As a result, researchers need to report the response rate if needed, and if the response rate is less than 85%, to implement the method to control and manage non-response bias.

Keywords


Ary, D., Jacobs, L., & Razavieh, A. (1996). Introduction to research in education. Ft. Worth: Holt, Rinehart, and Winston. Inc. college. Journal of Agricultural Education, 34(3), 76-83.
Asgari Bahman, Elahi Alireza, Poursoltani H. (2014) Content Analysis of Articles in Sports Science Research Journal of Sport Management, Sport Management Studies, pp. 172-155 (Persia)
Berger, A.A. (2000). Semiotic Analysis. In A.A. Berger (Ed.), Media and communication research methods. Thousand Oaks, CA: Sage.
Chalip, L. (2006). Toward a distinctive sport management discipline. Journal of Sport Management, 20, 1-21.
Christie, D., Gordon, I., & Heller, R. F. (1997). Epidemiology: An introductory text for medical and other health science students: UNSW Press.
Costa, C. A. (2005). The Status and Future of Sport Management: A Delphi Study. Journal of Sport Management, 19(2).
Cuneen, J., & Parks, J. B. (1997). Practice or Sport Management Education? A Response. Journal of Sport Management, 11, 125-132.
Davern, M. (2013). Nonresponse rates are a problematic indicator of nonresponse bias in survey research. Health Services Research, 48(3), 905-912.
Dey, E. L. (1997). Working with low survey response rates: The efficacy of weighting adjustments. Research in higher education, 38(2), 215-227.
Dillman, D. A. (2000). Mail and internet surveys: The tailored design method (Vol. 2): Wiley New York.
Dooley, L. M., & Lindner, J. R. (2003). The handling of nonresponse error. Human Resource Development Quarterly, 14(1), 99-110.
Fink, A. (2003). The survey handbook (Vol. 1): Sage.
Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (1993). How to design and evaluate research in education (Vol. 7): McGraw-Hill New York.
Groves, Robert M. Floyd J. Fowler, Mick P. Couper, James M. Lepkowski, Eleanor Singer, and Roger Tourangeau. (2009). Survey Methodology. 2nd ed. Hoboken, NJ: John Wiley & Sons.
Heere, B., & Dickson, G. (2008). Measuring attitudinal loyalty: Separating the terms of affective commitment and attitudinal loyalty. Journal of Sport Management, 22(2), 227.
Hovland, E. J., Romberg, E., & Moreland, E. F. (1980). Nonresponse bias to mail survey questionnaires within a professional population. Journal of Dental Education, 44(5), 270-274.
Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative health research, 15(9), 1277-1288.      JAMA.2013http://Jama.Jamanetwork.Com/Public/Instructionsforauthors.Aspx. American Medical Association.
Jeremy Jordan, Aubrey Kent, Yuhei Inoue (2011) Nonresponse error in sport management research: A content analysis of the Journal of Sport Management- North American Society for Sport Management Conference (NASSM)
Jaime J. Coon, Carena J. van Riper, Lois Wright Morton & James R. Miller (2019): Evaluating Nonresponse Bias in Survey Research Conducted in the Rural Midwest, Society & Natural Resources, DOI: 10.1080/08941920.2019.1705950.
Kim, D., & Kim, S. Y. (1995). QUESC: An instrument for assessing the service quality of sport centers in Korea. Journal of Sport Management, 9(2).
Krosnick, J. A. (1999). Survey research. Annual review of psychology, 50(1), 537-567.
Lindner, J. R., Murphy, T. H., & Briers, G. E. (2001). Handling nonresponse in social science research. Journal of Agricultural Education, 42(4), 43-53.
Locker, D. (2000). Response and nonresponse bias in oral health surveys. Journal of public health dentistry, 60(2), 72-81.
Lohr SL (1999) Sampling: design and analysis. Pacific Grove, CA: Duxbury Press, a Brooks/Cole Publishing Company
Meterko, M., Restuccia, J. D., Stolzmann, K., Mohr, D., Brennan, C., Glasgow, J., & Kaboli, P. (2015). Response Rates, Nonresponse Bias, and Data Quality Results from a National Survey of Senior Healthcare Leaders. Public Opinion Quarterly, 79(1), 130-144.
Miller, L. E., & Smith, K. L. (1983). Handling nonresponse issues. Journal of extension, 21(5), 45-50.
Pace, C. R. (1939). Factors influencing questionnaire returns from former university students. Journal of Applied Psychology, 23(3), 388.
Parashos, P., Morgan, M. V., & Messer, H. H. (2005). Response rate and nonresponse bias in a questionnaire survey of dentists. Community dentistry and oral epidemiology, 33(1), 9-16.
Parks, J. B., & Bartley, M. E. (1996). Sport Management Scholarship: A Professoriate in Transition? Journal of Sport Management, 10(2).
Paton, G. (1987). Sport management research: What progress has been made? Journal of Sport Management, 1(1), 25-31.
Phillips, A. W., Reddy, S., & Durning, S. J. (2016). Improving response rates and evaluating nonresponse bias in surveys: AMEE Guide No. 102. Medical teacher, 38(3), 217-228.
Rogelberg, S. G., & Luong, A. (1998). Nonresponse to mailed surveys: A review and guide. Current Directions in Psychological Science, 7(2), 60-65.
Seo, W. J., & Green, B. C. (2008). Development of the motivation scale for sport online consumption. Journal of Sport Management, 22(1), 82.
Singer, E. (2006). Introduction nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 637-645.
Stanley Marshica, Roycroft Jessica, Amaya Ashley, Dever Jill A, Srivastav Anup (2020),  The Effectiveness of Incentives on Completion Rates, Data Quality, and Nonresponse Bias in a Probability-based Internet Panel Survey, sagepub.com/journals-permissions, journals.sagepub.com/home/fmx, Field Methods1-21, DOI: 10.1177/1525822X20901802
Tuckman, B.W. (1999). Conducting Educational Research (5th ed). Orlando, FL: Harcourt Brace & Company.
Verner, E.M., Hect, J.B., & Fransler, G.A. (1998). Validating an instrument to assess the motivation of athletic donors. Journal of Sport Management, 12, 123–137.
Wann, D., Schrader, M., & Wilsen, A. (1999). Sport fan motivation: Questionnaire validation, comparisons by sport, and relationship to athletic motivation. Journal of Sport Behavior, 22(1), 114.
Wentland, E. J. (1993). Survey responses: An evaluation of their validity: Academic Press.
Werner, S., Praxedes, M., & Kim, H.-G. (2007). the reporting of nonresponse analyses in survey research. Organizational Research Methods, 10(2), 287-295.