62
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      To submit your manuscript to JMIR, please click here

      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Web-Based Versus Traditional Paper Questionnaires: A Mixed-Mode Survey With a Nordic Perspective

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Survey response rates have been declining over the past decade. The more widespread use of the Internet and Web-based technologies among potential health survey participants suggests that Web-based questionnaires may be an alternative to paper questionnaires in future epidemiological studies.

          Objective

          To compare response rates in a population of parents by using 4 different modes of data collection for a questionnaire survey of which 1 involved a nonmonetary incentive.

          Methods

          A random sample of 3148 parents of Danish children aged 2-17 years were invited to participate in the Danish part of the NordChild 2011 survey on their children’s health and welfare. NordChild was conducted in 1984 and 1996 in collaboration with Finland, Iceland, Norway, and Sweden using mailed paper questionnaires only. In 2011, all countries used conventional paper versions only except Denmark where the parents were randomized into 4 groups: (1) 789 received a paper questionnaire only (paper), (2) 786 received the paper questionnaire and a log-in code to the Web-based questionnaire (paper/Web), (3) 787 received a log-in code to the Web-based questionnaire (Web), and (4) 786 received log-in details to the Web-based questionnaire and were given an incentive consisting of a chance to win a tablet computer (Web/tablet). In connection with the first reminder, the nonresponders in the paper, paper/Web, and Web groups were also present with the opportunity to win a tablet computer as a means of motivation. Descriptive analysis was performed using chi-square tests. Odds ratios were used to estimate differences in response rates between the 4 modes.

          Results

          In 2011, 1704 of 3148 (54.13%) respondents answered the Danish questionnaire. The highest response rate was with the paper mode (n=443, 56.2%). The other groups had similar response rates: paper/Web (n=422, 53.7%), Web (n=420, 53.4%), and Web/tablet (n=419, 53.3%) modes. Compared to the paper mode, the odds for response rate in the paper/Web decreased by 9% (OR 0.91, 95% CI 0.74-1.10) and by 11% (OR 0.89, 95% CI 0.73-1.09) in the Web and Web/tablet modes. The total number of responders for NordChild declined from 10,291 of 15,339 (67.09%) in 1984 and 10,667 of 15,254 (69.93%) in 1996 to 7805 of 15,945 (48.95%) in 2011 with similar declines in all 5 Nordic countries.

          Conclusions

          Web-based questionnaires could replace traditional paper questionnaires with minor effects on response rates and lower costs. The increasing effect on the response rate on participants replying for a nonmonetary incentive could only be estimated within the 2 Web-based questionnaire modes before the first reminder. Alternative platforms to reach higher participation rates in population surveys should reflect the development of electronic devices and the ways in which the population primarily accesses the Internet.

          Related collections

          Most cited references20

          • Record: found
          • Abstract: found
          • Article: not found

          The extended version of the Strengths and Difficulties Questionnaire as a guide to child psychiatric caseness and consequent burden.

          R. Goodman (1999)
          The Strengths and Difficulties Questionnaire (SDQ) is a brief behavioural screening questionnaire that asks about children's and teenagers' symptoms and positive attributes; the extended version also includes an impact supplement that asks if the respondent thinks the young person has a problem, and if so, enquires further about chronicity, distress, social impairment, and burden for others. Closely similar versions are completed by parents, teachers, and young people aged 11 or more. The validation study involved two groups of 5-15-year-olds: a community sample (N = 467) and a psychiatric clinic sample (N = 232). The two groups had markedly different distributions on the measures of perceived difficulties, impact (distress plus social impairment), and burden. Impact scores were better than symptom scores at discriminating between the community and clinic samples; discrimination based on the single "Is there a problem?" item was almost as good. The SDQ burden rating correlated well (r = .74) with a standardised interview rating of burden. For clinicians and researchers with an interest in psychiatric caseness and the determinants of service use, the impact supplement of the extended SDQ appears to provide useful additional information without taking up much more of respondents' time.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Web-based questionnaires: the future in epidemiology?

            The traditional epidemiologic modes of data collection, including paper-and-pencil questionnaires and interviews, have several limitations, such as decreasing response rates over the last decades and high costs in large study populations. The use of Web-based questionnaires may be an attractive alternative but is still scarce in epidemiologic research because of major concerns about selective nonresponse and reliability of the data obtained. The authors discuss advantages and disadvantages of Web-based questionnaires and current developments in this area. In addition, they focus on some practical issues and safety concerns involved in the application of Web-based questionnaires in epidemiologic research. They conclude that many problems related to the use of Web-based questionnaires have been solved or will most likely be solved in the near future and that this mode of data collection offers serious benefits. However, questionnaire design issues may have a major impact on response and completion rates and on reliability of the data. Theoretically, Web-based questionnaires could be considered an alternative or complementary mode in the range of epidemiologic methods of data collection. Practice and comparisons with the traditional survey techniques should reveal whether they can fulfill their expectations.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Response Rate and Completeness of Questionnaires: A Randomized Study of Internet Versus Paper-and-Pencil Versions

              Background Research in quality of life traditionally relies on paper-and-pencil questionnaires. Easy access to the Internet has inspired a number of studies that use the Internet to collect questionnaire data. However, Internet-based data collection may differ from traditional methods with respect to response rate and data quality as well as the validity and reliability of the involved scales. Objective We used a randomized design to compare a paper-and-pencil questionnaire with an Internet version of the same questionnaire with respect to differences in response rate and completeness of data. Methods Women referred for mammography at a Danish public hospital from September 2004 to April 2005, aged less than 67 years and without a history of breast cancer, were eligible for the study. The women received the invitation to participate along with the usual letter from the Department of Radiology. A total of 533 women were invited to participate. They were randomized to receive either a paper questionnaire, with a prepaid return envelope, or a guideline on how to fill in the Internet-based version online. The questionnaire consisted of 17 pages with a total of 119 items, including the Short Form-36, Multidimensional Fatigue Inventory-20, Hospital Anxiety and Depression Scale, and questions regarding social status, education level, occupation, and access to the Internet. Nonrespondents received a postal reminder giving them the option of filling out the other version of the questionnaire. Results The response rate before the reminder was 17.9% for the Internet group compared to 73.2% for the paper-and-pencil group (risk difference 55.3%, P < .001). After the reminder, when the participant could chose between versions of the questionnaire, the total response rate for the Internet and paper-and-pencil group was 64.2% and 76.5%, respectively (risk difference 12.2%, P = .002). For the Internet version, 97.8% filled in a complete questionnaire without missing data, while 63.4% filled in a complete questionnaire for the paper-and-pencil version (risk difference 34.5%, P < .001). Conclusions The Internet version of the questionnaire was superior with respect to completeness of data, but the response rate in this population of unselected patients was low. The general population has yet to become more familiar with the Internet before an online survey can be the first choice of researchers, although it is worthwhile considering within selected populations of patients as it saves resources and provides more complete answers. An Internet version may be combined with the traditional version of a questionnaire, and in follow-up studies of patients it may be more feasible to offer Internet versions.
                Bookmark

                Author and article information

                Contributors
                Journal
                J Med Internet Res
                JMIR
                Journal of Medical Internet Research
                JMIR Publications Inc. (Toronto, Canada )
                1439-4456
                1438-8871
                August 2013
                26 August 2013
                : 15
                : 8
                : e173
                Affiliations
                [1] 1Department of Public Health Section for General Practice Aarhus University Aarhus CDenmark
                [2] 2Department of Health Statistics Norwegian Institute of Public Health OsloNorway
                [3] 3THL National Institute for Health and Welfare HelsinkiFinland
                [4] 4NHV Nordic School of Public Health GothenburgSweden
                [5] 5University of Iceland and The Directorate of Health ReykjavikIceland
                [6] 6Sahlgrenska Academy Centre for Applied Biostatistics University of Gothenburg GothenburgSweden
                Author notes
                Corresponding Author: Lena Hohwü lena.hohwu@ 123456alm.au.dk
                Article
                v15i8e173
                10.2196/jmir.2595
                3757995
                23978658
                284329ef-8919-4cd3-8c7d-cf95c4db2939
                ©Lena Hohwü, Heidi Lyshol, Mika Gissler, Stefan Hrafn Jonsson, Max Petzold, Carsten Obel. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.08.2013.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.

                History
                : 12 March 2013
                : 24 April 2013
                : 24 May 2013
                : 25 June 2013
                Categories
                Original Paper

                Medicine
                mixed-mode survey,patient participation rate,web-based,paper,questionnaires,nonmonetary incentive

                Comments

                Comment on this article