• Sign In to gain access to subscriptions and/or My Tools.
Impact Factor:1.525 | Ranking:Social Sciences, Interdisciplinary 15 out of 93 | Information Science & Library Science 24 out of 86 | Computer Science, Interdisciplinary Applications 51 out of 104
Source:2016 Release of Journal Citation Reports, Source: 2015 Web of Science Data

Metrics and Design Tool for Building and Evaluating Probability-Based Online Panels

    1. Charles DiSogra1
    2. Mario Callegaro2
    1. 1Advance Methods Group, Abt SRBI, New York, NY, USA
    2. 2Quantitative Marketing Team, Google UK Ltd., London, United Kingdom
    1. Charles DiSogra, Abt SRBI, 275 Seventh Avenue, Suite 2700, New York, NY 10001, USA. Email: c.disogra{at}srbi.com

    Abstract

    Probability-based online panels are beginning to replace traditional survey modes for existing established surveys in Europe and the United States. In light of this, current standards for panel response rate calculations are herein reviewed. To populate these panels cost-effectively, more diverse recruitment methods, such as, mail, telephone, and recruitment modules added to existing surveys are being used, either alone or in combinations. This results in panel member cohorts from different modes complicating panel response rate calculations. Also, as a panel ages with inevitable attrition, multiple cohorts result from panel refreshment and growth strategies. Formulas are presented to illustrate how to handle multiple cohorts for panel metrics. Additionally, drawing on relevant metrics used for a panel response rate, we further demonstrate a computational tool to assist planners in building a probability-based panel. This provides a means to estimate the recruitment effort required to build a panel of a predetermined size.

    Article Notes

    • Declaration of Conflicting Interests The authors declared following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Some concepts presented in this paper were originally discussed in DiSogra, C., & Callegaro, M. (2010). Computing response rates for probability-based online panels. in AMSTAT (Ed.), Proceedings of the Joint Statistical Meetings, Survey Research Methods section (pp. 5309–5320). Alexandria, VA: AMSTAT. This is a completely rewritten, updated, and more elaborated paper.

    • Funding The authors received no financial support for the research, authorship, and/or publication of this article.

    This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 3.0 License (http://www.creativecommons.org/licenses/by-nc/3.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).

    | Table of Contents
    Immediate free access via SAGE Choice

    This Article

    1. Social Science Computer Review vol. 34 no. 1 26-40
      SAGE Choice article
    1. Free via Creative Commons: CC
    2. All Versions of this Article:
      1. current version image indicatorVersion of Record - Dec 30, 2015
      2. OnlineFirst Version of Record - Mar 31, 2015
      3. OnlineFirst Version of Record - Mar 5, 2015
      What's this?
    3. References

    Share