Process + methodology

We are sourcing from a non-probability frame and the two main sources we use are:

1. Traditional online access panels — where respondents opt-in to take part in online market research for an incentive
  • To grow the online panel, there are several channels that can be utilized, including: social media campaigns, affiliate networks and direct publisher relationships.
      • Trusted recruitment partners are used to select the affiliates and other publishers best suited to our requirements; if there are any data concerns with incoming joins they are removed and replaced.
      • Once confirmed, recruitment partners work with their affiliates and other partners to get traffic into the landing page and registration survey and will make continuous tweaks to messaging and targeting to assist with targeting based on the profiling available.
      • The depth of targeting varies by partner, but for those that do not utilize heavily profiled traffic sources they instead have direct relationships with different niche/special interest groups that fit the targeting.
      • All recruitment campaigns require a dedicated landing page to direct traffic to, which include additional information on the panel including research topics (if appropriate to share), incentives on offer and typical lengths of interviews. The landing page helps provide potential joiners the information they need to decide if they’d like to proceed, in order to reduce dropouts and help drive higher participation rates among those who join.
      • All recruits are based on collecting double opt-ins, verifying the respondents’ email is legitimate. To track DOIs, the ability to place post-back pixels at the double opt-in stage is required to track conversions live, which gives the ability to monitor conversions and make necessary traffic adjustments.
  • Depending on the intended panel size, campaigns run anywhere from 2 weeks to 6+ months, and channels and sources are constantly optimized to ensure the highest quality sources are being prioritized and underperforming ones are closed.
2. Programmatic — where respondents are online and are given the option to take part in a survey to receive a virtual incentive usually related to the online activity they are engaging in

All respondents have consented to be contacted to take part in online market research interviews, and alongside this, they have provided additional information about themselves to assist with their future selection for such interviews. They also then gave informed consent to take part in this specific research — having been provided with all the relevant information about the content of the survey, who is conducting it and how their answers will be used.

Those who do not fit the specified sample are terminated from the survey. As the survey is fielded, dynamic online sampling is used, adjusting targeting to achieve the quotas specified as part of the sampling plan.

Regardless of which sources a respondent comes from, they are directed to an online survey, where the survey is conducted in English (unless otherwise noted). Respondents are awarded points for completing the survey. These points have a small cash-equivalent monetary value.

Cells are only reported on for analysis if they have a minimum of 80 respondents, and statistical significance is calculated at the 95% level. Data is not weighted, but quotas and other parameters are put in place to reach the desired sample.

Interviews are excluded from the final analysis if they failed quality-checking measures. This includes:

  • Speeders: Respondents who complete the survey in a time that is quicker than one-third of the median length of interview are disqualified as speeders
  • Open ends: All verbatim responses (full open-ended questions as well as “other (please specify)” options) are checked for inappropriate or irrelevant text
  • Bots: Captcha is enabled on surveys, which allows the research team to identify and disqualify bots
  • Duplicates: Survey software has “deduping” based on digital fingerprinting, which ensures nobody is allowed to take the survey more than once

While all reasonable efforts have been made to ensure quality responses were collected, there are limitations with the data, due to unmeasured error that’s associated with all forms of public opinion research. It is also worth noting that our surveys are only available to individuals with internet access, and the results may not be generalizable to those without internet access.

For more information on the research, please contact questions@talkerresearch.com