Search Russell Research

Find a solution, case, or article

Enter at least two characters to search the site.

    Press Esc to close. Use Ctrl/⌘ K to search from anywhere.
    Research planning tools

    Survey length and respondent burden

    How much are you asking of respondents?

    Estimate survey time from the questions people will answer, the routes they follow, and the device they use. See where the work accumulates before you shorten the questionnaire.

    Build your survey inventoryInterpret your estimateResearch and sources

    Start with an editable questionnaire.

    The example has two qualified-complete routes and an early screen-out. Open each inventory block to change its format, content, and routing. All timing defaults are illustrative; they are not calibrated Russell benchmarks.

    Editable example · self-completion web survey

    View your result
    01 Set your planning context

    A note for your report. It does not apply demographic or language multipliers. No questionnaire or respondent data is uploaded or saved by this tool.

    An editable study constraint, not a universal quality threshold.

    Used for the mixed scenario. Assumed to be the same on every route.

    Routes and conditional follow-ups

    List complete paths through the survey, including each screen-out path you want to assess. Assign blocks below to every path that sees them. A complete route includes its screener; do not add screener time again.

    To calculate a weighted scenario, complete routes must be mutually exclusive, cover all qualified completes, and total 100%. Screen-outs are excluded. Unknown shares stay unweighted.

    02 Inventory the questionnaire

    Keep blocks in survey order. A block can represent identical repeated questions or one exercise. Open a row to edit wording, counts, routes, and burden signals. Set count to zero to omit it.

    1. Eligibility questions4 × Single choice / rating
    Routes that see this block

    Include instructions read before the question or media.

    Add time for finding records or consulting someone, beyond reading and answering. Zero means no allowance. These seconds are not multiplied for smartphones.

    Design review signals
    2. Category behavior6 × Multiple choice
    Routes that see this block

    Include instructions read before the question or media.

    Add time for finding records or consulting someone, beyond reading and answering. Zero means no allowance. These seconds are not multiplied for smartphones.

    Design review signals
    3. Read three concepts3 × Instructions / written stimulus
    Routes that see this block

    Include all written stimulus words here. Its evaluation questions belong in separate blocks.

    Add time for finding records or consulting someone, beyond reading and answering. Zero means no allowance. These seconds are not multiplied for smartphones.

    Design review signals
    4. Concept ratings3 × Grid / battery
    Routes that see this block

    Include instructions read before the question or media.

    Shared prompt and scale are read once per grid; each row adds wording and a response allowance.

    Add time for finding records or consulting someone, beyond reading and answering. Zero means no allowance. These seconds are not multiplied for smartphones.

    Design review signals
    5. Reasons for the ratings2 × Open-ended response
    Routes that see this block

    Include instructions read before the question or media.

    For example, a short phrase, sentence, or several sentences. Thinking and typing are separate assumptions.

    Add time for finding records or consulting someone, beyond reading and answering. Zero means no allowance. These seconds are not multiplied for smartphones.

    Design review signals
    6. Respondent profile5 × Single choice / rating
    Routes that see this block

    Include instructions read before the question or media.

    Add time for finding records or consulting someone, beyond reading and answering. Zero means no allowance. These seconds are not multiplied for smartphones.

    Design review signals

    Up to 40 blocks and 6 explicit routes. Complex loops or routing graphs need a separate review.

    03 Review the timing assumptions
    Reading, answering, typing, and device allowances

    These defaults are illustrative planning values, not calibrated Russell benchmarks or coefficients estimated from the cited studies. Replace them with assumptions appropriate to your questionnaire and population.

    Faster reading and typing use the upper speed. The slower scenario uses the lower speed. Response allowances use their lower and upper seconds respectively. Smartphone multipliers apply only to their named component.

    Assumption-based timing scenarios

    Time for each respondent route

    Choose a result scenario
    9.6–17.4minutes · qualified complete, including assigned screener

    An assumption range, not a confidence interval or a claim about “most respondents.” No timing model has been calibrated. The mixed scenario averages 60% smartphone and 40% desktop on this route.

    Desktop8.6–15.4 min

    Smartphone10.4–18.8 min

    The upper scenario exceeds your 15-minute planning limit. This is a time-budget comparison; it does not establish response quality.

    Where the minutes accumulate

    Survey order on this route. Bar lengths use the upper timing scenario; text gives both scenario values.

    1. Eligibility questions0.8–1.4 min

      Ends at 0.8–1.4 min

    2. Category behavior1.7–3.0 min

      Ends at 2.5–4.4 min

    3. Read three concepts1.6–2.5 min

      Ends at 4.1–6.9 min

    4. Concept ratings1.4–2.5 min

      Ends at 5.5–9.5 min · Primary outcome starts at 4.1–6.9 min

    5. Reasons for the ratings3.0–6.1 min

      Ends at 8.6–15.6 min

    6. Respondent profile1.0–1.8 min

      Ends at 9.6–17.4 min

    Largest time contributor

    Reasons for the ratings: 3.0–6.1 minutes. Review its purpose before removing questions.

    Fixed example. Enable JavaScript to edit.

    Methods and your report

    Timing sums reading, response work, and additional lookup for each included block. Media uses the larger of enforced exposure and viewing time. Specialist exercise totals replace these components. Scenario endpoints are summed without assuming a probability distribution.

    Keep the longer paths visible.

    Each row represents an entered route, not a simulated path. Screen-outs never reduce the qualified-complete estimate.

    Minutes by route and device
    Route / outcomeDesktopSmartphoneMixed
    Standard completeQualified complete6.1–10.46.9–11.86.6–11.2
    Complete with follow-upQualified complete8.6–15.410.4–18.89.6–17.4
    Early screen-outScreen-out / termination0.8–1.30.9–1.50.8–1.4

    Among the entered complete routes, Standard complete has the lowest lower scenario (6.6 min); Complete with follow-up has the highest upper scenario (17.4 min), using mixed devices.

    No route-weighted duration: route shares are unknown or unused. Review each complete path separately.

    Review the work respondents do.

    Signals for Complete with follow-up. They come from your inventory and declared concerns. They are review prompts, not measured burden scores or predictions of dropout.

    Timing alone does not establish whether a question is appropriate. Review primary outcomes in context before moving them earlier.

    Read three conceptsRepeated exposure

    Repeated exposure: Check whether every stimulus is necessary. Removing stimuli changes coverage and may change comparisons or required sample.

    Concept ratingsGrid interaction

    Grid interaction: Check 6 rows × 5 scale points on a phone. Shorter groups may ease navigation; this tool assigns no automatic time saving for splitting a grid.

    Reasons for the ratingsTyping · Required response

    Typing: Review 2 written responses of about 40 words each. A shorter or conditional probe changes the detail and respondent base you collect.

    Required response: Consider an appropriate skip or don't-know option. Requiring difficult answers can change participation; no dropout probability is estimated.

    Respondent profileSensitivity

    Sensitivity: Explain why the information is needed and review privacy and skip options. Sensitivity has no automatic seconds penalty.

    What if you omit a block?

    Compare one revision on Complete with follow-up. This preview keeps your inventory unchanged. Check the research trade-off before making a change.

    Omission scenario
    Current route
    9.6–17.4 min
    Without this block
    6.6–11.2 min
    Time removed
    3.0–6.1 min

    Omitting this block removes its measures or exposure. Check objectives, routing, comparability, and required respondent bases before editing the questionnaire.

    Only this route is compared. The exported report describes the current inventory, not this unapplied omission.

    Before fieldwork

    Use the estimate to decide what to test.

    The arithmetic makes assumptions visible. A pretest and pilot establish how the actual wording, programming, and audience affect the experience. A shorter survey still needs to collect the evidence your decision requires.

    Discuss your questionnaire
    What does the timing range mean?

    The endpoints combine your faster and slower reading, answering, and typing assumptions. They are planning scenarios, not measured percentiles or a confidence interval. Respondents can take longer because of interruptions, unfamiliar content, or access needs. Pilot the actual questionnaire before stating how long most people will take.

    Read the source guidance
    How should we enter branching and screen-outs?

    Define each complete path separately, then assign the blocks it includes. A detailed follow-up belongs only on the routes that see it. Include eligibility questions on qualified-complete routes as well as relevant screen-out routes. Screen-out time stays separate. Overlapping branches require explicit combination routes. This release does not parse or simulate routing graphs.

    Why separate smartphone and desktop timing?

    Reading, selecting answers, using grids, and typing can differ by device. The planner exposes separate component multipliers. Fixed media exposure, additional lookup, and thinking allowances stay unchanged. A specialist exercise uses its own full smartphone total. The default multipliers are editable assumptions, not coefficients estimated from the cited study.

    Read the source guidance
    What is included in a conjoint or MaxDiff block?

    Enter the whole exercise allowance from the specialist planner or your timing notes: instructions, practice, learning tasks, validation tasks, and any anchoring. Enter separate desktop and smartphone totals. Exclude the rest of the survey. This replaces generic block timing; do not add another block for the same instructions or questions. Reducing choice tasks changes the evidence available for analysis.

    Can a short question still impose substantial burden?

    Yes. A question may require sensitive information, unfamiliar judgments, or consulting organizational records. Mark those concerns and enter any additional lookup allowance. Sensitivity and declared complexity do not receive invented time penalties. The review prompts identify what to examine; they do not measure perceived burden.

    Read the source guidance
    Should we always shorten the longest block?

    Review its contribution to the research objective first. Removing a concept, required explanation, or primary outcome changes what you can conclude. The omission comparison shows arithmetic time savings and the trade-off. It does not recommend a statistically adequate revised design or predict better response quality.

    What should we check in a pilot?

    Test wording and comprehension with people similar to the intended respondents. Then test the programmed survey, routing, media, and controls on both devices. Review route-specific timings, pauses, missing responses, and participant feedback. Keep observed elapsed times distinct from adjusted active time; a slow response is not automatically invalid.

    Read the source guidance
    Does this tool check accessibility or predict dropouts?

    No. It provides review prompts for grids, media, required responses, and concerns you declare. Check the actual questionnaire's labels, instructions, keyboard controls, focus order, and media alternatives. No programmed-survey audit, dropout model, or universal burden score is included.

    Read the source guidance

    Research behind the approach

    Questionnaire features matter. Local timing data matters too.

    These sources support the choice of inputs and review topics. They do not validate this calculator's default coefficients or guarantee a survey duration. Sources reviewed September 29, 2026.

    1. Pew Research Center: How we keep our online surveys from running too long

      An example of organization-specific timing calibration. This tool does not adopt Pew's points as universal seconds.

    2. Gummer & Roßmann: Explaining Interview Duration in Web Surveys

      Question wording, options, and formats contribute to timing. Counting questions alone loses useful information.

    3. Antoun & Cernat: Factors affecting completion times

      A smartphone/PC crossover study supports examining device differences by task. Its overall ratio is not used as a universal multiplier.

    4. American Association for Public Opinion Research: Best Practices for Survey Research

      Guidance for wording, required responses, sensitive questions, pretesting, and pilot testing.

    5. U.S. Census Bureau: Measuring Respondents' Perceptions of Burden

      Burden includes effort and privacy as well as time. This tool keeps these review topics separate.

    6. W3C Web Accessibility Initiative: Forms Tutorial

      Guidance for labels, instructions, grouping, and accessible controls. The planner does not inspect a programmed survey.

    Plan a conjoint questionnairePlan a MaxDiff exerciseConcept and product testingB2B researchAll planning tools