Products

SurveyMonkey is built to handle every use case and need. Explore our product to learn how SurveyMonkey can work for you.

Get data-driven insights from a global leader in online surveys.

Integrate with 100+ apps and plug-ins to get more done.

Build and customise online forms to collect info and payments.

Create better surveys and spot insights quickly with built-in AI.

Purpose-built solutions for all of your market research needs.

Templates

Measure customer satisfaction and loyalty for your business.

Learn what makes customers happy and turn them into advocates.

Get actionable insights to improve the user experience.

Collect contact information from prospects, invitees and more.

Easily collect and track RSVPs for your next event.

Find out what attendees want so that you can improve your next event.

Uncover insights to boost engagement and drive better results.

Get feedback from your attendees so you can run better meetings.

Use peer feedback to help improve employee performance.

Create better courses and improve teaching methods.

Learn how students rate the course material and its presentation.

Find out what your customers think about your new product ideas.

Resources

Best practices for using surveys and survey data

Our blog about surveys, tips for business and more.

Tutorials and how-to guides for using SurveyMonkey.

How top brands drive growth with SurveyMonkey.

Contact SalesLog in
Contact SalesLog in

2 tips for writing agree/disagree survey questions

Your healthcare provider cares about you—and they also care that you come back. So after a doctor visit, many of you may receive a feedback survey asking about your experience. A key question might look like this:

Do you agree or disagree with the following statement: My health provider spent enough time with me addressing my needs.

  • Strongly agree
  • Somewhat agree
  • Neither agree nor disagree
  • Somewhat disagree
  • Strongly disagree

In the field of survey research, this is called an agree/disagree question (it’s named after the answer options it uses). This question type uses an agree, disagree scale. Essentially, an agree, disagree scale is a range of answer options that go from strongly agree to strongly disagree. It allows respondents to answer more precisely and it provides you with more nuanced survey responses to analyze. This type of question has been extremely popular among survey researchers for decades. Why?

Well, they’re easy to write—and it’s a pretty standard question that’s used across industries. That being said, research has revealed some challenges with this question type. We’ll go over two such challenges and share our tips on how to overcome them in a snap.

The seemingly simple agree/disagree construct has what’s called an acquiescence response bias. What we mean by that is, in general, people who answer surveys like to be seen as agreeable. So they’ll say they agree when given the choice, regardless of the actual content of the question.

Another challenge is that the agree/disagree question appears to be so straightforward that researchers sometimes write a whole bunch of questions using the same answer choice options. Then, they put the questions into a matrix question type.

Since an agree/disagree matrix question type packs a lot of information in a small space—it’s essentially one question that asks respondents to agree or disagree with a series of statements—respondents may not be careful about how how they answer these questions.

We call this phenomenon straight-lining. (Basically, straight-lining is when a respondent moves down a series of statements too quickly, selecting the same answer choice for all.)

Obviously, this is a major problem if you’re trying to collect accurate data. And, in the case of your doctor’s office, as a result of straight-lining, you won’t be able to use the data you collect to improve services and make informed decisions.

In order to force all questions into the same format, survey designers need to come up with a rating subject for each question. In the example above, respondents are asked to rate the statement that their health provider spent enough time with them. The same question can also be asked as “not enough time” or “too much time.”

Say one healthcare clinic wants to compare its level of patient satisfaction with another’s—if their question wordings are different, it’s difficult than to make a meaningful comparison.

Now, you must be wondering how to ask patients about their satisfaction levels if you’re a health provider? Let’s look at another question.

How satisfied or dissatisfied were you with the amount of time your health provider spent with you addressing your needs?

  • Very satisfied
  • Somewhat satisfied
  • Neither satisfied nor dissatisfied
  • Somewhat dissatisfied
  • Very dissatisfied

This type of question is called an item specific question. Meaning that response options are specific to the survey question. Different questions have a different set of response options.

Research has shown that item specific rating scales are much less prone to an acquiescent response bias. Also, a group of researchers from both Spain and the U.S. have experimentally compared item specific and agree/disagree scales in 14 European countries and found that in general the reliability and validity of item specific scales are superior to those of agree/disagree scales.

Now it’s your turn to design a rating scale. And don’t forget to check out the SurveyMonkey Question Bank when designing your survey. There’s a ton of item-specific scales for you to choose from out of the thousands of methodology-certified questions available!

Toolkits Directory

Discover our toolkits, designed to help you leverage feedback in your role or industry.

Survey Best Practices

Learn our survey best practices to make the most of your next survey. Explore our survey guidelines and get started today, for FREE!

Easily create and customise online application forms

Easily create and customise application forms. Customise their design, collaborate with your team live and launch faster with our free templates.

Discover SurveyMonkey Enterprise features

Manage feedback at scale with SurveyMonkey enterprise-grade security features, privacy and compliance standards and data integrations.