Building a strong patient reported outcome instrument – What Really Goes Into It

Research updated on July 18, 2025
Author: Santhosh Ramaraj

Creating a patient reported outcome (PRO) instrument is not quick or easy. It often takes significant time, planning, and funding. At first glance, it might seem like just a list of health questions, but there is a lot more to it. Every item must reflect something meaningful to the patient. Without that connection, the results can be unclear or misleading. In the previous article, we discussed about what are PROs. In this, we will talk about PRO instrument.

You may ask what is an instrument. An instrument is a structured tool used to collect data or measure something specific. It’s not a physical object like a thermometer, but usually a questionnaire, survey, or rating scale designed to capture information about a person’s health, symptoms, behaviors, or quality of life.

Example instruments:

  • A fatigue severity scale with 9 questions
  • A depression rating scale like the PHQ-9
  • A quality of life survey for cancer patients

To be useful in clinical trials or real-world care, an instrument must be: Valid (measures what it should), Reliable (consistent over time), and Clear and relevant to patients.

Start with what matters to patients

The first step is content validity. This is about making sure the instrument truly measures what it says it does. You begin by listening to patients. You talk to them about their condition, how it affects their lives, and what matters most to them. These conversations help uncover the language and ideas that the questionnaire should include.

To get this right, researchers use qualitative methods. That means interviews, focus groups, expert panels, and discussions that go deep into patient experiences. When you hear the same themes again and again, you begin to see what matters most. That is what goes into the questions.

The power of qualitative research

For PRO instruments to work, they need to be grounded in real life. That is why qualitative research is so valuable. It helps you explore how patients think and feel in a structured way. The most common method for this is called grounded theory. It focuses on finding patterns and relationships between ideas that patients express.

Another important concept is saturation. This happens when you collect enough patient input that no new ideas are coming up. It means you can feel confident that the main concerns of the group have been covered. Reaching saturation shows you are ready to move forward with building the questionnaire.

Building a conceptual framework

From all that listening and research, a picture begins to form. Researchers call this the conceptual framework. It is a visual map of how symptoms, ideas, and impacts connect. This framework helps guide which questions are created and how they are grouped.

Clinicians often help refine the framework. Literature reviews also help to confirm that nothing important has been missed. Once the framework is in place, the draft questions can be tested with more patients. The goal is to make sure the final instrument is clear, relevant, and complete.

Understanding the types of validity

Once the instrument is drafted, it goes through several validation steps. These are used to confirm that the tool works the way it should. Different types of validity help answer different questions.

Here are some of the main types:

  • Content validity confirms that the right ideas are being measured
  • Construct validity checks that the tool fits with the theory behind it
  • Convergent validity shows that related measures produce similar results
  • Divergent validity checks that unrelated measures are not confused
  • Known groups validity tests if the tool can tell different patient types apart
  • Criterion validity includes comparisons with current or future outcomes
  • Factor analysis explores how different questions group together

Each type of validity adds another layer of confidence. The stronger the evidence, the more useful the PRO tool becomes.

Disclaimer: This article is for educational purposes only.