Understanding Retrospective Probing
User feedback is critical to improving user experience. Without insights from observation, questionnaires, or probing, it is difficult to assess whether a product meets user needs.
Retrospective probing helps identify elements that positively or negatively impact user experience. It is typically conducted one-on-one and alongside other probe qualitative research methods. Probing can be open or closed, depending on the probe design.
The method is time-consuming, as each participant is probed individually. While surveys (including a retrospective survey) can scale feedback collection, they lack the depth of probing into user responses.
Method
Purpose
Advantages
Disadvantages
Open
Open retrospective probing enables participant-driven insights and qualitative responses without predefined constraints.
- Users freely express thoughts.
- Higher chances of identifying critical issues.
- Can reduce researcher bias if managed well.
Responses vary widely, making synthesis complex.
Closed
Closed retrospective probing uses predefined questions (yes/no or rating scales), often aligned with structured design thinking retrospective approaches.
- Easier to analyse patterns and draw conclusions.
- Can be conducted by less experienced researchers.
- Limited flexibility for participants.
- Not all experiences can be quantified or categorised.
Advantages of Retrospective Probing
1. Human-centred
Focuses on understanding user needs and improving experience.
2. Feedback-driven
Helps capture user reactions post-usage, informing product improvements and adoption.
3. Consolidated insights
Combines responses to highlight what matters most to users and what hinders experience.
Challenges of Retrospective Probing
1. Time-consuming
Requires individual probing unless replaced by surveys, which reduce depth.
2. Reliance on memory
Participants may struggle to recall details of their experience accurately.
3. Participant bias
Strong positive or negative experiences may skew feedback.