Audio Video Analysis in User Research

Audio/video analysis is a flexible observation-recording method used to capture, review, and analyze user behaviour in specific scenarios. It often complements other research methods like interviews, guided tours, or task analysis to document user interactions with prototypes, products, or services—digital or physical.

Quick details:

Audio/ Video Analysis

Structure:

Semi-structured or Unstructured

Preparation:

Recording tools, Analysis tools, Participant Recruitment

Deliverables:

Audio/ Video data, Synthesis

Audio Video Analysis

More about Audio Video Analysis

Video is a sequence of images or frames displayed rapidly to create the illusion of continuous motion. Typically, videos run at 24-30 frames per second (fps), meaning a 5-second video at 15 fps consists of 75 individual frames. Alongside visuals, videos usually include an audio track.

In research, audio and video recordings capture interactions, processes, or scenarios. When visual recording is costly or unnecessary, researchers often rely on audio alone. The recorded audiovisual data is then analyzed to understand the events and behaviours during the session.

How to Conduct Audio Video Analysis Research

The essential equipment includes a camera (many phone cameras offer time-lapse recording), tripod, and remote. This setup can capture multiple users in the same scenario or the same users in different scenarios. The researcher and videographer roles can be separate. When researcher presence might influence participant behaviour, recordings can be preset and reviewed later.

Various techniques analyze audio and video data to study interactions involving people, digital products, and prototypes. The chosen technique depends on the research questions. Both audio and video data enable rich analysis and effective communication of findings across diverse audiences.

What are various types of Audio/ Video analysis?

The table below explains the various types of Audio/ Video analysis and their advantages and disadvantages

Method

Purpose

Advantages

Disadvantages

Open approach

The open approach allows for discoveries where no initial patterns have been identified, limiting any preconceived barriers by the designer.

  • Chances of identifying criticalities are higher.
  • As the researcher listens or views the recording with an open mind, the possibility of introducing bias or overlooking details is lower.

Different participants or user groups may approach the scenario being recorded differently, which can add complexity when consolidating findings.

Closed approach

The second approach is in direct contrast to open approach. Here, the researcher analyzes the footage for a specific event, or with respect to a specific hypothesis that matter to the participants and/or to the research project.

As the problem statement or the question to which the researcher is seeking answers is already defined, it is a quicker approach to open

  • Chances of introducing researcher bias.
  •  Chances of missed specific details because the researcher is looking for answers to existing questions.

Focused

In the focused approach, specific interactions are selected and examined for analysis. The focus is on a specific subject or content.

  • Quicker than the open approach.
  • The researcher can devote attention to specific portions of the footage.

Other areas of the audio or video that may be relevant to the subject under consideration may go unheard or unseen.

Advantages of Audio Video Analysis

1. Large sample sizes

Audios/videos can be recorded simultaneously for many individuals across various scenarios, with only the necessary recording equipment required.

2. Researcher presence

When a senior researcher cannot attend a session, recordings enable later review and detailed documentation of findings.

3. No researcher influences

Independent recordings prevent researchers from unintentionally affecting participant behaviour during sessions.

4. Missed details

Recorded media allows researchers to revisit sessions and capture details that might have been missed during live observation.

Challenges of Audio/Video Analysis

1. Time-consuming and costly

Reviewing and analyzing recordings require significant time. Increasing sample sizes demands more equipment and personnel, and expert participants may require compensation.

2. No probing

Without the researcher present during recording, interesting or unexpected user behaviours cannot be immediately explored or probed.

3. Researcher attitudes

Knowing sessions are recorded may lead researchers to feel less pressure during observations, relying on recordings to catch details later, which could affect engagement.

Think Design's recommendation

Audio Video Analysis is a powerful research tool, especially when other methods fall short. For instance, when designing a mobile app for livestock transactions, reviewing audio and video recordings helps assess the environment and user behaviour to create a context-sensitive app. It’s also crucial for security applications like monitoring threats via voice calls or surveillance footage.

Design researchers benefit from this method when live presence isn’t possible, as it provides quick retrospective insights. However, since Audio Video Analysis in user research is done after the fact, understanding the exact time and context of recordings is vital for accurate conclusions. Audio Video Analysis offers deep observational data but doesn’t replace real-time interaction or future scenario insights.

Get in Touch

Partner with us to bring your ideas to life.

Thank you for your feedback.