# Interviews

<figure>
<img src="img/antenna-cw-cj_nFa14-unsplash.jpg" style="width:70.0%" alt="Interviewing to gather data (Photo by Antenna on Unsplash)" />
<figcaption aria-hidden="true">Interviewing to gather data (Photo by Antenna on Unsplash)</figcaption>
</figure>

This week you will gain hands-on experience with designing and conducting semi-structured interviews. This is one of the most common data collection methods in HCI research. Importantly, interviews help us to gather information related to our known research goals as well as information that we don’t know to ask about.

<!--
- Define and identify the features of a semi-structured user interview
- Design an interview guide with well-defined themes and questions
- Evaluate interview questions through practice with other participants
- Reflect on the interview interactions and questions to refine your
  interview approach -->

## Pre-Class Tasks

You should complete the following activities prior to attending your tutorial:

1.  Read **Chapter 8 Data Gathering** in ([Rogers et al., 2023](#ref-rogers-beyond-hci:2023)). Available as an [ebook through the ANU Library](https://quicklink.anu.edu.au/kv9b).

2.  Read this resource: <https://www.nngroup.com/articles/interview-guide/>

3.  Post a forum post following the instructions below:

Go back to the interface/object that you discussed in the previous tutorial[^1].

Write five questions about this your interface or object. The questions are aimed at understanding *the experience that someone else had with that interface or object*.

Post your questions on the forum, along with a picture/sketch of the object.

4.  Comment on another person’s forum post following these instructions:

Find another person’s interface/object interview questions on the forum.

Answer one of the interview questions as a comment on their question. Make sure you list the number and question that you are answering.

Design a semi-structured interview guide on the topic of the pre-class task that you submitted last Week (Week 4). Last week you identified bad design features. This week, your goal is to explore the experience that someone else had with that object/interface or a similar one.

## Plan for the Class

<!-- 3.  Read the following paper to see an example of an interview guide
    (accessible through the ACM Digital Library):
    [Sara Ljungblad et al. 2021. What Matters in Professional Drone Pilots' Practice? An Interview Study to Understand the Complexity of Their Work and Inform Human-Drone Interaction Research. In Proc. CHI \'21.](https://doi-org.virtual.anu.edu.au/10.1145/3411764.3445737) [@ljungblad-what-matters:2021] -->

The tutorial will follow this structure:

0.  Intro and review pre-class tasks (20 mins)
1.  Analyse sample questions (20 mins)
2.  Designing a semi-structured interview guide (10 mins)
3.  Test interviews in pairs (30 mins)
4.  Reporting back and reflecting (10 mins)

## In-Class Tasks

### 0. Review pre-class tasks (20 minutes)

As a group, look through the pre-class tasks, you tutor will check your understanding of the interview questions posted in terms of the following discussion questions:

- What are the key differences between unstructured, structured and semi-structured interviews?
- What is a focus group?
- What is the difference between open and closed questions?
- What is the difference between leading and neutral questions?
- What are probing questions?
- What makes a good interview question?
- How might the type of questions influence the data you collect?

### 1: Analysing sample questions (20 minutes)

You will work in small groups of 3-5 students using the [interview question card deck](https://smcclab.au/thirty-nine-hundred-hci/resources/interview-question-cards.html) — open it on one group member’s laptop or phone. Each card shows one interview question drawn at random from a deck of 100; the codes and analysis stay hidden until you reveal them.

For each card, **before revealing**, agree as a group on:

- Is it **open (O)** or **closed (C)**?
- Is it **leading (L)** or **neutral (N)**?
- Is it a **probing (P)** question?
- Does it have another flaw: **double-barreled (D)**, **hypothetical (H)**, **solution-asking (S)**, **memory-taxing (M)**, or **vague/jargon (V)**? (The legend on the page explains each code.)

Then reveal the analysis and compare. For flawed questions the deck also holds a suggested rewrite behind a second reveal — **say your own fix out loud before revealing it**, then argue about whose version is better. Some cards are deliberately debatable — if your group disagrees with the card’s verdict, argue your case; that discussion is the point.

Work through cards for about 10 minutes, then:

1.  Pick the **two worst questions** you saw and agree on *why* they are the worst.
2.  **Rewrite both** so they would elicit useful data about a real experience.
3.  Swap your rewrites with a neighbouring group and check each other’s work: did the fix introduce a new flaw (e.g., did an open rewrite become double-barreled)?

Your tutor may also call out a card number for the whole class to analyse together.

### 2. Designing an interview guide individually (10 mins)

*You will undertake the following task by yourself, but feel free to discuss and ask for/provide help in your small groups:*

Expand your pre-class interview questions into a complete interview guide (don’t forget that this is covered in this week’s [resource](https://www.nngroup.com/articles/interview-guide/)). You may wish to incorporate feedback on your questions from earlier parts of the class.

The guide should:

1.  have a title
2.  briefly introduce the topic.
3.  include an ‘icebreaker question’ as a conversation starter
4.  include 5 main questions with example probing/follow up question
5.  include a prompt to thank your participants at the end

For an example interview guide, see this research paper: [Sara Ljungblad et al. 2021. What Matters in Professional Drone Pilots’ Practice? An Interview Study to Understand the Complexity of Their Work and Inform Human-Drone Interaction Research. In Proc. CHI '21.](https://doi-org.virtual.anu.edu.au/10.1145/3411764.3445737) ([Ljungblad et al., 2021](#ref-ljungblad-what-matters:2021))

### 3. Conducting your interview in pairs (30 mins)

Now you will test your interview guide on another person in the class. You will take turns being an interviewer and a participant. If the participant has no experience with the system being discussed you’ll have to pretend 🙃.

1.  **Everybody:** Choose another person from the tutorial to work with.
2.  **Interviewer:** Practice interviewing them using your guide. Try and ask at least one follow-up questions that relates to their responses, but was not in your original interview guide. Do not record or write down their responses, just listen carefully.
3.  **Participant:** Give the best responses you can, write down any feedback or suggestions you have for your interviewer.
4.  **After 10 minutes:** interview ends, participant provides feedback to interviewer, swap roles.

### 4. Reporting back and reflecting (10 mins)

The tutor will bring you back together for a whole group discussion to reflect on what you learnt and observed. Think about the following questions:

1.  Did your interview guide support your goal?
2.  What was your experience of designing your interview guide?
3.  What did you learn from testing your interview guide in a pair?
4.  How might you refine and improve your interview questions based on your experiences and the feedback that you received?

## Resources

- [Writing an Effective Guide for a UX interview](https://www.nngroup.com/articles/interview-guide/)
- [User Interviews 101 (nngroup)](https://www.nngroup.com/articles/user-interviews/)
- [6 Mistakes when crafting interview questions (nngroup)](https://www.nngroup.com/articles/interview-questions-mistakes)
- [The 3 types of user interviews: structure, semi-structured and unstructured (nngroup)](https://www.youtube.com/watch?v=jy-QGuWE7PQ)

## References

<div id="refs" class="references csl-bib-body hanging-indent" data-entry-spacing="0" data-line-spacing="2">

<div id="ref-ljungblad-what-matters:2021" class="csl-entry">

Ljungblad, S., Man, Y., Baytaş, M. A., Gamboa, M., Obaid, M., & Fjeld, M. (2021). What matters in professional drone pilots’ practice? An\&nbsp;interview\&nbsp;study\&nbsp;to understand the complexity of their work and inform human-drone interaction research. *Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems*. <https://doi.org/10.1145/3411764.3445737>

</div>

<div id="ref-rogers-beyond-hci:2023" class="csl-entry">

Rogers, Y., Sharp, H., & Preece, J. (2023). *Interaction design: Beyond human-computer interaction, 6th edition*. John Wiley & Sons, Inc. <https://quicklink.anu.edu.au/kv9b>

</div>

</div>

[^1]: If you did not complete the task last week or want to change interface/object, that’s ok.