Desktop Video Conferencing User Research and Design for Webinars

Project Details

what's it about?

Presenting the Webinar

With the COVID-19 pandemic, seminars have shifted online and webinars have been the norm for many since then. This prevalence has exposed multiple issues with the webinar format. This coincides with the module I took called NM2213 Introduction to User Experience, where we are tasked to design a desktop video conferencing application. For the project, my group decided to discover and solve such issues. Throughout, we discovered that gauging audience engagement and managing presentation tools were key problems. We sought out to develop our solution, Slife, to solve these problems. Our process is detailed below.

The Challenge: Conferencing App for Webinars

For the project, we decided to design a desktop video conferencing app tailor made for webinar use. This means targeting our feature set for webinar users; we decided to focus squarely on the speakers.

My Role

Our team had 3 members(myself, Jolyn and Shing Yee) sharing the workload. My personal role includes spearheading the team for both user research and design, doing my share of interviewing and usability testing as well as designing of the screens.

Constraints

We had the following constraints that stem from the module itself:

  • compact timeline of 6–7 weeks to carry out entire project
  • minimal budget
  • weekly deliverable for the module for each step of the project, resulting in having a short timeframe of 1 week to carry out user interviews + analysis and 1 week to carry out usability testing
  • could only use Miro for the prototype with the wizard of oz technique to simulate interactions

The Kickoff: Exploring the Problem Space

To find out more about the problem space, we did some preliminary desk research followed by carrying out a total of 6 user interviews. From our preliminary desk research, we found out there are multiple types of webinars. Of which we decided to narrow our scope to education/keynote type webinars where the speaker educates the audience about a subject.

We recruited our interviewees according to this narrowed scope, doing 3 user interviews each for webinar speakers and audience. This allows to gain insight on key pain points faced by both parties.

Making sense of the interviews

For the user interviews when exploring the problem space, we synthesised our findings with an affinity map each for speakers and audience. These revealed key insights, including:

Snapshot of affinity map with i-statements for gauging audience engagement, with colours corresponding to a specific interviewee
  • Speakers having difficulty gauging audience engagement as they don’t turn on their video. They got around it by interacting with the audience by periodically asking questions.
Snapshot of affinity map with i-statements for opening multiple screens, with colours corresponding to a specific interviewee
  • Speakers needing to open multiple screens to manage the different tools they use to interact with the audience.
  • Audience members are unable to get their questions answered on the chat as it is has a lot of spam.

We generated 2 personas based on the i-statements for future use as well.

Left: Farisah, an amalgamation of our speaker interviewees. Right: Sam, an amalgamation of our audience interviewees

(defining) The Problem

From the insights gained from our research, we were able to define possible problems to solve for the project. This led to us generating 3 main problem statements(in the form of user need statements):

  1. Farisah, an educator at Adam Khoo, needs to control audience interaction features on 1 screen, in order to be able to manage a webinar by herself.
  2. Farisah, an educator at Adam Khoo, wants to be able to gauge audience engagement and reactions in order to find out how to adjust her performance during the webinar.
  3. Sam, a student, wants to be able to ask questions without it being lost in an abundance of chat messages, in order to find out more about the industry.

We then decided to narrow our scope due to limited time constraint and focus on solving the speaker’s problems instead of both the speaker and the audience. Namely problems 1 and 2.

(reaching) The Solution

Coming up with ideas

Based on the 2 problem statements we then made a mind map to ideate for possible solutions. We also have a specific branch of the mind map called “Worst Possible Ideas”. It allows us to get our worst ideas out of the way and the creative juices flowing.

Sample mind map for gauging audience engagement problem statement, highlighting the worst possible ideas branch

We voted on our ideas and settled on 3 main ones:

Slide Actions
  • What: Slide actions is a feature, where upon reaching a slide, an interaction touchpoint is sent to the audience.
  • Problem solved: Managing tools during the webinar on 1 screen
  • How: The speaker does not have to fiddle with an external tool, instead the slide action is sent out automatically upon reaching the slide.

Initial designs for slide actions can be seen below, such as setting up a poll to be sent out upon reaching a slide:

And what it looks like during the webinar itself:

Emoji Requests
  • What: Emoji Requests, which prompts audience members to respond with a selection of emojis.
  • Problem solved: Gauging audience engagement
  • How: The feedback received from the audience gives information to the speaker on how the audience is feeling and thus adjust his/her performance accordingly

Initial designs for emoji requests can be seen below, such as setting up an emoji request to be sent out upon reaching a slide:

And what it looks like during the webinar itself:

Customising Speaker View
  • What: Allowing the speaker to customise their screen when presenting, including elements(termed screen choices) like audience chat/q&A, speaker notes and more.
  • Problem solved: Managing tools during the webinar on 1 screen
  • How: The user can designate spaces in the viewport for the tools they want at all times during the webinar.
Key Screen for Customising Speaker View, where the user can open the screen choices drop down to fill the empty window spaces with windows such as Speaker Notes, audience Q&A and more.

(Carrying out) The Test

We carried out usability testing with 3 speakers and validated our solutions as helping to solve the problems we have chosen. However, this also exposed 2 main issues with the design.

Done button + Confirm button is confusing for the user

Before: There is both a confirm and done button. The confirm button is to finalise the slide action(poll) added to the specific slide. The done button is used for finalising slide actions added for all slides.

Both a done and confirm button was present in the initial design

What’s wrong: From our testing, after confirming, users do not know that they have to click “Done” to end the add polls action and move onto other actions

After: This was fixed by doing without the extra done button by having an autosave feature for the local changes for that specific automated action.

An autosave does away with the need for an extra confirm button

Did not know where to find the possible screen window choices due to unclear instructions

Before: There was a one liner instruction: “Click and drag screen choices for desired window onto screen” to guide the user into accessing a dropdown containing possible screen choices. These screen choices can be dragged into the empty window to fill its space.

Screen choices dropdown and instruction present in the original design

What’s wrong: The instruction was confusing to the user and they did not understand it. In fact, the users also did not understand what the term “Screen Choices” meant and thus whats inside the dropdown menu.

After: Instead of having a dropdown, we pinned the choices as an always visible sidebar. Next to it is an “i” icon that on hover reveals an information tooltip for further explanation. There is also a plus button for empty spaces to also add the screen choice in the empty space itself. This addresses the problem of unclear instructions and users inability to locate screen choices with the drop-down menu previously.


Screen choices is present on a sidebar with a tooltip explaining things, with a plus button to also fill up the space on the empty window itself

Running Heuristics

We carried out a heuristic evaluation for the prototype as well. We utilised Jacob Nielsen’s 10 Usability Heuristics as a basis to evaluate this newer version of the prototype.

In general, we feel that the revised prototype is user friendly for the most part. However, more work can be done to allow the user to have more control and freedom and not let them go through an extended dialogue to leave the unwanted state i.e. have more recovery actions.

Common Heuristic Issues Identified within the team

The (final) Solution: Introducing Slife

The final solution is called Slife (Slide + Life). It consists of 3 main features:

  1. Customising Speaker View
  2. Slide Actions
  3. Emoji Requests

The finalised interactions are shown below for each feature.

Customising Speaker View

Speakers can add different screen choices such as speaker notes to the empty window

Slide Actions

Speakers can add a slide action, for example a poll, to be sent to audiences at slide 2

Upon reaching slide 2 during the webinar, speakers can send out the slide action set up to the audience to interact with. Results are received and speakers can choose to display it to the audience too. (no changes from initial design)

Emoji Request

Speakers can add a slide action, in this case an Emoji Request, to be sent to audiences at slide 2

Upon reaching slide 1, emoji requests can be sent out to audience. Feedback is received by the speaker allowing them to adjust their performance. (no changes from initial design)

The Reflection: Satisfied with Room for Improvement

Overall, we produced a relatively interesting solution for the problem statement provided which also has been validated via usability testing. We did our due diligence for each step even with limited time.

There is definitely room for improvement, such as doing:

  • more interviews to get more insights as well as to further validate the insights(3 users per i-statement is not particularly strong as an insight).
  • more usability tests to expose more problems with the design
  • more ideation techniques to possibly think of better solutions to the problem

To end off, the main lesson learnt was that it is completely okay to not decide on an exact problem and target audience, the final decision can be made after exploring the problem space.

Contents