UX Measurement Bootcamp 2022

MeasuringU UX Bootcamp 2022

5 Days of Intensive Training on UX Methods, Metrics and Measurement

Virtual for 2022, 5 hours/day

Event Dates: September 19 – September 23, 2022

Event Location: Online from 8am – 1pm (Pacific Time)

This is our 10th Annual Bootcamp, tailored for online learning.

Each year we’ve had a great group of participants from dozens of companies including:

Aetna, Amazon, American Airlines, Amica Insurance, Autodesk, BlackRock, Boeing, Charter Communications, Cisco, Citigroup, Google, IBM, John Deere, Rockwell Automation, Samsung, Spotify, Target, The Home Depot, Workday.

Participants receive:

  • a User Experience Research Certificate
  • 2.5 Continuing Education Credits from the University of Denver.
 
 
 
 

[My bosses] are thrilled with the possibilities that this opened up for us in terms of quantifying user feedback and behavior.

You gave me the tools and skills to give more credibility to my work…I am very grateful.

 

 

Course Details

This year the UX Measurement Bootcamp will be held online. Class times will be modified to work for online delivery.

Jeff Sauro, PhD & Jim Lewis, PhD will be the instructors.

The courses will be a mix of (1) lecture material and (2) practice learning and applying the methods (adapted for online delivery).

The online course cost is $3000 per participant.

This includes:

  • Access to the lectures and all online courses on MeasuringUniversityTM for 1 year.
  • Course Materials (valued at over $700)
  • A Downloadable Excel Statistics calculator
  • Up to 100 US-based participants for your group study conducted during the bootcamp on MUIQ
  • Certificate and Continuing Education Credit from the University of Denver

Contact us if you have more than 5 attendees or if you are interested in a custom bootcamp for your company.

I thought the bootcamp was extremely helpful. Jeff did a great job of teaching a lot of material in a short amount of time, and I am already using these ideas in my work.

We had a lot of fun and success in applying what I learned in the bootcamp to my work.

 


 

Topics Covered

  • An Overview of UX Methods & Metrics
  • Determining Customers’ Top Tasks
  • Making the Most of Unmoderated Usability Testing
  • UX Benchmarking
  • Testing the Information Architecture / Navigation of Websites
  • Card Sorting and Tree Testing
  • How to Present Quantitative UX Data
  • Best Practices for Survey Design and Analysis
  • Sample Size Calculations
  • Confidence Intervals & Statistical Comparisons
  • Making the Most of Small Sample Sizes
 
 
 
 


 

 
 

Bootcamp Course Schedule

(subject to change)

The UX Measurement Bootcamp now has a flipped classroom format, reducing the time spent on lectures for more dynamic interaction during the scheduled course times (but requiring some investment before each day’s course times watching prerequisite videos and taking online quizzes).

The bootcamp course times include a few interactive lectures, discussions of online content, visuals, witty jokes, and practice exercises, along with hands-on workshops focusing on more detailed topics. Each day will have five hours of class time with two 15-minute breaks.

A significant portion of the bootcamp is spent on having teams actually conduct research with our MUIQ® platform to collect real-world data for analysis and reporting, applying the lessons learned in online training and in-class discussion/exercises.

Schedules and topics may change based on participants’ backgrounds and current needs.

Day 1

Monday

Prerequisites
Before starting the bootcamp on Monday, attendees will receive access to bootcamp-related courses on MeasuringUniversity™, our online training center. The prerequisite videos/quizzes to complete before the bootcamp begins on Monday morning are:

  1. UX Methods (60 min): A review of common methods for measuring usability and user experiences.
  2. UX Metrics (60 min): A taxonomy of UX metrics including the difference between attitude and action metrics and how to determine the metric you need.
  3. Intro to Data Types (25 min): A tour of different types of data (qualitative vs. quantitative, discrete vs. continuous) and an introduction to levels of measurement.

Introductions
The day starts with a brief introduction to UX and introductions of instructors and attendees.

Study Development
Introducing our framework, based on the scientific method, for developing UX studies.

Picking the Right Methods and Metrics
Building on the prerequisite online training, we review key UX methods and metrics with in-class selection exercises.

Top Tasks Analysis
It’s difficult to do everything well all the time. One of the biggest problems in interactions we see in software and websites is that developers and designers think users are doing one thing when in fact users are doing something else. The top task analysis is a simple, yet powerful way of understanding what critical few tasks tend to affect the bulk of the user experience. We reinforce the online training with an in-class top-task exercise.

Introduction to MUIQ
During the bootcamp, attendees will work in teams to conduct an unmoderated usability study with our MUIQ tool. The first day ends with an exercise in developing a study script and the introduction of the MUIQ platform.

Day 2

Tuesday

Prerequisites

  1. Benchmarking Part 1 (38 min): Introduction to benchmarking essentials including what is it and why use it, when to use it, what type to use, and defining and getting access to users.
  2. Benchmarking Part 2 (41 min): Additional benchmarking essentials including task definition, metrics selection, measurement precision, and study length.
  3. Confidence Interval Demonstration (12 min): Physical demonstration of the accuracy of confidence intervals.
  4. Confidence Intervals: Intro and Rating Scales (48 min): Introduction to confidence intervals including their three ingredients, a quick stats review, and application to rating scale data.
  5. Confidence Intervals: Binary and Time Data (28 min): Confidence intervals for binary data (e.g., completion rates) and task time data.

Team Assignment
The day starts with the formation of research teams and some time for team members to start making decisions about the teams’ research projects.

Benchmark Review & Quiz Results
Next is a review of the online benchmarking content and quizzes.

Confidence Intervals Review and Exercises
Sampling users of any size involves sampling error. Confidence intervals provide the level of precision around estimates of findability, completion rates, likelihood to recommend, and any metric you collect from a sample of users. We review the prerequisite online content and go through additional confidence interval exercises.

Project: Design & Deployment
Throughout the day you’ll have two hours for you and your team to start setting up an unmoderated study (of your choosing), with personal guidance from MeasuringU team members.

Day 3

Wednesday

Prerequisites

  1. Hypothesis Testing Demonstration (25 min): Physical demonstration of hypothesis testing.
  2. Hypothesis Testing Intro (36 min): An introduction to the Null Hypothesis Significance Testing (NHST) framework, including discussion of significance levels and difference between statistical and practical significance.
  3. Hypothesis Testing – Conducting Tests (12 min): Considerations when conducting statistical tests (data types and experimental designs).

Hypothesis Testing Review & Exercises
With everyone wide awake on caffeine, we build on the online prerequisite courses, reviewing the content and going through additional in-class exercises.

Project: Design & Deployment
Throughout the day you’ll have 2.5 hours to complete the development of your project (in consultation with MeasuringU team members). Once ready, it will be launched overnight to collect real data from real participants so you can practice the analyses you’ve learned with real-world data.

Day 4

Thursday

Prerequisites

  1. Power and Sample Size Estimation – Intro and Problem Discovery (39 min): Introduction to three ways to determine the right sample size and discussion of sample sizes for problem discovery, including whether five users are enough and if more severe problems get discovered first.
  2. Power and Sample Estimation – Precision/Estimation (33 min): With a focus on sample sizes for confidence intervals, discusses precision requirements and different methods for different data types (binary vs. continuous).
  3. Power and Sample Size Estimation – Comparison (37 min): Discussion of how effect sizes and power affect sample size estimation for statistical hypothesis tests.

Observing & Coding Usability Problems
At the heart of usability testing, whether it be the do-it-yourself kind or the more industrial strength kind, is documenting, diagnosing and reducing usability problems. We will watch videos of users attempting to find the cost of dog grooming, documenting and discussing the usability problems.

Power and Sample Size Review & Exercises
How many users do you test? It’s one of the most common and confusing questions in applied user research. We review the prerequisite online content and go through additional sample size estimation exercises.

Project: Analyze Data & Prepare Presentations
Breaking again into project teams, you’ll get help in preparing your analyses, conducting statistical calculations, and presenting your findings.

Day 5

Friday

Project: Finish Analysis and Report Preparation
Breaking again into project teams, you’ll have 2.5 hours to complete your analyses, statistical calculations, and presentations.

Final Exam
Take and pass a final exam, 50 items based on quizzes taken online during the bootcamp (80% required to pass, no limit on number of times to attempt the test).

Presentations & Ending
We finish with team representatives giving their presentations, then wrapping up with a final Q&A.

Thank you for the wonderful training…loved it!

I love, love, loved the class! It was by far the best training that I’ve attended in my career (and I have been working for a very long time).

Jeff is a phenomenal speaker and teacher. He makes very difficult (and let’s face it, pretty dry) stuff fun to learn. Thanks for putting this on!

 

 


Course Faculty

Jeff Sauro Jeff Sauro will be the primary instructor for the bootcamp. He has taught UX research methods classes for companies including Google, Meta (Facebook), Netflix, Hulu, Autodesk, Cisco, Dropbox and Salesforce. Jeff has published over twenty-five peer-reviewed research articles and six books, including Benchmarking the User Experience, Customer Analytics for Dummies and Quantifying the User Experience.
Jim Lewis Jim Lewis will be the assistant instructor for the bootcamp. He spent 40 years as a UX researcher/consultant at IBM. While at IBM, he collaborated with Jeff on a number of projects, including co-authoring numerous books and conference papers (two of which were nominated for Best of CHI). He has published almost 100 research articles and papers, is on 91 US patents, and in 2020 joined MeasuringU as Distinguished User Experience Researcher.

 

 

Recording Disclaimer

By attending the virtual boot camp, you consent to audio recording, screen captures, and video recording to be used for news, promotional purposes, advertising, inclusion on websites, social media, or any other purpose by MeasuringU. Images, recordings and/or videos may be used to promote similar events in the future.

Substitution and Carry-Over Policy

Due to the customized nature of this training, we cannot offer refunds but we accept substitutions. Please contact us as soon as you know you will have a substitute. We may also carry over your registration for the following year.

Registration

Purchase tickets below to attend the event. Last day to register is September 12th, 2022.

0
    0
    Your Cart
    Your cart is emptyReturn to Shop
    Scroll to Top