5 Days of Intensive Training on UX Methods, Metrics and Measurement
Virtual for 2022, 5 hours/day
Event Dates: September 19 – September 23, 2022
Event Location: Online from 8am – 1pm (Pacific Time)
This is our 10th Annual Bootcamp, tailored for online learning.
Each year we’ve had a great group of participants from dozens of companies including:
Aetna, Amazon, American Airlines, Amica Insurance, Autodesk, BlackRock, Boeing, Charter Communications, Cisco, Citigroup, Google, IBM, John Deere, Rockwell Automation, Samsung, Spotify, Target, The Home Depot, Workday.
- a User Experience Research Certificate
- 2.5 Continuing Education Credits from the University of Denver.
[My bosses] are thrilled with the possibilities that this opened up for us in terms of quantifying user feedback and behavior.
You gave me the tools and skills to give more credibility to my work…I am very grateful.
This year the UX Measurement Bootcamp will be held online. Class times will be modified to work for online delivery.
Jeff Sauro, PhD & Jim Lewis, PhD will be the instructors.
The courses will be a mix of (1) lecture material and (2) practice learning and applying the methods (adapted for online delivery).
The online course cost is $3000 per participant.
- Access to the lectures and all online courses on MeasuringUniversityTM for 1 year.
- Course Materials (valued at over $700)
- A Downloadable Excel Statistics calculator
- Up to 100 US-based participants for your group study conducted during the bootcamp on MUIQ
- Certificate and Continuing Education Credit from the University of Denver
Contact us if you have more than 5 attendees or if you are interested in a custom bootcamp for your company.
I thought the bootcamp was extremely helpful. Jeff did a great job of teaching a lot of material in a short amount of time, and I am already using these ideas in my work.
We had a lot of fun and success in applying what I learned in the bootcamp to my work.
- An Overview of UX Methods & Metrics
- Determining Customers’ Top Tasks
- Making the Most of Unmoderated Usability Testing
- UX Benchmarking
- Testing the Information Architecture / Navigation of Websites
- Card Sorting and Tree Testing
- How to Present Quantitative UX Data
- Best Practices for Survey Design and Analysis
- Sample Size Calculations
- Confidence Intervals & Statistical Comparisons
- Making the Most of Small Sample Sizes
Bootcamp Course Schedule
(subject to change)
The UX Measurement Bootcamp includes interactive lectures, visuals, witty jokes, and practice exercises, along with hands-on workshops focusing on more detailed topics. Schedules and topics may change based on participants’ backgrounds and current needs.
Day 1 and 2
Monday – Tuesday
|Introduction to UX Methods and Metrics|
A 100 year history of usability in pictures, people and events followed by a discussion of how usability is defined and measured across dozens of organizations. We will review common methods for measuring usability and user experiences. This will follow Chapters 1-2 in Quantifying the User Experience.
|Top Tasks Analysis|
It’s difficult to do everything well all the time. One of the biggest problems in interactions we see in software and websites is that developers and designers think users are doing one thing when in fact users are doing something else. The top task analysis is a simple, yet powerful way of understanding what critical few tasks tend to affect the bulk of the user experience.
|Findability & Tree Testing|
Despite improvements in search technology, browsing is still a dominant strategy used by most users. At the heart of findability problems is a navigation with a confusing structure and poorly chosen category labels. We will discuss how to conduct a tree-test to isolate and generate a valid quantitative baseline measure of findability. We will explore strategies for improving findability through card sorting and cross-linking and then comparing a new navigation structure to the baseline.
Introducing our framework for developing UX studies, then breaking up into groups for an exercise in study development.
|Benchmark Usability Testing|
We will review a case study for two online rental car company websites using the standard usability metrics to understand how to obtain a valid usability benchmark and set the foundation for statistical decision making with UX metrics.
|Introduction to MUIQ (Team Formation & Study Goals)|
During the bootcamp, attendees will work in teams to conduct an unmoderated usability study with our MUIQ tool. The first day ends with introduction of the tool and formation of teams.
Sampling users of any size involves sampling error. Confidence intervals provide the level of precision around estimates of findability, completion rates, likelihood to recommend, and any metric you collect from a sample of users. We will cover both the concepts of confidence intervals and normal theory and how to apply this practice on any sample from 2 to 200,000 users. This will follow Chapter 3 in Quantifying the User Experience.
|Project: Design & Deployment|
In this two-hour workshop, we’ll give you and your team hands-on instruction in setting up and preparing to analyze an unmoderated study (of your choosing). Once ready, it will be launched to collect real data from targeted participants.
|Hypothesis Testing & Statistical Significance|
With everyone wide awake on caffeine, we will get into both the theoretical and practical applications of testing hypotheses in the user experience. We will cover the basics of statistical testing and get practice determining if two websites or designs are statistically different. Participants will receive a comprehensive Excel calculator and guide to walk them through how to conduct statistical tests for the most common situations in applied user research. This will follow Chapters 5 and 10 in Quantifying the User Experience.
|Project: Analyze Data & Prepare Presentations|
Breaking again into project teams, you’ll get help in preparing your analyses, conducting statistical calculations, and presenting your findings.
|Observing & Coding Usability Problems|
At the heart of usability testing, whether it be the do-it-yourself kind or the more industrial strength kind, is documenting, diagnosing and reducing usability problems. Following up from the early quantitative benchmark data we will watch videos of users attempting to find the cost of dog grooming, documenting and discussing the usability problems.
|Power and Sample Size Calculations|
How many users do you test? It’s one of the most common and confusing questions in applied user research. Instead of relying on vague rules of thumb, you’ll learn how to compute sample sizes for making comparisons, discovering problems in usability tests, and for survey research.
|Project: Finish Analysis and Report Preparation|
Breaking again into project teams, you’ll complete your analyses, statistical calculations, and presentations.
|Presentations & Ending|
We finish with team representatives giving their presentations, then wrapping up with a final Q&A.
Thank you for the wonderful training…loved it!
I love, love, loved the class! It was by far the best training that I’ve attended in my career (and I have been working for a very long time).
Jeff is a phenomenal speaker and teacher. He makes very difficult (and let’s face it, pretty dry) stuff fun to learn. Thanks for putting this on!
|Jeff Sauro will be the primary instructor for the bootcamp. He has taught UX research methods classes for companies including Google, Meta (Facebook), Netflix, Hulu, Autodesk, Cisco, Dropbox and Salesforce. Jeff has published over twenty-five peer-reviewed research articles and six books, including Benchmarking the User Experience, Customer Analytics for Dummies and Quantifying the User Experience.|
|Jim Lewis will be the assistant instructor for the bootcamp. He spent 40 years as a UX researcher/consultant at IBM. While at IBM, he collaborated with Jeff on a number of projects, including co-authoring numerous books and conference papers (two of which were nominated for Best of CHI). He has published almost 100 research articles and papers, is on 91 US patents, and in 2020 joined MeasuringU as Distinguished User Experience Researcher.|
Substitution and Carry-Over Policy
Due to the customized nature of this training, we cannot offer refunds but we accept substitutions. Please contact us as soon as you know you will have a substitute. We may also carry over your registration for the following year.
Purchase tickets below to attend the event.