2 Days of Intensive Training on UX Methods, Metrics and Measurement
Event Date: June 10 – June 11, 2020
Event Location: Milan, Italy
Early bird registration is available until May 1st, 2020.
Each year we’ve had a great group of participants from dozens of companies including:
Aetna, Amazon, American Airlines, Amica Insurance, Autodesk, BlackRock, Boeing, Charter Communications, Cisco, Citigroup, Google, IBM, John Deere, Rockwell Automation, Samsung, Spotify, Target, The Home Depot, Workday.
● a User Experience Research Certificate
● 2.5 Continuing Education Credits from the University of Denver.
[My bosses] are thrilled with the possibilities that this opened up for us in terms of quantifying user feedback and behavior.
You gave me the tools and skills to give more credibility to my work…I am very grateful.
Registration available starting January, 2020. The early registration discounted cost is $2,800 US per participant (through May 1st). The regular price is $3,100.
This is the same material covered in our Denver event.
● Daily Breakfast, Lunch and Two Daily Breaks
● Course Books, Binders and Materials (valued at over $700)
● Software Licenses (downloadable Excel calculators)
● Up to 100 participants for your study
● Certificate and Continuing Education Credit from the University of Denver
The classes will run from approx. 8am-6:30pm both days with breakfast, lunch and a morning and afternoon break. Jeff Sauro PhD will be the instructor. The courses will be a mix of lecture material and hands on practice learning and applying the methods.
All classes will be held in Milan, Italy (address details coming soon).
I thought the bootcamp was extremely helpful. Jeff did a great job of teaching a lot of material in a short amount of time, and I am already using these ideas in my work.
We had a lot of fun and success in applying what I learned in the bootcamp to my work.
● An Overview of UX Methods & Metrics
● Determining Customers’ Top Tasks
● Making the Most of Unmoderated Usability Testing
● UX Benchmarking
● Testing the Information Architecture / Navigation of Websites
● Card Sorting and Tree Testing
● How to Present Quantitative UX Data
● Best Practices for Survey Design and Analysis
● Sample Size Calculations
● Confidence Intervals & Statistical Comparisons
● Making the Most of Small Sample Sizes
Boot camp Course Schedule (subject to change)
The UX Measurement Bootcamp will involve mornings with interactive lectures, visuals, witty jokes, and practice exercise. Afternoons will involve more hands-on workshops focusing on more detailed topics. Schedules and topics may change based on participants’ backgrounds and current needs.
|Introduction to Usability & User Measurement
A 100 year history of usability in pictures, people and events followed by a discussion of how usability is defined and measured across dozens of organizations. We will review common methods for measuring usability. This will follow Chapters 1-2 in Quantifying the User Experience.
|Top Tasks Analysis
It’s difficult to do everything well all the time. One of the biggest problems in interactions we see in software and websites is that developers and designers think users are doing one thing when in fact users are doing something else. The top task analysis is a simple, yet powerful way of understanding what critical few tasks tend to affect the bulk of the user experience.
|Benchmark Usability Testing
We will review a case study for two online rental car company websites using the standard usability metrics to understand how to obtain a valid usability benchmark and set the foundation for statistical decision making with UX metrics.
|Findability & Tree Testing
Despite improvements in search technology, browsing is still a dominant strategy used by most users. At the heart of findability problems is a navigation with a confusing structure and poorly chosen category labels. We will discuss how to conduct a tree-test to isolate and generate a valid quantitative baseline measure of findability. We will explore strategies for improving findability through card sorting and cross-linking and then comparing a new navigation structure to the baseline.
Sampling users of any size involves sampling error. Confidence intervals provide the level of precision around estimates of findability, completion rates, likelihood to recommend, and any metric you collect from a sample of users. We will cover both the concepts of confidence intervals and normal theory and how to apply this practice on any sample from 2 to 200,000 users. This will follow Chapter 3 in Quantifying the User Experience.
|Programming and Launching an Unmoderated Study in MUIQ
After covering the different methods, now you get hands on experience with agile research by creating a study in our unmoderated platform MUIQ. The MeasuringU team will give you hands-on instruction in going through setting up and preparing to analyze an unmoderated study (solo or in groups) and prepare to launch it to collect real data from targeted participants. We’ll collect the data overnight for your to analyze and present on the 2nd day.
|Hypothesis Testing & Statistical Significance
With everyone wide awake on caffeine, we will get into both the theoretical and practical applications of testing hypotheses in the user experience. We will cover the basics of statistical testing and get practice determining if two websites or designs are statistically different. Participants will receive a comprehensive Excel calculator and guide to walk them through how to conduct statistical tests for the most common situations in applied user research. This will follow Chapters 5 and 10 in Quantifying the User Experience.
|A/B Testing and Metric Comparisons
We will continue getting practice forming hypotheses and testing the differences in designs by going more in depth into conducting A/B tests and determining if two designs are statistically significant at small and very large sample sizes. We will focus on balancing practical significance with statistical significance through a series of examples and exercises.
|Observing & Coding Usability Problems
At the heart of usability testing, whether it be the do-it-yourself kind or the more industrial strength kind, is documenting, diagnosing and reducing usability problems. Following up from the early quantitative benchmark data we will watch videos of users attempting to rent a car and document and discuss the usability problems.
|Power and Sample Size Calculations
How many users do you test? It’s one of the most common and confusing questions in applied user research. Instead of relying on vague rules of thumb, you’ll learn how to compute sample sizes for making comparisons, discovering problems in usability tests, and for survey research.
|Final Analysis & Project Presentations
You’ll get help in preparing your analysis and statistical calculations then present your findings.
Thank you for the wonderful training…loved it!
I love, love, loved the class! It was by far the best training that I’ve attended in my career (and I have been working for a very long time).
Jeff is a phenomenal speaker and teacher. He makes very difficult (and let’s face it, pretty dry) stuff fun to learn. Thanks for putting this on!
|Jeff Sauro will be the primary instructor for the bootcamp. He has taught UX research methods classes for companies including Netflix, Autodesk, Cisco, Dropbox and Salesforce. He is an adjunct instructor at the University of Denver.|
Substitution and Carry-Over Policy
Due to the customized nature of this training, we cannot offer refunds but we accept substitutions. Please contact us as soon as you know you will have a substitute. We may also carry over your registration for the following year.
Invoices & Purchase Orders
Please contact us if you need to pay using an invoice/purchase order or by bank transfer.