Join us at MeasuringU for the UX Book Club Denver event on Wednesday, November 28th at 7:00 PM! At this event, Dr. Jeff Sauro presents an overview of his new book, Benchmarking the User Experience, and a talk on UX benchmarking.
Additionally, be ready for a night of networking and mingling with the accompaniment of drinks and appetizers.
You may find free street parking located around the block of our building (3300 E 1st Ave, Suite 370, Denver, CO 80202).
Benchmarking the User Experience is a practical book about how to measure the user experience of websites, software, mobile apps, products, or just about anything people use. This book is for UX researchers, designers, product owners, or anyone who has a vested interest in improving the experience of websites and products.
In this book, Jeff Sauro, Ph.D. uses practical examples to illustrate what benchmarking is and how you can use this technique to measure users’ experiences. Dr. Sauro uses many examples of studies from his company, MeasuringU, to give constructive information that will help you formulate and/or understand your benchmarking studies, which will ultimately help you understand your audience and customers.
Making Better Design Decisions With Data
Jeff Sauro, Ph.D., author of “Quantifying the User Experience,” will be a featured speaker at Rosenfeld Media’s virtual conference on “The Business Case for Design.”
He will be speaking from 10:00-10:50 AM (MST).
Dr. Sauro will be discussing topics that include: how to apply scientific thinking toward several design scenarios; how to form a testable hypothesis; ways to operationalize a study with the right tasks, metrics and methods; the importance of randomization to minimize nuisance variables; and analyzing data to differentiate real change from random noise.
● Certificate and Continuing Education Credit from the University of Denver
● Thursday Night Cocktail Reception
Classes will run from approx. 9am-5pm daily with lunch and a morning and afternoon break. Jeff Sauro will be the instructor. The courses will be a mix of lecture material and hands on practice learning and applying the methods.
All classes will be held on the University of Denver Campus.
I thought the bootcamp was extremely helpful. Jeff did a great job of teaching a lot of material in a short amount of time, and I am already using these ideas in my work.
We had a lot of fun and success in applying what I learned in the bootcamp to my work.
● An Overview of UX Methods & Metrics
● Determining Customers’ Top Tasks
● Making the Most of Unmoderated Usability Testing
● UX Benchmarking
● Testing the Information Architecture / Navigation of Websites
● Card Sorting and Tree Testing
● How to Present Quantitative UX Data
● Best Practices for Survey Design and Analysis
● Sample Size Calculations
● Confidence Intervals & Statistical Comparisons
● Making the Most of Small Sample Sizes
Bootcamp Course Schedule (subject to change)
The UX Measurement Bootcamp will involve mornings with interactive lectures, visuals, witty jokes, and practice exercise. Afternoons will involve more hands-on workshops focusing on more detailed topics. Schedules and topics may change based on participants’ backgrounds and current needs.
Introduction to Usability & User Measurement
A 100 year history of usability in pictures, people and events followed by a discussion of how usability is defined and measured across dozens of organizations. We will review common methods for measuring usability. This will follow Chapters 1-2 in Quantifying the User Experience.
Top Tasks Analysis
It’s difficult to do everything well all the time. One of the biggest problems in interactions we see in software and websites is that developers and designers think users are doing one thing when in fact users are doing something else. The top task analysis is a simple, yet powerful way of understanding what critical few tasks tend to affect the bulk of the user experience.
Benchmark Usability Testing
We will review a case study for two online rental car company websites using the standard usability metrics to understand how to obtain a valid usability benchmark and set the foundation for statistical decision making with UX metrics.
Findability & Tree Testing
Despite improvements in search technology, browsing is still a dominant strategy used by most users. At the heart of findability problems is a navigation with a confusing structure and poorly chosen category labels. We will discuss how to conduct a tree-test to isolate and generate a valid quantitative baseline measure of findability. We will explore strategies for improving findability through card sorting and cross-linking and then comparing a new navigation structure to the baseline.
Sampling users of any size involves sampling error. Confidence intervals provide the level of precision around estimates of findability, completion rates, likelihood to recommend, and any metric you collect from a sample of users. We will cover both the concepts of confidence intervals and normal theory and how to apply this practice on any sample from 2 to 200,000 users. This will follow Chapter 3 in Quantifying the User Experience.
Observing & Coding Usability Problems
At the heart of usability testing, whether it be the do-it-yourself kind or the more industrial strength kind, is documenting, diagnosing and reducing usability problems. Following up from the early quantitative benchmark data we will watch videos of users attempting to rent a car and document and discuss the usability problems.
PM Workshop: Conducting Usability Tests
After covering the different methods, now we will get hands on and break into groups to work through the core usability testing methods of moderated sessions, unmoderated tests and tree-testing.
Hypothesis Testing & Statistical Significance
With everyone wide awake on caffeine, we will get into both the theoretical and practical applications of testing hypotheses in the user experience. We will cover the basics of statistical testing and get practice determining if two websites or designs are statistically different. Participants will receive a comprehensive Excel calculator and guide to walk them through how to conduct statistical tests for the most common situations in applied user research. This will follow Chapters 5 and 10 in Quantifying the User Experience.
A/B Testing and Metric Comparisons
We will continue getting practice forming hypotheses and testing the differences in designs by going more in depth into conducting A/B tests and determining if two designs are statistically significant at small and very large sample sizes. We will focus on balancing practical significance with statistical significance through a series of examples and exercises.
Project Design & Deployment In this half-day workshop, we’ll give you hands-on instruction in going through setting up and preparing to analyze an unmoderated study (of your choosing) and prepare to launch it to collect real data from targeted participants.
Power and Sample Size Calculations
How many users do you test? It’s one of the most common and confusing questions in applied user research. Instead of relying on vague rules of thumb, you’ll learn how to compute sample sizes for making comparisons, discovering problems in usability tests, and for survey research.
Findability & Usability Case Studies
We will walk through a series of scenarios to bring together the methods learned earlier and apply research design, sample size calculations, metric selection and statistical comparisons. Working in teams, participants will design and conduct an unmoderated or findability study for analysis and discussion.
Final Analysis & Project Presentations
You’ll get help in preparing your analysis and statistical calculations then present your findings.
Thank you for the wonderful training…loved it!
I love, love, loved the class! It was by far the best training that I’ve attended in my career (and I have been working for a very long time).
Jeff is a phenomenal speaker and teacher. He makes very difficult (and let’s face it, pretty dry) stuff fun to learn. Thanks for putting this on!
Jeff Sauro will be the primary instructor for the bootcamp. He has taught UX research methods classes for companies including Autodesk, Cisco, Dropbox and Salesforce. He is a regular speaker at UX conferences including UXPA and CHI and is an adjunct instructor at the University of Denver.
Hyatt Place Denver Cherry Creek will be offering discounted rates for UX Bootcamp attendees. The group rate is $139 for singles and $149 for doubles per night.
Due to the customized nature of this training, we cannot offer refunds but we accept substitutions. Please contact us as soon as you know you will have a substitute. We may also carry over your registration for the following year.
MeasuringU official presentation date TBD
Jeff and the MeasuringU Team will present:
From Snake-Oil to Science: Measuring UX Maturity
Colorado Convention Center, Denver, CO | May 10, 2017 | 4:30pm