Revision as of 19:12, 8 March 2022

The Ford company realized in 1957 that making a perfectly functional car was not enough to achieve commercial success. Indeed, nobody wanted to buy it, and the company suffered a loss of 250 million dollars ^[1]. The goal of validation is to ensure that a design meets the user's needs, and it is just as important as producing a functional design. Indeed, an inadequate validation will result in designing an undesired or unsuitable product, wasting significant amounts of resources, money, and time. The increase in complexity and duration of design projects often causes the initial objectives to get forgotten. Validation closes the production loop and ensures that the functionality intended for the user is fulfilled. Traditionally, validation is performed at the end of the product design process, through direct user testing, among other methods. However, a newer validation approach is called User-Centered Design and consists of early user integration in the design process, which spreads the validation over the whole project timeline.

Note to the reader

I realized that all the text that I uploaded Sunday wasn't saved so it would be nice if you could wait for me to add it again before giving feedback :) . Should be done for wednesday.

Big Idea

Definition of design validation

According to the U.S. Food and Drugs Administration, “Design validation means establishing by objective evidence that device specifications conform with user needs and intended use(s).“^[2]. Simply put, validating a design means answering the following question: did you design the right product?

Difference with verification

Verification is linked to validation, but its goal is to make sure that the product works. It answers the question: did you design the product right?

Validation in the V-Model

The V-Model is a commonly used graphical representation of the lifecycle of a product’s development. It provides guidance to minimize the risks, reduce the total cost and improve the guarantee of quality and communication between the stakeholders. Validation steps appear on the right branch of the “V” and each of them is a mirror of a verification phase shown on the left branch.

Application

Methods

Validation methods can be divided into 2 main categories: qualitative and quantitative. They can of course be combined, and they do not all allow to analyze the product in its entirety, but only on certain aspects such as ergonomics for example. Many of these methods are mainly used in the IT field, for applications or websites. However, they are completely extrapolatable to any field involving the creation of a product or a service, and therefore to many projects. Some of them are detailed below.

Qualitative methods

Heuristic evaluation

The purpose of this type of validation is to ensure that the product meets a set of pre-established requirements. It is a powerful way to ensure that the product is relevant enough before submitting it to users' experimentation. The heuristics used can be customized for the company and the type of product to be analyzed, or pre-recorded evaluation heuristics, commonly used in the field.

Heuristics are a good way to establish a pre-validation of a product without directly asking the users. They can therefore be preferred in the case of a confidential project. It is a simple, inexpensive, and quick method to set up. It can be done at the end of the design process for the final validation as well as throughout the process to ensure that a project is on the right development path. Its effectiveness depends largely on the quality and completeness of the criteria selected.

A good example is Nielsen’s Heuristics, which are used to validate machine-user interfaces of computer software. It is a ten points checklist that highlights as many requirements as possible that need to be fulfilled by a piece of software. If even one of these points is not checked, Jakob Nielsen argues that there will be inevitable flaws in the use of the product. Many of these criteria can be adapted to other types of products, and a similar heuristic can be created in any domain to ensure that our design meets the user's needs. It is also possible to assign weights to the different criteria according to their importance, to focus the analysis on the most critical points.

The 10 Nielsen’s Heuristics include:

1. Visibility of System Status

   The user of the website, digital application, or other digital product must understand what is going on with appropriate feedback (notifications, progress bar...).

2. Correspondence between the system and the real world

   Words, sentences, information, graphic elements, must be natural and look like the experiences the user already had.

3. Control and freedom

   Users can easily exit the system in case of error, redo or cancel an action.

4. Consistency and standards

Respect for standards, in terms of functionality, navigation, graphics, language used, etc. Similar elements should also look similar.

1. Error prevention

The design is conceived so that the user does not make serious mistakes and can always correct their mistakes.</p>

1. Recognition rather than recall

Reduce the mental load with clear instructions, showing the path taken, to minimize the effort of memorization during use.

1. Flexibility and efficiency

The interface is convenient for the user regardless of their digital maturity. For example, the keyboard shortcuts are not very visible for the novice. On the other hand, for the expert who must use it regularly, it is a productivity gain.

1. Aesthetic and minimalist design

The content, graphic design, etc. must have a reason to exist, otherwise, the task may be prevented.

1. Error recognition, diagnosis, and repair

Error messages are clear, simple, and constructive.

1. Help and documentation

If necessary, always provide easily accessible instructions to answer users' questions and needs.

Pilot User Test

Products tested under this Design Validation Method are submitted to real users in real use conditions (time, environment). The testing users receive a scenario to follow which is a part of the typical use of the product. Throughout the simulation, the testers give feedback and their opinion.

Quantitative methods

Metrics

The Pilot User Test is combined with digital tools whose aims are to gather quantified data on the use of the product: number of testers at the same time, execution time, mean task realization time, etc. This data is then used by the IT team to improve the capacities of the product. The testers may also grade their experience, providing more numerical information.

User-Centered Design

A newer validation approach is called  User-Centered Design and consists of early user integration in the design process, which spreads out the validation in time. A notable example of this process is open-source collaboration, in which users can provide real-time feedback and suggestions.

Examples of successful validation

Limitations

• Lack of awareness of its tremendous benefits especially in emerging countries like China, India, Brazil, and Argentina.
• External pressure (in pharmaceuticals where big amount of funds is invested.)
• Increase of design complexity (this point is a key challenge in various domains. The variables to create the right product is ever-changing and with-it outdated methods of validation fail to produce the right product quite consistently).

References

1. ↑ Bahill, A. T., & Henderson, S. J. (2005). Requirements Development, Verification, and Validation Exhibited in Famous Failures. (Www.Interscience.Wiley.Com). Syst Eng, 8, 1–14. https://doi.org/10.1002/sys.20017
2. ↑ eCFR :: 21 CFR 820.3 -- Definitions. (n.d.). Retrieved February 18, 2022, from https://www.ecfr.gov/current/title-21/chapter-I/subchapter-H/part-820/subpart-A/section-820.3