The Decision Matrix

Abstract

Innovation within technology is moving faster than ever. Companies are forced to keep innovate new products or improve exsisting products. Due to strict time frames and many different competitors on the technological market, decision-making within product-development/innovation have to be credible and solid. However, in the decision making process in product-development/innovation, low knowledge and many uncertainties are dominating. By using the so-called ”Decision Matrix” (DM), the former can be increased and the latter can be decreased and will be elaborated further. Hence, in product-development/innovation the DM is extremely relevant and may create more knowledge and turn these uncertainties into measurable quantities.

This wiki-article wishes to give a deeper insight and background description of the DM e.g. The Concept Screening Matrix and examine both the quantitative and qualitative approches (Stuart Pugh's approach). In addition the application procces will also be examined by focusing on innovation-projects, –programs and –portfolios including a ”Six Steps”-process description. Moreover, it will contain which parameters/criterion are key and appropriate in order to obtain an realistic and solid output when applying the DM, e.g. define the end-goal and stakeholders (customers), reflect on output and list the weight of parameters/criterion.

Challenges and difficulties when using the DM will also be examined focusing on how to chose the DM parameters/criterion and their weights and how to relate objectively to the outcome and how to use the DM as an iterative tool. Finally, suggestions are identified in order to accomodate and improve the challenges and difficulties and to identify for what the tool is applicable, for when the DM is applicable, how the DM is applicable and for who it is applicable and who can benefit from the DM.

The preliminary structure:

- Concept desription of the tool, the DM (both quantitative and qualitative approaches

- Application in innovation-projects, –programs and –portfolios and choice of approriate parameters/criterion when using the DM

- Challenge and limitations in the DM

- Suggestions for improving the challenges and limitations of the DM

Introduction

The following wiki-article focus on the tool the Decision Matrix. The Decision Matrix (DM)is a tool which can be used in many connections. Both everyday-problems like “what should we have for dinner?”, “which theme should party be?” and the list is end-less, however the DM can also in more complex situations like in development projects, where problems like “Which product should we improve?” and in bid-situations where many criteria are influencing the final winner of the bid.

Hence, the DM is a very relevant tool for both Programs, Projects and Portfolio since decision making, no matter the complexity, is inevitable factor in all perspectives of achieving an end-goal.

The article will elaborate on the concept of the DM, application of the DM, challenges in relation to the DM, improvements of the DM and finally a personal review of the tool is conducted.

Big Idea

The basic concept

The Decision Matrix (DM) is a decision-making tool invented by Stuart Pugh in 1990 [Source: Product Design and Development] and hence the method is also known as the Pugh-Method. Initially the Pugh-Method is based upon qualitative assessment using only “+” and “-” but has later on evolved to also use a quantitative assessment and hence a grading system. By using the DM a quick overview of different alternative solutions (candidates) is formed. The DM contains a list of candidates. Each of the candidates are judged and evaluated based on a row of different criteria. The candidates with the highest score is chosen as the final candidate and the decision is made. However, if two candidates scores the same a new iteration may take form. Moreover, if the external envirionment changes and influences the criteria a new DM needs to be formed etc. Hence, the DM should be perceived as an iterative tool. Below is shown a basic DM:

Table 1. The basic Decision-Matrix, with four candidate and four criterion (this may vary relating to the complexity), a total sum column showing the best candidate and a column showing any additional comments.

To show how the DM works a simplified, an example has been established below. The example concerns a decision everyone has to make during their life and hence can relate to: “What do I want to eat for breakfast?”

A list of optional canditdates and criteria are listed in the DM and they are rated by using a quantitative grading system: 1-5, where 5 is the best.

Table 2. Example ”What do I want to eat for breakfast today?”

A lot of different questions may arise in relation to this example e.g.”what if the price is more important to me than the taste”,”How do I come up with the different candidates?” etc. In the following section the process in choosing the final candidate is elaborated via six steps.

The Six Step process

• Prepare the matrix by setting up all optional candidates and identify which criteria the decision should be based upon. From example, different types of breakfast and factors to rate i.e. price, taste. To identify the most appropriate criteria an elaboration is given further down under the Application section.
• Rating of the candidates can be done either by using a quantitative or qualitative approach as in the given example above. When many different candidates are occurring a qualitative approach is suitable. However, this is most suitable during the initial phase when you have to narrow down the candidates rather quickly. Moreover, a reference candidate may be chosen and the other candidates are then rated compared to the reference. This is also referred to as “The Concept Screening Matrix”. In this approach only +, 0 or – are assigned. This gives a quick overview of potential candidates to pursue and hence is suitable in an early stage [Source: Product Design and Development]. From example, the usual breakfast is chosen as reference and the other candidates are rated compared to the usual, if they are more + than the reference then eat that.

Table 3. The Concept Screening Matrix where one candidate is chosen as reference and proceed with oatmeal and Skyr with fruit

The quantitative approach is based upon a scale like the one from table 2 and like the example, the candidate with the highest ranking is chosen. In some cases, a candidate who has a higher score for all criteria might occur and will naturally be chosen and decision process will end. This type of candidate is referred to as a “Dominant Candidate”. [Source: Lecture, 42457 Supply Chain Management, 13.09.2016]

• Ranking each criterion can be assigned with a weight if they are of greater importance for the end-decision. From example, health is twice as important as the price and then health’s rating is multiplied with two.
• Combine and improve candidates if this is possible and feasible.
• Picking possible candidates (one or more) to pursue.
• Reflect on the results and the process. The project team has to agree upon the final candidate, to achieve an optimal output. [Source: Product Design and Development]

Application

Initially when applying the DM for an innovation projects many uncertainties and low knowledge is occurring. It is thus necessary to identify who are the customer and key stakeholders and what are their needs. The reason for this is that output from the DM relies on the right set of criteria and those are based on these identified needs.

Different approaches to identify the needs are existing, however a general method also follow a six step process in order to select the right criteria:

• Define the scope of the candidates. This can be done by describing the stakeholders (both internal and external), their needs and goals, identify and define the given market and hence identify the benefit of a product and without getting a specific product concept. Moreover, it is important to carefully setup assumptions in order to comply the project scope.
• Gather raw data from customers. This is important in order to get a basic understanding of the customers. The raw data gathering can be handled by using either:
  • Interviews: Members from the innovation project discuss needs with the customer in their environment.
  • Focus groups: A member from the innovation project facilitates a discussion with 8-12 customers.
  • Observe an existing product in use: Members from the innovation project go out and an existing product in use because that can reveal what the customers’ needs really are.
• Interpret the raw data. After having gathered the raw it is important to clarify what the product has to do and hence use the identified needs as raw data. There are different approaches to express the needs:
  • What does the product have to do instead how the product might do it? By using this approach technological solutions do not stand in the way and limit the product development.
  • The level of needs should be on the same detail level as the raw data to secure information.
  • Use positive phrasing when expressing the needs, however this can be quite challenging. E.g. “I spend so much money on breakfast” is very negative whereas “I like cheap food” is more positive but somehow more difficult to phrase.
  • Use the need as attribute of the product.
  • Avoid must and should since those words may contribute to limiting the innovation project.
• Organize the need into hierarchy by writing down needs on a i.e. a post-it, eliminate redundant statements, group the post-its in the needs, review and edit the statements
• Establish the importance of the needs and compare to other needs.
• Reflect on the results. [Source: Product design…)

Once all the customer’s needs are gathered and defined and the criteria have been listed the innovation project team can proceed in the decision making process.

The need for applying the DM occurs when several options can be conducted for one end-goal. The DM is expedient when there is no clear option and an objective approach is needed. However, a dominant candidate may occur when rating has been done and this candidate is superior in all criteria [Lecture, 42457 Supply Chain Management, 13.09.2016]. The appropriate phases to conduct the DM is when a project team narrowing options and this is often the case in the early phases of an innovation project or when selecting and accommodate customers’ needs. Even though, this article focuses on innovation projects, the DM is applicable for other purposes.

Applicable areas

In the construction industry a tendering process is carried out before a construction site is launched. During turnkey contracts different interested contractors give an offer on the construction. Here the DM is very appropriate. There are different criteria that influence the final choice of the contractor. Often architecture, time-frame, operation and maintenance and of course cost are the primary criteria which a contractor is evaluated upon. Moreover, these criteria are also weighted since operation and maintenance may be considered of higher influence on the final decision compared to architecture.

The building owner or its consultants are responsible ranking and evaluate each candidate based on each criterion. The contractor with the highest score then win the tender. As mentioned earlier it may be possible to combine to different candidates when they have been evaluated. This could result in more contractors then being responsible for subject areas. A new decision-making process could then be launched in order to decide if this solution is more feasible. Hence, new criteria for this DM could be based upon planning (which order should the work be done), more internal challenges with handling the logistic of workers etc. This shows that using the DM is an iterative process and that the DM is a vivid tool. [Conversation with a Construction Manager from BaneDanmark, 12.06.2016]

Picture 1. A section how to evaluate in a tender process, taken BaneDanmark’ folder concerning “Information about tender, evaluation, negotiation and award”

As it can be read from picture the contract is awarded to the “most economically advantageous tender”, however the tendered prices and the technical solutions are both subcriteria which are weighted equally. The reasons could be that the prices and technical solutions often go hand in hand. [Lecture]

During procurement of products it is often supplied from an external source. To decide the right suppliers, the DM could be used. Moreover, if you are the supplier you could also use the DM in order to decide where the best location is. The criteria used could then be based upon criteria like customers, price, transportation and costs.

Figure 2. Example of a simple DM when a production has to choose a new site location. Due to no weight added to the criteria, it is not possible to determine which location is most suitable, solely assess on behalf of the table above.

Annotated bibliography

Ulrich, Karl T.; Eppinger, Steven D. (2013) Product Design and Development

• Description of perspectives on marketing, design and manufacturing where theory and practical cases are explained in order to elaborate and support the theory

Lecture (13.09.2016) 42457 Supply Chain Management, DTU Engineering Management

• Lecture in the course 42457 Supply Chain Management regarding strategic network design, Location-allocation problem and hence tools and methods to manage the problem the DM

Conversation with a Construction Manager from BaneDanmark (12.06.2016)

• Unformal conversation with a construction Manager from BaneDanmark disussing the tender process for public construction projects with focus on the grading system and the process evolving that.

Sloma, Richard S. (2000), No-Nonsense Management

• A guide for managers including 70 principles which managers should follow if they wish to be successful and have a maximum performance.

The U.S. Small Business Administration () https://www.sba.gov/managing-business/leading-your-business/making-decisions

• Article formulating tips for Decision-Making, common Decision-Making mistakes and the importance of making time during a desicion process.

Brooks, Chad (01.04.2014) http://www.businessnewsdaily.com/6162-decision-making.html

• Article formulating Desicion-making tips and tools and explaning common mistakes.