Analytic Hierarchy Process

From apppm
(Difference between revisions)
Jump to: navigation, search
(→‎Annotated Bibliography)
 
(90 intermediate revisions by one user not shown)
Line 1: Line 1:
−
==Abstract==
+
''Developed by Hafsteinn Thor Gudjonsson''
−
'''This will be written in the end'''
+
  
−
==Introduction==
+
 
 +
Decision making and doing it right is one of the largest challenges that organizations have to face. Especially when the constant sea of new emerging technologies and markets is considered. Managers have to consider different criteria, gather input from multiple stakeholders and conclude on the best alternative of solutions. This is where the Analytic Hierarchy Process comes in play.
 +
The Analytic hierarchy process is a multi-criteria decision making (MCDM) method utilized to analyse, solve and prioritize complex decisions, by rating and comparing multiple criteria and scenarios against each other. Based on mathematics and psychology, it enables the incorporation of both qualitative and quantitative input while also considering subjective biases when rating solution alternatives.
 +
 
 +
This article explains the background for the Analytic Hierarchy Process and the application of the tool in a Project, Portfolio and Program Management context. The main focus is on explaining the application of the tool, in a step-by-step manner including a fictional case example
 +
for easier application understanding.
 +
 
 +
=Overview=
 
===History===
 
===History===
−
The Analytic hierarchy process is a multi-criteria decision making (MCDM) method utilized to analyse, solve and prioritize complex decision, by rating and comparing multiple criteria and scenarios against each other <ref name="Ishizaka">''(“Ishizaka Alessio, Labib Ashraf, Analytic Hierarchy Process and Expert Choice: Benefits and Limitations, ORInsight, 22(4), p. 201–220, 2009)''</ref> .  
+
The Analytic hierarchy process is a multi-criteria decision making (MCDM) method utilized to analyse, solve and prioritize complex decisions, by rating and comparing multiple criteria and scenarios against each other <ref name="Ishizaka">''(“Ishizaka Alessio, Labib Ashraf, Analytic Hierarchy Process and Expert Choice: Benefits and Limitations, ORInsight, 22(4), p. 201–220, 2009)''</ref> .  
  
 
It was Thomas Saaty, regarded as one of the pioneers of Operations research which developed the Analytic Hierarchy Process throughout the 1970s. In the late 1960's, Saaty was recruited by the Arms Control and Disarmament Agency at the U.S. Department of state to direct their research projects. During his period there, he observed considerable communication difficulties between the scientists and lawyers at the department, both groups being the main contributors and decision makers in the project, which led to poor project results. Based on his experience from this period, Saaty was driven to develop a simple way to help ordinary people communicate better and make complex decisions, eventually resulting in the Analytic Hierarchy Process. From that day on, the Analytic Hierarchy Process has perhaps become the most widely used decision making method in the world with actual relevant applications counting in the thousands <ref name="Exposition"></ref>.
 
It was Thomas Saaty, regarded as one of the pioneers of Operations research which developed the Analytic Hierarchy Process throughout the 1970s. In the late 1960's, Saaty was recruited by the Arms Control and Disarmament Agency at the U.S. Department of state to direct their research projects. During his period there, he observed considerable communication difficulties between the scientists and lawyers at the department, both groups being the main contributors and decision makers in the project, which led to poor project results. Based on his experience from this period, Saaty was driven to develop a simple way to help ordinary people communicate better and make complex decisions, eventually resulting in the Analytic Hierarchy Process. From that day on, the Analytic Hierarchy Process has perhaps become the most widely used decision making method in the world with actual relevant applications counting in the thousands <ref name="Exposition"></ref>.
Line 14: Line 20:
 
The Analytic Hierarchy Process, as defined by Thomas Saaty, has been acknowledged for combining psychology and mathematics well to apply towards complex organizational decision making. The Analytic Hierarchy Process compares criteria, or alternatives with respect to a criterion in a pairwise manner. Each criteria and alternative is evaluated, based on a predetermined scale which has shown to capture individual preferences with respect to quantitative and qualitative attributes. The scale helps converts the evaluations to numerical values which are than utilized to calculate overall ratings for the possible alternatives and find the optimal solution <ref name="Exposition">''(Forman Ernest H., Gass Saul I.,The Analytic Hierarchy Process - An Exposition, 2001)''</ref>. As the qualitative input and the interpretation of the quantitative evaluations for the ratings can be inconsistent, the Analytic Hierarchy Process considers and calculates a consistency ratio for the ratings given, to prevent previously mentioned biases and to secure consistency throughout the ratings <ref name="Saaty"></ref>.  
 
The Analytic Hierarchy Process, as defined by Thomas Saaty, has been acknowledged for combining psychology and mathematics well to apply towards complex organizational decision making. The Analytic Hierarchy Process compares criteria, or alternatives with respect to a criterion in a pairwise manner. Each criteria and alternative is evaluated, based on a predetermined scale which has shown to capture individual preferences with respect to quantitative and qualitative attributes. The scale helps converts the evaluations to numerical values which are than utilized to calculate overall ratings for the possible alternatives and find the optimal solution <ref name="Exposition">''(Forman Ernest H., Gass Saul I.,The Analytic Hierarchy Process - An Exposition, 2001)''</ref>. As the qualitative input and the interpretation of the quantitative evaluations for the ratings can be inconsistent, the Analytic Hierarchy Process considers and calculates a consistency ratio for the ratings given, to prevent previously mentioned biases and to secure consistency throughout the ratings <ref name="Saaty"></ref>.  
  
−
Considering how effective the Analytic Hierarchy Process is for complex decision making, it is often utilized by the PPM (Project Portfolio Management) for the prioritization and selection of projects in a portfolio. The selection of projects is often driver by multiple drivers and affected by multiple stakeholders. The Analytic Hierarchy Process , its application and overall understanding can therefor be considered very relevant for Project Portfolio Managers and Project Managers alike <ref name="Portfolio">''(Vargas R. V., Using the analytic hierarchy process (ahp) to select and prioritize projects in a portfolio, 2010''</ref>.
+
===Application in a Project, Portfolio and Program Management Context===
−
 
+
Considering how effective the Analytic Hierarchy Process is for complex decision making, it is often utilized by the PPM (Project Portfolio Management) for the prioritization and selection of projects in a portfolio. Portfolio Management includes the processes to identify, categorize, evaluate, select, prioritize, balance and authorize projects within a portfolio <ref name="PortfolioMan">''(PMI, The Standard for Portfolio Management, page 21, 2008)''</ref>. The selection of projects is thereby driven by multiple drivers, includes many complex decision and is affected by multiple stakeholders. The tool allows multiple inputs from stakeholders to be considered, allowing for pairwise comparison of criteria and alternatives, which can be done in a meeting or workshop environment, while maintaining a relatively high rating consistency . Allowing stakeholders to have a say in the decision making and being heard can help increase support, minimize resistance towards an individual project and thereby increase the chance for a project success <ref name="ProjectMan">''(PMBOK® Guide, A Guide to the Project Management Body of Knowledge, Fifth Edition, chapter 13.3, 2013)''</ref>.  
−
 
+
  
−
----
+
The Analytic Hierarchy Process, its application and the overall understanding can therefor be considered very relevant for Project Portfolio Managers and Project Managers alike <ref name="Portfolio">''(Vargas R. V., Using the analytic hierarchy process (ahp) to select and prioritize projects in a portfolio, 2010)''</ref>.
  
−
==Methodology - A Step-By-Step approach==
+
=Methodology - A Step-By-Step approach=
 
In the following section the Analytic Hierarchy Process and its application towards decision making is described in a step-by-step manner.
 
In the following section the Analytic Hierarchy Process and its application towards decision making is described in a step-by-step manner.
−
Additionally, for a better understanding of the Analytical Hierarchy Process anexample has been made to showcase the practical usage of the tool, highlighted after every described step. The example is derived from the theory, but created by the author of the article and based on a fictional case. The case example is to consider improved scenarios for the medicinal distribution within a hospital, with pre-defined criteria and possible solution alternatives.
+
Additionally, for a better understanding of the Analytical Hierarchy Process an example has been made to showcase the practical usage of the tool, highlighted after every described step. The example is derived from the theory, but created by the author of the article and based on a fictional case. The case example is to consider improved scenarios for the medicinal distribution within a hospital, with pre-defined criteria and possible solution alternatives.
  
−
===Define the Problem===
+
==Define the Problem==
 
The decision making should be driven by a stated problem. The problem should be well defined and the objectives of the problem should be broadened to consider all actors, objectives and possible outcomes. All criteria that influence the solution, the chosen outcome, are then to be identified<ref name="Vaidy">''(Vaidy Omkarprasad S., Kumar Sushil, Analytic hierarchy Process: An overview of applications, European Journal of Operational Research 169, 2006)''</ref>.
 
The decision making should be driven by a stated problem. The problem should be well defined and the objectives of the problem should be broadened to consider all actors, objectives and possible outcomes. All criteria that influence the solution, the chosen outcome, are then to be identified<ref name="Vaidy">''(Vaidy Omkarprasad S., Kumar Sushil, Analytic hierarchy Process: An overview of applications, European Journal of Operational Research 169, 2006)''</ref>.
  
−
====Example: Background and Definition of the problem ====
+
===Example: Background and Definition of the problem ===
 
A consultant team has proposed two new solutions to improve the efficiency, quality and cost of distributing medicine towards the patients within a hospital. The hospital has a low level of technology, minimal usage of IT systems and the medicinal storage is spread out throughout the hospital.  
 
A consultant team has proposed two new solutions to improve the efficiency, quality and cost of distributing medicine towards the patients within a hospital. The hospital has a low level of technology, minimal usage of IT systems and the medicinal storage is spread out throughout the hospital.  
  
Line 45: Line 50:
 
*G. Efficiency (Efficiency in terms of daily operations)
 
*G. Efficiency (Efficiency in terms of daily operations)
  
−
===Define the Problem Hierarchy===
+
==Define the Problem Hierarchy==
−
[[File:1_Hierarchy_Small.png|thumb|600px|'''Figure x''' - Problem Hierarchy for the Analytical Hierarchy Process. Ref6]]
+
[[File:1_Hierarchy_Small.png|thumb|600px|'''Figure 1''' - Problem Hierarchy for the Analytical Hierarchy Process. Illustration created by author]]
 
The factors which effect the final decision are then arranged in an hierarchic structure. This serves two purposes:
 
The factors which effect the final decision are then arranged in an hierarchic structure. This serves two purposes:
  
Line 56: Line 61:
  
  
−
====Example: Define the Problem Hierarchy====
+
===Example: Define the Problem Hierarchy===
−
To start the process, the steering committee defines the hierarchy for the problem. The Distribution of medicine is defined as the overarching Goal, the pre-defined criteria shown below and lastly the three available solutions are defined as the alternatives. Each alternative has to consider each criteria in the hierarchy level above. The hierarchy is shown in figure xx.
+
To start the process, the steering committee defines the hierarchy for the problem. The Distribution of medicine is defined as the overarching Goal, the pre-defined criteria shown below and lastly the three available solutions are defined as the alternatives. Each alternative has to consider each criteria in the hierarchy level above. The hierarchy is shown in '''Figure 1'''.
  
−
===Pairwise comparison and Calculate the Goal Priority===
+
==Pairwise comparison and Calculate the Goal Priority==
−
[[File:2_ScaleTable_Small.png|thumb|600px|'''Figure x''' - The Fundamental scale. Ref6]]
+
[[File:2_ScaleTable_Small.png|thumb|600px|'''Figure 2''' - The Fundamental scale, inspired and adapted from Saaty <ref name="Multi">''(Ishizaka Alessio, Nemery Philippe, Multi-Criteria Decision Analysis: Methods and Software, 2013)''</ref><ref name="Wiki">''(Lou Sander, https://en.wikipedia.org/wiki/Analytic_hierarchy_process_%E2%80%93_car_example#/media/File:AHPFundamentalScale.png, 2008)''</ref>]]
−
Next step is the Pairwise comparison of attributes on each level defined with a numerical rating, based on a pre-defined numerical scale by Saaty <ref name="Saaty">''(Saaty Thomas L., Decision making with the analytic hierarchy process,Int. J. Services Sciences Vol. 1 No.1, 2008)''</ref>. Comparison matrices are constructed for each set of pairwise comparisons. This requires n(n-1)/2 comparisons, n defined as the number of attributes in consideration on each hierarchy level. The rating scale for the pairwise comparison goes from 1 to 9, where if attribute A is of equal importance to attribute B, it receives a rating of 1. If attribute A is of absolute more importance than B, it receives a rating of 9. Likewise, if attribute A is considered absolutely more important than B, than attribute B should be rated with the reciprocal rating of A.
+
Next step is the Pairwise comparison of attributes on each level defined with a numerical rating, based on a pre-defined numerical scale by Saaty <ref name="Saaty">''(Saaty Thomas L., Decision making with the analytic hierarchy process,Int. J. Services Sciences Vol. 1 No.1, 2008)''</ref>. Comparison matrices are constructed for each set of pairwise comparisons. This requires ''n(n-1)/2'' comparisons, ''n'' defined as the number of attributes in consideration on each hierarchy level. The rating scale for the pairwise comparison goes from 1 to 9, where if attribute A is of equal importance to attribute B, it receives a rating of 1. If attribute A is of absolute more importance than B, it receives a rating of 9. Likewise, if attribute A is considered absolutely more important than B, than attribute B should be rated with the reciprocal rating of A.
  
 
Based on the comparison matrices for each set, the priorities are obtained and utilized to weigh the priorities in the level below in the hierarchy.
 
Based on the comparison matrices for each set, the priorities are obtained and utilized to weigh the priorities in the level below in the hierarchy.
  
−
====Example: The Pairwise Comparison and Goal Priority====
+
===Example: The Pairwise Comparison and Goal Priority===
−
With the hierarchy in place, the weight of each criteria is considered. Each criteria is compared in a pairwise comparison utilizing The Fundamental Scale for Pairwise Comparisons, shown in figure x:
+
With the hierarchy in place, the weight of each criteria is considered. Each criteria is compared in a pairwise comparison utilizing The Fundamental Scale for Pairwise Comparisons, shown in '''Figure 2''':
  
 
The comparison is done in a reciprocal matrix, with the size n x n. As there are 7 criteria, the matrix has to consider 49 values. The rating scale value is inserted for each pair comparison, read as row compared to column.  
 
The comparison is done in a reciprocal matrix, with the size n x n. As there are 7 criteria, the matrix has to consider 49 values. The rating scale value is inserted for each pair comparison, read as row compared to column.  
Line 72: Line 77:
 
The Steering committee discusses each pair comparison and eventually comes to a conclusion, resulting in the table shown below:
 
The Steering committee discusses each pair comparison and eventually comes to a conclusion, resulting in the table shown below:
  
−
[[File:3_CriteriaRating_Small.png||center|thumb|1000px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:3_CriteriaRating_Small.png||center|thumb|1000px|'''Figure 3''' - Criteria Rating Matrix. Illustration created by Author]]
  
 
To calculate the priority weight of each criteria, the table has to be normalized. This is done by dividing each rating with the sum of the given column. An example is the row criteria ''Technology Usage'' for column criteria ''Quality''. This value is calculated as follows:
 
To calculate the priority weight of each criteria, the table has to be normalized. This is done by dividing each rating with the sum of the given column. An example is the row criteria ''Technology Usage'' for column criteria ''Quality''. This value is calculated as follows:
Line 78: Line 83:
  
  
−
:<math> 0.14 / 2.03 = 0.70 </math>  
+
:<math> 0.14 / 2.03 = 0.070 </math>  
  
  
Line 84: Line 89:
 
This is calculated for all values in the table and results in the following, as shown below:
 
This is calculated for all values in the table and results in the following, as shown below:
  
−
[[File:4_CriteriaNormal_Small.png||center|thumb|1000px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:4_CriteriaNormal_Small.png||center|thumb|1000px|'''Figure 4''' - Normalised Criteria Rating Matrix. Illustration created by Author]]
  
  
  
−
Lastly, to define the overall priority rating for each criteria, the average is calculated for each row criteria. This results in the following table:
+
Lastly, to define the overall priority rating for each criteria, the average is calculated for each row (per criteria). This results in the following table:
  
−
[[File:5_Priority_Small.png||center|thumb|900px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:5_Priority_Small.png||center|thumb|900px|'''Figure 5''' - Overall priority for Criteria. Illustration created by Author]]
  
−
====Example: Ratings per Alternatives====
+
===Example: Ratings per Alternatives===
  
 
With the criteria in place, the solution alternatives have to be compared pairwise as well and rated. The procedure is similar, where each alternative pair is considered for each criteria.
 
With the criteria in place, the solution alternatives have to be compared pairwise as well and rated. The procedure is similar, where each alternative pair is considered for each criteria.
Line 98: Line 103:
 
An example for the first step of the Quality Criteria is showcased as follows:
 
An example for the first step of the Quality Criteria is showcased as follows:
  
−
[[File:8_QualityCriteria.png||center|thumb|800px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:8_QualityCriteria.png||center|thumb|800px|'''Figure 6''' - Example: Alternatives per criteria rating. Illustration created by Author]]
  
−
This is done for all 7 criteria and as before the table is then normalized. With all alternative pair-wize comparisons in place, the overall priority ratings per criteria for each alternative is shown in the table, figure xx, highlighted in green:
+
This is done for all 7 criteria and as before the table is then normalized. With all alternative pair-wize comparisons in place, the overall priority ratings per criteria for each alternative is shown in the table, '''Figure 7''', highlighted in green:
  
  
−
[[File:9_Priorities.png||center|thumb|500px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:9_Priorities.png||center|thumb|500px|'''Figure 7''' - Pairwise comparison rating for all attributes. Illustration created by Author]]
  
 
As shown in the table, column highlighted in yellow, the Quality criteria is considered to have the highest priority while the Technology Usage criteria is considered to be of the lowest importance
 
As shown in the table, column highlighted in yellow, the Quality criteria is considered to have the highest priority while the Technology Usage criteria is considered to be of the lowest importance
  
−
===Consider how consistent the ratings are===
+
==Consider how consistent the ratings are==
−
After obtaining the priorities towards the hierarchy goal, it is important to consider how reliable the ratings are.  As previously mentioned, the ratings are a pairwise comparison and can be subjectively bias, as they are based on individual or group perspectives towards each criteria. In psychology subjective bias is typically defined as Confirmation Bias, generally defined as the interpretation of evidence which is partial to ones existing beliefs and expectations. This bias can affect the overall solution, with certain criteria or alternatives weighing to much and thereby affecting the rating consistency <ref name="Bias">''(Nickerson Raymond S., Confirmation Bias: A Ubiquitous Phenomenon in Many Guises, 1998)''</ref>.
+
After obtaining the priorities towards the hierarchy goal, it is important to consider how reliable the ratings are.  As previously mentioned, the ratings are a pairwise comparison and can be subjectively bias, as they are based on individual or group perspectives towards each criteria. In psychology, subjective bias is typically defined as Confirmation Bias, generally defined as the interpretation of evidence which is partial to ones existing beliefs and expectations. This bias can affect the overall solution, with certain criteria or alternatives weighing to much and thereby affecting the rating consistency <ref name="Bias">''(Nickerson Raymond S., Confirmation Bias: A Ubiquitous Phenomenon in Many Guises, 1998)''</ref>.
  
−
To address this, a consistency ratio is calculated utilizing a framework and a consistency index (CI) put forward by Saaty (1997). <ref name="Ishizaka">''(Ishizaka&Labib, 2009, p5)''</ref>. A Principal Eigen Value is calculated, based on the global priority for each attribute. The sum of the Principal Eigen Values for all attributes are accumulated and divided with n, the number of attributes in the given hierarchy level. This gives a certain Inconsistency level. This Inconsistency level is then compared to the Consistency Index as proposed by Saaty, which is defined for each matrix of size n. The numerical value for each matrix of size n in the Consistency Index, has been calculated based on large samples of random matrices and the consistency indices of those matrices <ref name="Vaidy"></ref>. A Consistency Ratio is calculated, by dividing the Inconsistency level with the appropriate Consistency Index. If the Consistency Ratio is less than 0.1 (10%) than the matrix can be considered as being consistent. If it is higher than 10% it is advised to reconsider the attribute rating to achieve consistent measures  <ref name="Ishizaka">''(Ishizaka&Labib, 2009, p5)''</ref>.
+
To address this, a consistency ratio is calculated utilizing a framework and a consistency index (CI) put forward by Saaty (1997). <ref name="Ishizaka">''(Ishizaka&Labib, 2009, p5)''</ref>. A Principal Eigen Value is calculated, based on the global priority for each attribute. The sum of the Principal Eigen Values for all attributes is accumulated and divided with n, the number of attributes in the given hierarchy level. This gives a certain Inconsistency level. This Inconsistency level is then compared to the Consistency Index as proposed by Saaty, which is defined for each matrix of size n. The numerical value for each matrix of size n in the Consistency Index, has been calculated based on large samples of random matrices and the consistency indices of those matrices <ref name="Vaidy"></ref>. A Consistency Ratio is calculated, by dividing the Inconsistency level with the appropriate Consistency Index. If the Consistency Ratio is less than 0.1 (10%) than the matrix can be considered as being consistent. If it is higher than 10% it is advised to reconsider the attribute rating to achieve consistent measures  <ref name="Ishizaka">''(Ishizaka&Labib, 2009, p5)''</ref>.
  
−
====Example: Consistency in criteria Ratings====
+
===Example: Consistency in criteria Ratings===
 
To make sure that the steering committee was consistent throughout their criteria weight ratings, the Consistency Ratio has to be calculated. The Consistency Ratio (CR) is calculated by dividing the Inconsistency Ratio (IR) with the Consistency Index (CI) which is pre-defined for each matrix of the size n as explained in the step-by-step segment above.  
 
To make sure that the steering committee was consistent throughout their criteria weight ratings, the Consistency Ratio has to be calculated. The Consistency Ratio (CR) is calculated by dividing the Inconsistency Ratio (IR) with the Consistency Index (CI) which is pre-defined for each matrix of the size n as explained in the step-by-step segment above.  
  
−
First, the Principal Eigen Vector is needed. The Principal Eigen Vector is calculated by multiplying the overall priority rating for each criteria with the sum of rating for each attribute column. An example is the Principal Eigen Vector calculation for the ''Quality'' criteria. The row ''Quality'' criteria value of ''0,454'' is multiplied by the ''Quality' criteria column sum of ''2,03'' (as shown in figure xx). This calculates to:
+
First, the Principal Eigen Vector is needed. The Principal Eigen Vector is calculated by multiplying the overall priority rating for each criteria with the sum of rating for each attribute column. An example is the Principal Eigen Vector calculation for the ''Quality'' criteria. The row ''Quality'' criteria value of ''0,454'' is multiplied by the ''Quality' criteria column sum of ''2,03'' (as shown in '''Figure 3'''). This calculates to:
  
  
Line 123: Line 128:
 
The Principal Eigen Vector is calculated for all criteria and shown as follows:
 
The Principal Eigen Vector is calculated for all criteria and shown as follows:
  
−
[[File:6_EigenVector.png||center|thumb|500px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:6_EigenVector.png||center|thumb|600px|'''Figure 8''' - The Principal Eigen Vector per criteria. Illustration created by Author]]
  
  
Line 132: Line 137:
  
  
−
As there are 7 criteria (attributes), n is equal to ''7''. As shown in figure xx, the sum of the Principal Eigen Vectors is ''z = 7,558''. Based on the formula, this gives:  
+
As there are 7 criteria (attributes), n is equal to ''7''. As shown in '''Figure 8''', the sum of the Principal Eigen Vectors is ''z = 7,558''. Based on the formula, this gives:  
  
  
Line 141: Line 146:
 
The Consistency Index is based on the amount of attributes n, defined in the following table:
 
The Consistency Index is based on the amount of attributes n, defined in the following table:
  
−
[[File:7_CIndex.png||center|thumb|500px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:7_CIndex.png||center|thumb|800px|'''Figure 9''' - The Random Consistency Index table, adapted from Saaty (1977) <ref name="Multi">''(Ishizaka Alessio, Nemery Philippe, Multi-Criteria Decision Analysis: Methods and Software, 2013)''</ref>]]
  
  
Line 163: Line 168:
 
The same calculations are repeated for the alternative ratings, which are also considered to be consistent as they likewise fall under 10%.
 
The same calculations are repeated for the alternative ratings, which are also considered to be consistent as they likewise fall under 10%.
  
−
===Overall weight of alternatives and optimal solution===
+
==Overall weight of alternatives and optimal solution==
  
−
After having considered the consistency and obtaining all the weighted priorities of criteria and alternative, it is possible to calculate the optimal alternative towards the overarching goal. This is done by calculatingthe weighted value per alternative and prioritizing the highest value.
+
After having considered the consistency and obtaining all the weighted priorities of criteria and alternative, it is possible to calculate the optimal alternative towards the overarching goal. This is done by calculating the weighted value per alternative, that is considering the weight of each criteria, and prioritizing the highest value.
  
−
====Example: Overall weight of alternatives====
+
===Example: Overall weight of alternatives===
  
−
The weight for each alternative within each criteria is calculated by multiplying the priorities with each other. An example is when calculating the ''Quality'' priority value with the ''Current State'' priority value, as shown in figure xx below:
+
The weight for each alternative within each criteria is calculated by multiplying the priorities with each other. An example is when calculating the ''Quality'' priority value with the ''Current State'' priority value, as shown in '''Figure 10''' below:
  
  
Line 179: Line 184:
  
  
−
[[File:10_OverallPriorities.png||center|thumb|500px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:10_OverallPriorities.png||center|thumb|500px|'''Figure 10''' - Priority ratings for Criteria and Alternatives. Illustration created by Author]]
  
 
These priorities are than summed up an a matrix, where the sum of all criteria per alternative is calculated. The sum is the overall priority goal for the Optimized Distribution of Medicine, per alternative. The Goal priorities are shown in the following table, highlighted in gray:
 
These priorities are than summed up an a matrix, where the sum of all criteria per alternative is calculated. The sum is the overall priority goal for the Optimized Distribution of Medicine, per alternative. The Goal priorities are shown in the following table, highlighted in gray:
  
−
[[File:11_GoalPriority.png||center|thumb|1000px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:11_GoalPriority.png||center|thumb|1000px|'''Figure 11''' - Overall priority Goal Ratings for alternatives. Illustration created by Author]]
  
  
 
As can be seen in the table, the New Footprint alternative is prioritized as the best solution with a Goal priority of 0.42 , based on all criteria and inputs for an optimized distribution of medicine within the hospital.
 
As can be seen in the table, the New Footprint alternative is prioritized as the best solution with a Goal priority of 0.42 , based on all criteria and inputs for an optimized distribution of medicine within the hospital.
  
−
===Perform a Sensitivity Analysis===
+
==Perform a Sensitivity Analysis==
−
Lastly, it is advised to perform a sensitivity analysis to observe the impact of modifying the input data towards the results. This is done by modifying the ranking of individual criteria as well the criteria weight towards the possible alternatives. If the global priority rank does not change, the results are considered to be robust. <ref name="Ishizaka">''(Ishizaka&Labib, 2009, p7)''</ref>.  
+
Lastly, it is advised to perform a sensitivity analysis to observe the impact of modifying the input data towards the results. This is done by modifying the ranking of individual criteria as well the criteria weight towards the possible alternatives. If the global priority rank does not change, the results are considered to be robust<ref name="Ishizaka">''(Ishizaka&Labib, 2009, p7)''</ref>.  
  
−
====Example: Sensitivity Analysis====
+
===Example: Sensitivity Analysis===
  
−
The consultant team proposes that a simple sensitivity analysis should be made. The steering committee wants to consider if they weighed the Quality criteria to high compared to the Investment criteria. They have therefor increased the weight of the investment by 0.3 and decreased the weight of the quality criteria by 0.3, as shown in figure xx:
+
The consultant team proposes that a simple sensitivity analysis should be made. The steering committee wants to consider if they weighed the Quality criteria to high compared to the Investment criteria. They have therefor increased the weight of the investment by 0.3 and decreased the weight of the quality criteria by 0.3, as shown in '''Figure 12''':
  
−
[[File:13_SensitivityChange.png||center|thumb|900px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:13_SensitivityChange.png||center|thumb|900px|'''Figure 12''' - Sensitivity Analysis with adjusted criteria ratings]]
 
   
 
   
  
 
When calculated through, this results in the following:
 
When calculated through, this results in the following:
  
−
[[File:12_Sensitivity.png||center|thumb|1000px|'''Figure 2''' - Framework of Project Sponsor relationships. Ref6]]
+
[[File:12_Sensitivity.png||center|thumb|1000px|'''Figure 13''' - Overall priority goal for Sensitivity Analysis. Ref6]]
  
  
Line 206: Line 211:
  
 
The Steering Committee and the consultant team feel confident in their consistent choices and rating considerations, and it is decided to go forward with the larger investment of an improved distribution footprint within the hospital.
 
The Steering Committee and the consultant team feel confident in their consistent choices and rating considerations, and it is decided to go forward with the larger investment of an improved distribution footprint within the hospital.
−
----
 
  
 +
=Application Areas=
  
−
----
+
The Analytical Hierarchy Process is possible the most widely utilized decision making method in the whole world. Application cases run in the thousands as well as there are more than a 1000 scientific articles regarding the method and over a 100 doctoral dissertations. <ref name="Exposition">''(Forman, p 1)''</ref>
−
 
+
−
==Application Areas==
+
−
 
+
−
The Analytical Hierarchy Process is possible the most widely utilized decision making method in the whole world. There are more than a 1000 articles regarding the method and over a 100 doctoral dissertations. <ref name="Exposition">''(Forman, p 1)''</ref>
+
  
 
The method has been used in a wide spread of areas within both the public and the private sector. The main but not only examples of applications are as follows:
 
The method has been used in a wide spread of areas within both the public and the private sector. The main but not only examples of applications are as follows:
Line 221: Line 222:
 
*Prioritization or evaluation of alternatives. Rather than only choosing one alternative, a few alternatives can be highlighted as the best ones. This could be relevant, for example if a company wants to consider a combination of alternatives.
 
*Prioritization or evaluation of alternatives. Rather than only choosing one alternative, a few alternatives can be highlighted as the best ones. This could be relevant, for example if a company wants to consider a combination of alternatives.
  
−
*Resource allocation, for example budgeting for an array of multiple projects and defining which projects to prioritize and invest in. This application could be defined as a typical  Project Portfolio Management approach, for defining projects to invest in within the portfolio.<ref name="Exposition">''(Forman, p 1)''</ref>
+
*Resource allocation, for example budgeting for an array of multiple projects and defining which projects to prioritize and invest in. This application could be defined as a typical  Project Portfolio Management approach, when defining projects to invest in within the portfolio.<ref name="Exposition">''(Forman, p 1)''</ref>
  
−
==Limitations==
+
=Limitations=
 
Even though the Analytic Hierarchy Process is widespread and often defined as one of the most adapted decision tool in the world, there are limitations that have to be considered.  
 
Even though the Analytic Hierarchy Process is widespread and often defined as one of the most adapted decision tool in the world, there are limitations that have to be considered.  
  
−
====Pairwise Comparison====
+
===Pairwise Comparison===
−
Due to the fact that all attributes on each level in the hierarchy have to be pairwise compared, the procedure can be quite cumbersome. This increases the resource and time usage needed to be able to define the optimal solution. Additionally, the pairwise comparison is very qualitative where participants evaluate the ratings based on individual or group input, which can be hard to quantify. This also includes quantitative information, as that has to be converted into the defined numerical scale.
+
Due to the fact that all attributes on each level in the hierarchy have to be pairwise compared, the procedure can be quite cumbersome. This increases the resource and time usage needed to be able to define the optimal solution. Additionally, the pairwise comparison is very qualitative due to the fact that participants evaluate the ratings based on individual or group input, which can be hard to quantify. This also includes quantitative information, as that has to be converted into the defined numerical scale.
  
−
====The Numerical Scale====
+
===The Numerical Scale===
 
There have been some discussions regarding the pre-defined linear scale ranging from 1 to 9 and if it is the optimal scale for solutions. Many different versions of the scale have been proposed, which include among others:
 
There have been some discussions regarding the pre-defined linear scale ranging from 1 to 9 and if it is the optimal scale for solutions. Many different versions of the scale have been proposed, which include among others:
 
*Geometric scale (9 values, ranging 1, 2, 4, 8, 16, 32, 64, 128, 256)
 
*Geometric scale (9 values, ranging 1, 2, 4, 8, 16, 32, 64, 128, 256)
Line 237: Line 238:
 
*Balanced Scale (9 values, with a balanced weighted value approach from 1 to 9)
 
*Balanced Scale (9 values, with a balanced weighted value approach from 1 to 9)
  
−
The scale debated is a very heated debate and no one solution is defined. Saaty's original 1 to 9 scale is currently the most adapted scale worldwide, while scientists argue that the scale choice rather should depend on the person and the decision problem at any given time.<ref name="Ishizaka"></ref>
+
The scale discussion in the scientific community is a very heated debate and no one solution is defined. Saaty's original 1 to 9 scale is currently the most adapted scale worldwide, while scientists argue that the scale choice rather should depend on the person and the decision problem at any given time.<ref name="Ishizaka"></ref>
 +
 
 +
===Considerations===
 +
The highlighted limitations showcase the importance of calculating the Consistency factor and to consider the Sensitivity Analysis carefully. Utilizing these steps, should help counteract the qualitative biases and scale rating biases when applying the tool.
 +
 
 +
=Glossary=
 +
'''Criteria''': A standard or input that has an effect on the solution choice
 +
 
 +
'''Matrix''': A mathematical term used for a rectangular array of numbers, most often referred to as a table
 +
 
 +
'''Reciprocal''': A mathematical term used when a number ''x'' is divided by ''1'', that is ''x'' becomes ''1/x''
 +
 
 +
'''Quantitative''': When an input is measured in numerical values
 +
 
 +
'''Qualitative''': When an input is measured in words, size, appearance etc., but not based entirely on numerical measurable values
 +
 
 +
'''ERP-System''': ''Enterprise Resource Planning'', a IT platform used to streamline information and processes across an organization
 +
 
 +
=Annotated Bibliography=
 +
Thomas L. Saaty , ''Decision making with the analytic hierarchy process'', 2008:
 +
 
 +
*''A recent article written by Thomas L. Saaty, the creator of the Analytic Hierarchy Process. A great introductory article with good explenations for the tool''
 +
 
 +
Alessio Ishizaka & Philippe Nemery, ''Multi-Criteria Decision Analysis: Methods and Software'', 2013:
 +
 
 +
*''A good introductionary article explaining the overall approach of the Analytic Hierarchy Process. Additionally is deepdives into the mathematics behind the Consistency Ration, explaining the Eigenvector and Eigenvalue calculations''.
 +
 
 +
Ernest H. Forman & Saul I. Gass , "The Analytic Hierarchy Process - An Exposition", 2001:
 +
*''A good journal discussing and highlighting the multiple application possibilities for the Analytic Hierarchy Process, with case and organizational examples''
  
−
====Considerations====
+
'''Deepdive:'''
−
The highlighted limitations showcase the importance of calculating the Consistency factor and consider the Sensitivity Analysis carefully. Utilizing these steps, should help counteract the qualitative biases and scale rating biases when applying the tool.
+
  
−
==Annotated Bibliography==
+
Thomas L. Saaty , ''Mathematical Principles of Decision Making (Principia Mathematica Decernendi)'', 2010:
 +
*''An in-depth summary and full theory explanation of the Analytic Hierarchy Process written by the creator of the Analytic Hierarchy Process and the Analytic Network Process''
  
−
=='''Bibliography'''==
+
=Bibliography=
  
 
'''References''' <references />
 
'''References''' <references />

Latest revision as of 18:47, 16 November 2018

Developed by Hafsteinn Thor Gudjonsson


Decision making and doing it right is one of the largest challenges that organizations have to face. Especially when the constant sea of new emerging technologies and markets is considered. Managers have to consider different criteria, gather input from multiple stakeholders and conclude on the best alternative of solutions. This is where the Analytic Hierarchy Process comes in play. The Analytic hierarchy process is a multi-criteria decision making (MCDM) method utilized to analyse, solve and prioritize complex decisions, by rating and comparing multiple criteria and scenarios against each other. Based on mathematics and psychology, it enables the incorporation of both qualitative and quantitative input while also considering subjective biases when rating solution alternatives.

This article explains the background for the Analytic Hierarchy Process and the application of the tool in a Project, Portfolio and Program Management context. The main focus is on explaining the application of the tool, in a step-by-step manner including a fictional case example for easier application understanding.

Contents

[edit] Overview

[edit] History

The Analytic hierarchy process is a multi-criteria decision making (MCDM) method utilized to analyse, solve and prioritize complex decisions, by rating and comparing multiple criteria and scenarios against each other [1] .

It was Thomas Saaty, regarded as one of the pioneers of Operations research which developed the Analytic Hierarchy Process throughout the 1970s. In the late 1960's, Saaty was recruited by the Arms Control and Disarmament Agency at the U.S. Department of state to direct their research projects. During his period there, he observed considerable communication difficulties between the scientists and lawyers at the department, both groups being the main contributors and decision makers in the project, which led to poor project results. Based on his experience from this period, Saaty was driven to develop a simple way to help ordinary people communicate better and make complex decisions, eventually resulting in the Analytic Hierarchy Process. From that day on, the Analytic Hierarchy Process has perhaps become the most widely used decision making method in the world with actual relevant applications counting in the thousands [2].

[edit] Application of the Analytic Hierarchy Process

Decision making and doing them right is one of the largest challenges that organizations have to face. This is especially true in the current competitive turbulent environment that organizations find themselves in. Decision making often involves multiple stakeholders throughout the organization with multiple different objectives. It has therefor become a critical factor for organization to make the right choices based on adequate and aligned objectives. This can be very hard as stakeholders tend to be subjective towards there own bias where they always choose the best alternative among those open to them, as they see them rather than focusing on the whole organizational perspective [3]. Humans tend to seek and interpret evidence in ways that will confirm there existing beliefs and hypothesis, well known in psychology as confirmation bias and thereby affecting multi-stakeholder decision making in organizational purposes[4].

The Analytic Hierarchy Process, as defined by Thomas Saaty, has been acknowledged for combining psychology and mathematics well to apply towards complex organizational decision making. The Analytic Hierarchy Process compares criteria, or alternatives with respect to a criterion in a pairwise manner. Each criteria and alternative is evaluated, based on a predetermined scale which has shown to capture individual preferences with respect to quantitative and qualitative attributes. The scale helps converts the evaluations to numerical values which are than utilized to calculate overall ratings for the possible alternatives and find the optimal solution [2]. As the qualitative input and the interpretation of the quantitative evaluations for the ratings can be inconsistent, the Analytic Hierarchy Process considers and calculates a consistency ratio for the ratings given, to prevent previously mentioned biases and to secure consistency throughout the ratings [5].

[edit] Application in a Project, Portfolio and Program Management Context

Considering how effective the Analytic Hierarchy Process is for complex decision making, it is often utilized by the PPM (Project Portfolio Management) for the prioritization and selection of projects in a portfolio. Portfolio Management includes the processes to identify, categorize, evaluate, select, prioritize, balance and authorize projects within a portfolio [6]. The selection of projects is thereby driven by multiple drivers, includes many complex decision and is affected by multiple stakeholders. The tool allows multiple inputs from stakeholders to be considered, allowing for pairwise comparison of criteria and alternatives, which can be done in a meeting or workshop environment, while maintaining a relatively high rating consistency . Allowing stakeholders to have a say in the decision making and being heard can help increase support, minimize resistance towards an individual project and thereby increase the chance for a project success [7].

The Analytic Hierarchy Process, its application and the overall understanding can therefor be considered very relevant for Project Portfolio Managers and Project Managers alike [8].

[edit] Methodology - A Step-By-Step approach

In the following section the Analytic Hierarchy Process and its application towards decision making is described in a step-by-step manner. Additionally, for a better understanding of the Analytical Hierarchy Process an example has been made to showcase the practical usage of the tool, highlighted after every described step. The example is derived from the theory, but created by the author of the article and based on a fictional case. The case example is to consider improved scenarios for the medicinal distribution within a hospital, with pre-defined criteria and possible solution alternatives.

[edit] Define the Problem

The decision making should be driven by a stated problem. The problem should be well defined and the objectives of the problem should be broadened to consider all actors, objectives and possible outcomes. All criteria that influence the solution, the chosen outcome, are then to be identified[9].

[edit] Example: Background and Definition of the problem

A consultant team has proposed two new solutions to improve the efficiency, quality and cost of distributing medicine towards the patients within a hospital. The hospital has a low level of technology, minimal usage of IT systems and the medicinal storage is spread out throughout the hospital.

  1. The first solution proposes to implement a new IT solution, a so called ERP system, for improved quality and management of medicine. It is considered relatively investment light and easy to implement, but with low cost improvements. This solution will be referred to as the New ERP System solution.
  2. The second solution proposes to radically change the storage solutions within the hospital. All storage units are to be combined in one large stocking area, with improved distribution combined with smaller stock supermarket solutions and distribution medicinal runners, which fill up the supermarkets daily. An all new ERP solution is proposed as a part of the solution. This solution has been simulated and showcases improved cost, efficiency and quality of distribution. It does though need considerable investment and it is harder to implement.

The two scenarios are to be proposed towards a steering committee within the hospital, which will have to decide what they want to do. The current state is also an option. The steering committee will use the Analytical Hierarchy Process (AHP) method to decide between the solutions.

The consultant team has proposed the following criteria that have to be considered when choosing a future solution:

  • A. Quality (quality of medicine distribution towards patience)
  • B. Ease of Implementation (Easiness of implementing new solution)
  • C. Investment (Cost of initial Investment)
  • D. Direct Cost (Reduced cost of operations)
  • E. Technology Usage (State of the art technology usage)
  • F. Stock Availability (Transparency of stock availability)
  • G. Efficiency (Efficiency in terms of daily operations)

[edit] Define the Problem Hierarchy

Figure 1 - Problem Hierarchy for the Analytical Hierarchy Process. Illustration created by author

The factors which effect the final decision are then arranged in an hierarchic structure. This serves two purposes:

  1. It helps to structure the problem and thereby better understand the complex relations between all considered factors.
  2. It helps the decision maker to visually assess whether the issues stated in each level in the hierarchy are at the same level of importance and magnitude. This is important so factors can be considered accurately and of similar manner.

The hierarchy is sorted from the overarching goal at the top, to criteria and eventual sub-criteria, and then lastly the possible alternatives that are to be considered. [5]


[edit] Example: Define the Problem Hierarchy

To start the process, the steering committee defines the hierarchy for the problem. The Distribution of medicine is defined as the overarching Goal, the pre-defined criteria shown below and lastly the three available solutions are defined as the alternatives. Each alternative has to consider each criteria in the hierarchy level above. The hierarchy is shown in Figure 1.

[edit] Pairwise comparison and Calculate the Goal Priority

Figure 2 - The Fundamental scale, inspired and adapted from Saaty [10][11]

Next step is the Pairwise comparison of attributes on each level defined with a numerical rating, based on a pre-defined numerical scale by Saaty [5]. Comparison matrices are constructed for each set of pairwise comparisons. This requires n(n-1)/2 comparisons, n defined as the number of attributes in consideration on each hierarchy level. The rating scale for the pairwise comparison goes from 1 to 9, where if attribute A is of equal importance to attribute B, it receives a rating of 1. If attribute A is of absolute more importance than B, it receives a rating of 9. Likewise, if attribute A is considered absolutely more important than B, than attribute B should be rated with the reciprocal rating of A.

Based on the comparison matrices for each set, the priorities are obtained and utilized to weigh the priorities in the level below in the hierarchy.

[edit] Example: The Pairwise Comparison and Goal Priority

With the hierarchy in place, the weight of each criteria is considered. Each criteria is compared in a pairwise comparison utilizing The Fundamental Scale for Pairwise Comparisons, shown in Figure 2:

The comparison is done in a reciprocal matrix, with the size n x n. As there are 7 criteria, the matrix has to consider 49 values. The rating scale value is inserted for each pair comparison, read as row compared to column.

The Steering committee discusses each pair comparison and eventually comes to a conclusion, resulting in the table shown below:

Figure 3 - Criteria Rating Matrix. Illustration created by Author

To calculate the priority weight of each criteria, the table has to be normalized. This is done by dividing each rating with the sum of the given column. An example is the row criteria Technology Usage for column criteria Quality. This value is calculated as follows:


0.14 / 2.03 = 0.070


This is calculated for all values in the table and results in the following, as shown below:

Figure 4 - Normalised Criteria Rating Matrix. Illustration created by Author


Lastly, to define the overall priority rating for each criteria, the average is calculated for each row (per criteria). This results in the following table:

Figure 5 - Overall priority for Criteria. Illustration created by Author

[edit] Example: Ratings per Alternatives

With the criteria in place, the solution alternatives have to be compared pairwise as well and rated. The procedure is similar, where each alternative pair is considered for each criteria.

An example for the first step of the Quality Criteria is showcased as follows:

Figure 6 - Example: Alternatives per criteria rating. Illustration created by Author

This is done for all 7 criteria and as before the table is then normalized. With all alternative pair-wize comparisons in place, the overall priority ratings per criteria for each alternative is shown in the table, Figure 7, highlighted in green:


Figure 7 - Pairwise comparison rating for all attributes. Illustration created by Author

As shown in the table, column highlighted in yellow, the Quality criteria is considered to have the highest priority while the Technology Usage criteria is considered to be of the lowest importance

[edit] Consider how consistent the ratings are

After obtaining the priorities towards the hierarchy goal, it is important to consider how reliable the ratings are. As previously mentioned, the ratings are a pairwise comparison and can be subjectively bias, as they are based on individual or group perspectives towards each criteria. In psychology, subjective bias is typically defined as Confirmation Bias, generally defined as the interpretation of evidence which is partial to ones existing beliefs and expectations. This bias can affect the overall solution, with certain criteria or alternatives weighing to much and thereby affecting the rating consistency [4].

To address this, a consistency ratio is calculated utilizing a framework and a consistency index (CI) put forward by Saaty (1997). [1]. A Principal Eigen Value is calculated, based on the global priority for each attribute. The sum of the Principal Eigen Values for all attributes is accumulated and divided with n, the number of attributes in the given hierarchy level. This gives a certain Inconsistency level. This Inconsistency level is then compared to the Consistency Index as proposed by Saaty, which is defined for each matrix of size n. The numerical value for each matrix of size n in the Consistency Index, has been calculated based on large samples of random matrices and the consistency indices of those matrices [9]. A Consistency Ratio is calculated, by dividing the Inconsistency level with the appropriate Consistency Index. If the Consistency Ratio is less than 0.1 (10%) than the matrix can be considered as being consistent. If it is higher than 10% it is advised to reconsider the attribute rating to achieve consistent measures [1].

[edit] Example: Consistency in criteria Ratings

To make sure that the steering committee was consistent throughout their criteria weight ratings, the Consistency Ratio has to be calculated. The Consistency Ratio (CR) is calculated by dividing the Inconsistency Ratio (IR) with the Consistency Index (CI) which is pre-defined for each matrix of the size n as explained in the step-by-step segment above.

First, the Principal Eigen Vector is needed. The Principal Eigen Vector is calculated by multiplying the overall priority rating for each criteria with the sum of rating for each attribute column. An example is the Principal Eigen Vector calculation for the Quality criteria. The row Quality criteria value of 0,454 is multiplied by the Quality' criteria column sum of 2,03 (as shown in Figure 3). This calculates to:


0,454 * 2,03 = 0,921


The Principal Eigen Vector is calculated for all criteria and shown as follows:

Figure 8 - The Principal Eigen Vector per criteria. Illustration created by Author


Next the Inconsistency Ratio is calculated. The Inconsistency Ratio is based on the sum of all Principal Eigen Vectors and the amount of attributes. The amount of attributes are defined as n, and the sum of the Principal Eigen Vectors as z. The formula to calculate the Inconsistency ratio is as follows:


IR = (z-n)/(n-1)


As there are 7 criteria (attributes), n is equal to 7. As shown in Figure 8, the sum of the Principal Eigen Vectors is z = 7,558. Based on the formula, this gives:


(7,558-7)/(7-1) = 0.093


The Consistency Index is based on the amount of attributes n, defined in the following table:

Figure 9 - The Random Consistency Index table, adapted from Saaty (1977) [10]


Again, as there are 7 criteria (attributes), n is equal to 7. Based on the table, that gives a Consistency Index (CI) of 1,32.

The Consistency Ratio is then calculated as follows:


CR = IR / CI


This gives:


0.093/1,32 = 7%


As the Consistency Ratio falls under 10%, the criteria ratings are considered to be consistent throughout the Matrix. The same calculations are repeated for the alternative ratings, which are also considered to be consistent as they likewise fall under 10%.

[edit] Overall weight of alternatives and optimal solution

After having considered the consistency and obtaining all the weighted priorities of criteria and alternative, it is possible to calculate the optimal alternative towards the overarching goal. This is done by calculating the weighted value per alternative, that is considering the weight of each criteria, and prioritizing the highest value.

[edit] Example: Overall weight of alternatives

The weight for each alternative within each criteria is calculated by multiplying the priorities with each other. An example is when calculating the Quality priority value with the Current State priority value, as shown in Figure 10 below:


0,454 * 0,074 = 0,033


This is done for all criteria and the results are highlighted in blue, in the following table:


Figure 10 - Priority ratings for Criteria and Alternatives. Illustration created by Author

These priorities are than summed up an a matrix, where the sum of all criteria per alternative is calculated. The sum is the overall priority goal for the Optimized Distribution of Medicine, per alternative. The Goal priorities are shown in the following table, highlighted in gray:

Figure 11 - Overall priority Goal Ratings for alternatives. Illustration created by Author


As can be seen in the table, the New Footprint alternative is prioritized as the best solution with a Goal priority of 0.42 , based on all criteria and inputs for an optimized distribution of medicine within the hospital.

[edit] Perform a Sensitivity Analysis

Lastly, it is advised to perform a sensitivity analysis to observe the impact of modifying the input data towards the results. This is done by modifying the ranking of individual criteria as well the criteria weight towards the possible alternatives. If the global priority rank does not change, the results are considered to be robust[1].

[edit] Example: Sensitivity Analysis

The consultant team proposes that a simple sensitivity analysis should be made. The steering committee wants to consider if they weighed the Quality criteria to high compared to the Investment criteria. They have therefor increased the weight of the investment by 0.3 and decreased the weight of the quality criteria by 0.3, as shown in Figure 12:

Figure 12 - Sensitivity Analysis with adjusted criteria ratings


When calculated through, this results in the following:

Figure 13 - Overall priority goal for Sensitivity Analysis. Ref6


As can be seen for the overall goal priority, the New Footprint solution is still considered to be the optimal solution, with a Goal priority of 0.59 .

The Steering Committee and the consultant team feel confident in their consistent choices and rating considerations, and it is decided to go forward with the larger investment of an improved distribution footprint within the hospital.

[edit] Application Areas

The Analytical Hierarchy Process is possible the most widely utilized decision making method in the whole world. Application cases run in the thousands as well as there are more than a 1000 scientific articles regarding the method and over a 100 doctoral dissertations. [2]

The method has been used in a wide spread of areas within both the public and the private sector. The main but not only examples of applications are as follows:

  • Choices involving the selection of alternatives from a set of alternatives, as exemplified in the step-by-step segment above. This can be choosing a new technological solution, choosing a new supplier or deciding on a new product for a new market etc.
  • Prioritization or evaluation of alternatives. Rather than only choosing one alternative, a few alternatives can be highlighted as the best ones. This could be relevant, for example if a company wants to consider a combination of alternatives.
  • Resource allocation, for example budgeting for an array of multiple projects and defining which projects to prioritize and invest in. This application could be defined as a typical Project Portfolio Management approach, when defining projects to invest in within the portfolio.[2]

[edit] Limitations

Even though the Analytic Hierarchy Process is widespread and often defined as one of the most adapted decision tool in the world, there are limitations that have to be considered.

[edit] Pairwise Comparison

Due to the fact that all attributes on each level in the hierarchy have to be pairwise compared, the procedure can be quite cumbersome. This increases the resource and time usage needed to be able to define the optimal solution. Additionally, the pairwise comparison is very qualitative due to the fact that participants evaluate the ratings based on individual or group input, which can be hard to quantify. This also includes quantitative information, as that has to be converted into the defined numerical scale.

[edit] The Numerical Scale

There have been some discussions regarding the pre-defined linear scale ranging from 1 to 9 and if it is the optimal scale for solutions. Many different versions of the scale have been proposed, which include among others:

  • Geometric scale (9 values, ranging 1, 2, 4, 8, 16, 32, 64, 128, 256)
  • Logarithmic scale (9 values, ranging logarithmically from 1 to 3,32)
  • Balanced Scale (9 values, with a balanced weighted value approach from 1 to 9)

The scale discussion in the scientific community is a very heated debate and no one solution is defined. Saaty's original 1 to 9 scale is currently the most adapted scale worldwide, while scientists argue that the scale choice rather should depend on the person and the decision problem at any given time.[1]

[edit] Considerations

The highlighted limitations showcase the importance of calculating the Consistency factor and to consider the Sensitivity Analysis carefully. Utilizing these steps, should help counteract the qualitative biases and scale rating biases when applying the tool.

[edit] Glossary

Criteria: A standard or input that has an effect on the solution choice

Matrix: A mathematical term used for a rectangular array of numbers, most often referred to as a table

Reciprocal: A mathematical term used when a number x is divided by 1, that is x becomes 1/x

Quantitative: When an input is measured in numerical values

Qualitative: When an input is measured in words, size, appearance etc., but not based entirely on numerical measurable values

ERP-System: Enterprise Resource Planning, a IT platform used to streamline information and processes across an organization

[edit] Annotated Bibliography

Thomas L. Saaty , Decision making with the analytic hierarchy process, 2008:

  • A recent article written by Thomas L. Saaty, the creator of the Analytic Hierarchy Process. A great introductory article with good explenations for the tool

Alessio Ishizaka & Philippe Nemery, Multi-Criteria Decision Analysis: Methods and Software, 2013:

  • A good introductionary article explaining the overall approach of the Analytic Hierarchy Process. Additionally is deepdives into the mathematics behind the Consistency Ration, explaining the Eigenvector and Eigenvalue calculations.

Ernest H. Forman & Saul I. Gass , "The Analytic Hierarchy Process - An Exposition", 2001:

  • A good journal discussing and highlighting the multiple application possibilities for the Analytic Hierarchy Process, with case and organizational examples

Deepdive:

Thomas L. Saaty , Mathematical Principles of Decision Making (Principia Mathematica Decernendi), 2010:

  • An in-depth summary and full theory explanation of the Analytic Hierarchy Process written by the creator of the Analytic Hierarchy Process and the Analytic Network Process

[edit] Bibliography

References
  1. ↑ 1.0 1.1 1.2 1.3 1.4 (“Ishizaka Alessio, Labib Ashraf, Analytic Hierarchy Process and Expert Choice: Benefits and Limitations, ORInsight, 22(4), p. 201–220, 2009)
  2. ↑ 2.0 2.1 2.2 2.3 (Forman Ernest H., Gass Saul I.,The Analytic Hierarchy Process - An Exposition, 2001)
  3. ↑ (Edwards Ward,The Theory of Decision Making, 1954)
  4. ↑ 4.0 4.1 (Nickerson Raymond S., Confirmation Bias: A Ubiquitous Phenomenon in Many Guises, 1998)
  5. ↑ 5.0 5.1 5.2 (Saaty Thomas L., Decision making with the analytic hierarchy process,Int. J. Services Sciences Vol. 1 No.1, 2008)
  6. ↑ (PMI, The Standard for Portfolio Management, page 21, 2008)
  7. ↑ (PMBOK® Guide, A Guide to the Project Management Body of Knowledge, Fifth Edition, chapter 13.3, 2013)
  8. ↑ (Vargas R. V., Using the analytic hierarchy process (ahp) to select and prioritize projects in a portfolio, 2010)
  9. ↑ 9.0 9.1 (Vaidy Omkarprasad S., Kumar Sushil, Analytic hierarchy Process: An overview of applications, European Journal of Operational Research 169, 2006)
  10. ↑ 10.0 10.1 (Ishizaka Alessio, Nemery Philippe, Multi-Criteria Decision Analysis: Methods and Software, 2013)
  11. ↑ (Lou Sander, https://en.wikipedia.org/wiki/Analytic_hierarchy_process_%E2%80%93_car_example#/media/File:AHPFundamentalScale.png, 2008)
Retrieved from "http://wiki.doing-projects.org/index.php?title=Analytic_Hierarchy_Process&oldid=60261"
Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox