Earned value management (EVM)
(→Scenario 3: Both types of issues affect the project) |
(→Absolute indices) |
||
(126 intermediate revisions by one user not shown) | |||
Line 1: | Line 1: | ||
''By Martina Rampazzo'' | ''By Martina Rampazzo'' | ||
− | Earned value management (EVM) is a methodology for performance measurement which can be applied to individual projects across programs and portfolios <ref>Cable, J. H., Ordonez, J. F., Chintalapani, G. and Plaisant, C. (2004). ''Project portfolio earned value management using Treemaps.'' Paper presented at PMI® Research Conference: Innovations, London, England. Newtown Square: Project Management Institute. (PMI).</ref>. EVM is used in the planning, executing and controlling phases of the PMI Project Management Standard and mainly involves the knowledge areas of scope, time, cost, communication and integration <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>. More specifically, EVM falls into the ''project cost management'' and ''plan schedule and cost management'' phases of the PMI Standard of Project Management <ref>Project Management Institute, Inc. (2017). ''Guide to the Project Management Body of Knowledge (PMBOK® Guide)'' (6th Edition). Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>. | + | Earned value management (EVM) is a methodology for performance measurement which can be applied to individual projects across programs and portfolios <ref>Cable, J. H., Ordonez, J. F., Chintalapani, G. and Plaisant, C. (2004). ''Project portfolio earned value management using Treemaps.'' Paper presented at PMI® Research Conference: Innovations, London, England. Newtown Square: Project Management Institute. (PMI)., p. 1 </ref>. EVM is used in the planning, executing and controlling phases of the PMI Project Management Standard and mainly involves the knowledge areas of scope, time, cost, communication and integration <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>. More specifically, EVM falls into the ''project cost management'' and ''plan schedule and cost management'' phases of the PMI Standard of Project Management <ref>Project Management Institute, Inc. (2017). ''Guide to the Project Management Body of Knowledge (PMBOK® Guide)'' (6th Edition). Pennsylvania, USA: Project Management Institute, Inc. (PMI)., pp. 173-270</ref>. |
[[File:PMI relationship.png|500px|thumb|Figure 1: Earned value management for project management (own figure, created based on <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>)]] | [[File:PMI relationship.png|500px|thumb|Figure 1: Earned value management for project management (own figure, created based on <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>)]] | ||
− | Figure 1 shows how EVM relates to project management phases and the activities which it comprises. While it might appear as | + | Figure 1 shows how EVM relates to project management phases and the activities which it comprises. While it might appear as mainly related to monitoring and controlling, EVM brings to the project managers’ attention the importance of performance measurement since the planning phase, with the need for accurate planning and for the realization of a project which is easy to execute and measure. |
− | This article will describe the EVM methodology applied to projects, with motivations of its relevance, prerequisites for a successful implementation as well as concrete explanations and applications of each of its key metrics. While EVM is a topic already widely discussed | + | This article will describe the EVM methodology applied to projects, with motivations of its relevance, prerequisites for a successful implementation as well as concrete explanations and applications of each of its key metrics. While EVM is a topic already widely discussed in project management from a theoretical point of view, this article will outline how to apply the tool to practical real life projects. Finally, the main limitations of EVM will be discussed thoroughly, including suggestions for project managers on how to face these challenges. |
== Why project managers should use EVM? == | == Why project managers should use EVM? == | ||
− | EVM is a tool created by the | + | EVM is a tool created by the U.S. Department of Defense in 1967 and later used to monitor Department of Education projects, such as the U.S. Large Hadron Collider (LHC) of CERN <ref name="cern"> Ferguson J., Kissler K.H. (2002). ''Earned Value Management''. CERN-AS-2002-010</ref>. The ability to connect cost and schedule, to identify project performance indicators and express cost and technical performance in an understandable way, led to the diffusion of this tool and to its increased application in the field of project management <ref name="ES">Lipke W. and Henderson K.(2010). Earned Schedule: An Emerging Enhancement to Earned Value Management. In: ''CROSSTALK The Journal of Defense Software Engineering'', pp. 26-29</ref>. EVM encompasses earned value analysis, which consists in defining a set of indices to monitor the project’s schedule and cost. Subsequently, this data is used to also calculate variance and trend analysis, as well as predictions for the future. Therefore, EVM provides a holistic view on the project’s progress and identifies deviations from the plan and budget, allowing project managers to react to these discrepancies by implementing corrective actions. |
− | + | ||
− | EVM encompasses earned value analysis, | + | |
== The prerequisites for a successful implementation of EVM == | == The prerequisites for a successful implementation of EVM == | ||
Line 18: | Line 16: | ||
*Assigning management responsibility to each of the control account <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>; | *Assigning management responsibility to each of the control account <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>; | ||
*Planning how to keep track of physical work progress and how to assign budgetary earned value for each activity <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>; | *Planning how to keep track of physical work progress and how to assign budgetary earned value for each activity <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>; | ||
− | + | *Implementing change management plans to ensure EVM remains relevant if the project scope changes <ref name="work"> Lukas J.A. (2008). 2008 AACE INTERNATIONAL TRANSACTIONS. ''Earned Value Analysis – Why it Doesn't Work'', pp. 6-9</ref>; | |
− | *Implementing change management plans to ensure EVM remains relevant if the project scope changes <ref name="work"> Lukas J.A. (2008). 2008 AACE INTERNATIONAL TRANSACTIONS. ''Earned Value Analysis – Why it Doesn't Work''</ref>; | + | *Using an adequate cost collection system to track actual cost and outstanding invoices <ref name="work"> Lukas J.A. (2008). 2008 AACE INTERNATIONAL TRANSACTIONS. ''Earned Value Analysis – Why it Doesn't Work'', pp. 6-9</ref>; |
− | *Using an adequate cost collection system to track actual cost and outstanding invoices <ref name="work"> Lukas J.A. (2008). 2008 AACE INTERNATIONAL TRANSACTIONS. ''Earned Value Analysis – Why it Doesn't Work''</ref>; | + | |
*Conducting reporting activities in order to interpret the data obtained and subsequently communicate it to the relevant stakeholders <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>. | *Conducting reporting activities in order to interpret the data obtained and subsequently communicate it to the relevant stakeholders <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>. | ||
Line 38: | Line 35: | ||
=== Definition of the time-phased budget === | === Definition of the time-phased budget === | ||
− | + | The first step of EVM is representing the BCWS, also called the baseline of the project, which represents the cumulative cost of the activities for each period of time and therefore aggregates the budgeted cost of all control accounts. The curve can be obtained thanks to the Gantt chart, which displays the scheduled activities of the project in each unit of time. An example is provided below to clarify this process. | |
− | The first step of EVM is representing the BCWS, also called the baseline of the project, which represents the cumulative cost of the activities for each period of time and therefore aggregates the budgeted cost of all control accounts. The curve can be obtained thanks to the Gantt chart | + | |
The following set of activities is given, with information on predecessors, scheduled time and budgeted cost. | The following set of activities is given, with information on predecessors, scheduled time and budgeted cost. | ||
Line 48: | Line 44: | ||
!Time | !Time | ||
!Cost | !Cost | ||
− | |||
|- | |- | ||
|A | |A | ||
|/ | |/ | ||
|2 | |2 | ||
− | |||
|15 | |15 | ||
|- | |- | ||
|B | |B | ||
|A | |A | ||
− | | | + | |4 |
− | + | ||
|20 | |20 | ||
|- | |- | ||
Line 65: | Line 58: | ||
|A, B | |A, B | ||
|1 | |1 | ||
− | |||
|30 | |30 | ||
|- | |- | ||
Line 71: | Line 63: | ||
|B | |B | ||
|4 | |4 | ||
− | |||
|10 | |10 | ||
|} | |} | ||
− | After creating the Gantt diagram, the BCWS is drawn so that cumulated costs across all scheduled activities are displayed for each time period. For example, in the first month only activity A occurs, so only its cost (15€) will be added to the BCWS. On the second month, activity A is still taking place so the cumulative cost will be 30€. | + | After creating the Gantt diagram ([[Gantt Chart in Project Management]]), the BCWS is drawn so that cumulated costs across all scheduled activities are displayed for each time period. For example, in the first month only activity A occurs, so only its cost (15€) will be added to the BCWS. On the second month, activity A is still taking place so the cumulative cost will be 30€. |
− | <div><ul><li style="display: inline-block;">[[File:Gantt_MR.png| | + | <div><ul><li style="display: inline-block;">[[File:Gantt_MR.png|390px|thumb|Figure 2: Gantt diagram (own figure)]]</li><li style="display: inline-block;">[[File:BCWS_2.png|300px|thumb|Figure 3: BCWS (own figure)]]</li></ul></div> |
=== Monitoring time and costs === | === Monitoring time and costs === | ||
− | |||
Monitoring of costs during the life of a project allows to trace the ACWP, which is the actual cost of work performed. This is extremely relevant as the real costs spent on a project often diverge from the planned ones, as many unforeseen events can occur. Usually actual costs are calculated by checking the actual division of work among manpower and using tools such as cost and time reports, which show how the resources of a project team spent their time and the total amount of expenditures <ref name="art"> Andawei, M. (2014). ''Project cost monitoring and control: A case of cost/time variance and earned value analysis''. IOSR Journal of Engineering (IOSRJEN), Vol. 04, Issue 02, p. 23.</ref>. | Monitoring of costs during the life of a project allows to trace the ACWP, which is the actual cost of work performed. This is extremely relevant as the real costs spent on a project often diverge from the planned ones, as many unforeseen events can occur. Usually actual costs are calculated by checking the actual division of work among manpower and using tools such as cost and time reports, which show how the resources of a project team spent their time and the total amount of expenditures <ref name="art"> Andawei, M. (2014). ''Project cost monitoring and control: A case of cost/time variance and earned value analysis''. IOSR Journal of Engineering (IOSRJEN), Vol. 04, Issue 02, p. 23.</ref>. | ||
− | === | + | === Deviation analysis === |
[[File:Scenarios.png|550px|thumb|Figure 4: Possible scenarios of deviation analysis (own figure, created based on <ref name="graphs"> Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer</ref>)]] | [[File:Scenarios.png|550px|thumb|Figure 4: Possible scenarios of deviation analysis (own figure, created based on <ref name="graphs"> Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer</ref>)]] | ||
− | BCWS and ACWP alone do not provide any information on the nature of a potential deviation. For example, if ACWP > BCWS, it might be that the project either is inefficient, so actual expenditures are higher than | + | BCWS and ACWP alone do not provide any information on the nature of a potential deviation. For example, if ACWP > BCWS, it might be that the project either is inefficient, so actual expenditures are higher than the budget, or work is being performed earlier compared to the schedule. For this reason traditional cost management is not precise enough and it is essential to analyze a third curve, the BCWP. |
− | The BCWP can be calculated by multiplying the percentage of completion (POC) with the budget at completion (BAC), which is the total budget of the project. The different methods to calculate the POC will be described further in | + | The BCWP can be calculated by multiplying the percentage of completion (POC) with the budget at completion (BAC), which is the total budget of the project. The different methods to calculate the POC will be described further in section 4. |
:<math> | :<math> | ||
Line 92: | Line 82: | ||
</math> | </math> | ||
− | A useful way to conduct deviation analysis is to group the three metrics into one graph, | + | A useful way to conduct deviation analysis is to group the three metrics into one graph, as shown in figure 4. This analysis generates 2<sup>n</sup> scenarios, where n is the number of parameters being studied. Being that with EVM the parameters are time and cost, the possible scenarios are four: |
#Project late compared to the schedule and inefficient | #Project late compared to the schedule and inefficient | ||
Line 99: | Line 89: | ||
#Project on time/early compared to the schedule and inefficient | #Project on time/early compared to the schedule and inefficient | ||
− | Other than graphically, it is also possible to evaluate time and costs with | + | Other than graphically, it is also possible to evaluate time and costs with indices, both relative and absolute, with the former expressing deviations in percentage, while the latter in monetary units. |
− | + | ||
− | + | ||
+ | ==== Relative indices ==== | ||
Relative indices are cost performance index (CPI) and schedule performance index (SPI). If these indices are greater than one, then the project is efficient and ahead of schedule respectively. | Relative indices are cost performance index (CPI) and schedule performance index (SPI). If these indices are greater than one, then the project is efficient and ahead of schedule respectively. | ||
Line 110: | Line 99: | ||
</math> | </math> | ||
− | + | ==== Absolute indices ==== | |
− | + | Absolute indices provide the same information of the relative ones but with different formulas, as shown below. In this case, it is preferred to have values larger than 0 for both cost variance (CV) as well as schedule variance (''SV''<sub>m</sub>). | |
− | Absolute indices provide the same information of the relative | + | |
:<math> | :<math> | ||
Line 118: | Line 106: | ||
\mathrm{SV_m}={\mathrm{BCWP}}-{\mathrm{BCWS}} | \mathrm{SV_m}={\mathrm{BCWP}}-{\mathrm{BCWS}} | ||
</math> | </math> | ||
− | [[File: | + | [[File:ES_2.png|600px|thumb|Figure 5: Earned Schedule (own figure, created based on <ref name="graphs"> Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer</ref>)]] |
− | It is important to notice that schedule variance is expressed in monetary units instead of time units, which is more challenging to interpret. This topic was widely discussed from the 1970s, as EVM originally did not include schedule deviations in time units. According to the article ''Earned Schedule: An Emerging Enhancement to Earned Value Management'' by Lipke W. and Henderson K., this situation led over time to project managers using the EVM methodology primarily to understand costs rather than schedule <ref name="ES">Lipke W. | + | It is important to notice that schedule variance is expressed in monetary units instead of time units, which is more challenging to interpret. This topic was widely discussed from the 1970s, as EVM originally did not include schedule deviations in time units. According to the article ''Earned Schedule: An Emerging Enhancement to Earned Value Management'' by Lipke W. and Henderson K., this situation led over time to project managers using the EVM methodology primarily to understand costs rather than schedule <ref name="ES">Lipke W. and Henderson K.(2010). Earned Schedule: An Emerging Enhancement to Earned Value Management. In: ''CROSSTALK The Journal of Defense Software Engineering'', pp. 26-29</ref>. However, in 2002 the ''earned schedule'' concept was introduced, a metric which indicates the instant of time in which the BCWS is equal to the BCWP. If these two curves do not match, the projection of the first one onto the second one is the amount of work performed which should be earned according to the schedule (BCWS). The earned schedule is the time from when the project begins up to the projection of this intersection onto the time axis, as shown in figure 5. |
In this way, schedule variance can be expressed in time units by subtracting the current period (which in this article will be referred to as Time Now) from the earned schedule. If this value is greater than zero, then it means the project is ahead of schedule. | In this way, schedule variance can be expressed in time units by subtracting the current period (which in this article will be referred to as Time Now) from the earned schedule. If this value is greater than zero, then it means the project is ahead of schedule. | ||
Line 128: | Line 116: | ||
</math> | </math> | ||
− | + | Moreover, if the trend of the BCWS is constant in the interval of time considered, meaning that the same activity is taking place during the entire time, then the schedule variance in time units can also be expressed with the following formula (where BCWS<sup>*</sup> is the trend of the curve): | |
:<math> | :<math> | ||
Line 134: | Line 122: | ||
</math> | </math> | ||
− | The case in which the BCWS is not constant will be discussed in | + | The case in which the BCWS is not constant will be discussed in section 6 of this article. |
+ | |||
+ | [[File:EAC_2.png|380px|thumb|Figure 6: Estimate at Completion and Schedule at Completion (own figure, created based on <ref name="graphs"> Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer</ref>)]] | ||
=== Forecasting === | === Forecasting === | ||
− | |||
By calculating deviation indices, project managers have a picture of the project’s performance in that specific moment. However, before implementing any corrective actions, it is necessary to understand what would be the final arrival point of the project if it continued with the same trend. In fact, identifying, planning, and mobilizing resources to implement corrective actions are time consuming and expensive activities, and may not be necessary if the final performance of the project is within the acceptable range. | By calculating deviation indices, project managers have a picture of the project’s performance in that specific moment. However, before implementing any corrective actions, it is necessary to understand what would be the final arrival point of the project if it continued with the same trend. In fact, identifying, planning, and mobilizing resources to implement corrective actions are time consuming and expensive activities, and may not be necessary if the final performance of the project is within the acceptable range. | ||
− | The key metrics to forecast future trends are EAC and SAC, which stand for Estimate At Completion and Schedule at Completion. In addition to these metrics, there is also Variance at Completion, which will not be covered in this article (if interested, read more about it at <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>). From a graphical point of view, these metrics are obtained by extending the ACWP | + | The key metrics to forecast future trends are EAC and SAC, which stand for Estimate At Completion and Schedule at Completion. In addition to these metrics, there is also Variance at Completion, which will not be covered in this article (if interested, read more about it at Practice Standard for Earned Value Management of Project Management Institute, p. 19 <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>). From a graphical point of view, these metrics are obtained by extending the ACWP until the end of the project. |
Mathematically, it is important to define which type of effects the deviation analysis in step 3 has on the project. The possible scenarios are three. | Mathematically, it is important to define which type of effects the deviation analysis in step 3 has on the project. The possible scenarios are three. | ||
==== Scenario 1: The effect of the issue on the project is limited ==== | ==== Scenario 1: The effect of the issue on the project is limited ==== | ||
− | |||
This is the case of deviations from original planning due to external factors which impacted the project but have ended their effect. For example, this is the case of higher prices for raw materials and therefore higher costs which impact only limited initial activities of the project. | This is the case of deviations from original planning due to external factors which impacted the project but have ended their effect. For example, this is the case of higher prices for raw materials and therefore higher costs which impact only limited initial activities of the project. | ||
Line 154: | Line 142: | ||
==== Scenario 2: The effect of the issue on the project is extended ==== | ==== Scenario 2: The effect of the issue on the project is extended ==== | ||
− | + | The second scenario corresponds to an issue impacting not only current activities, but also the entire project. There are also other alternatives to this calculation which can be found at ''Practice Standard for Earned Value Management'' of Project Management Institute, pg. 21 <ref name="standard">Project Management Institute, Inc. (2005). ''Practice Standard for Earned Value Management''. Pennsylvania, USA: Project Management Institute, Inc. (PMI).</ref>. | |
− | The second scenario corresponds to an issue impacting not only current activities, but also the entire | + | |
:<math> | :<math> | ||
Line 163: | Line 150: | ||
==== Scenario 3: Both types of issues affect the project ==== | ==== Scenario 3: Both types of issues affect the project ==== | ||
− | [[File:Forecasting_MR.png|500px|thumb|Figure | + | [[File:Forecasting_MR.png|500px|thumb|Figure 7: Forecasting steps for Scenario 3 (own figure, created based on <ref name="PoliFC">Pozzi A. Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). ''Sistemi Organizzativi: Stime a finire - Scostamenti Contingenti e Strutturali''. Class lecture.</ref>)]] |
− | Practically speaking, it is possible that the project falls into a grey zone in between the two scenarios and that there are two components of a deviation, one for each of the two scenarios. In this case, studies from the Department of Management, Economics and Industrial Engineering of Politecnico di Milano suggest the following steps to calculate EAC and SAC <ref name="PoliFC"> Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). ''Stime a finire - Scostamenti Contingenti e Strutturali''. | + | Practically speaking, it is possible that the project falls into a grey zone in between the two scenarios and that there are two components of a deviation, one for each of the two scenarios. In this case, studies from the Department of Management, Economics and Industrial Engineering of Politecnico di Milano suggest the following steps to calculate EAC and SAC <ref name="PoliFC">Pozzi A. Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). ''Sistemi Organizzativi: Stime a finire - Scostamenti Contingenti e Strutturali''. Class lecture.</ref>. The suggested process is valid if cost and time deviations of scenario 1 are efficiency (''Lower cost''<sub>1</sub> in the formula) and anticipation compared to the schedule (''Earlier schedule''<sub>1</sub> in the formula). In the opposite case in which scenario 1 deviations are inefficiency and lateness, the formulas of step 1 and 3 will have the opposite sign. |
+ | *Remove the positive deviations with limited effect and calculate the new ACWP* and BCWP*; | ||
− | |||
:<math> | :<math> | ||
\mathrm{ACWP^*}={\mathrm{ACWP}}+{\mathrm{Lower\ cost_1}}\qquad\qquad | \mathrm{ACWP^*}={\mathrm{ACWP}}+{\mathrm{Lower\ cost_1}}\qquad\qquad | ||
\mathrm{BCWP^*}={\mathrm{BCWP}}-{\mathrm{Earlier\ schedule_1}} | \mathrm{BCWP^*}={\mathrm{BCWP}}-{\mathrm{Earlier\ schedule_1}} | ||
</math> | </math> | ||
− | + | ||
− | + | *Calculate CPI* and SPI* and the corresponding EAC* and SAC* with the values obtained in step 1. These are the forecasted values which account only for deviations of scenario 2; | |
+ | *Calculate EAC and SAC by reintroducing the deviations of scenario 1 | ||
:<math> | :<math> | ||
Line 181: | Line 169: | ||
</math> | </math> | ||
− | === To Complete | + | === To Complete Indices === |
− | + | The last step of EVM consists in defining the SPI and CPI indices the project should have in order to reach the desired schedule and cost targets. To evaluate their actual concrete feasibility, To Complete Performance Index (TCPI) and To Complete Schedule Performance Index (TSPI) are calculated: | |
− | The last step of EVM consists in defining the SPI and CPI indices the project should have in order to | + | |
:<math> | :<math> | ||
Line 193: | Line 180: | ||
</math> | </math> | ||
− | Project managers should interpret these indices to understand whether it is really feasible to maintain them until the end of the project. A research conducted by the U.S. Department of Defense concluded that once a WBE is over 20% of its completion, CPI and SPI indices should not be increased by 10% <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref> because the WBE is | + | Project managers should interpret these indices to understand whether it is really feasible to maintain them until the end of the project. A research conducted by the U.S. Department of Defense concluded that once a work breakdown element (WBE) is over 20% of its completion, CPI and SPI indices should not be increased by 10% <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref> because the WBE is considered stable and therefore the final performance of a project will not diverge significantly. |
== Percentage of Completion Calculation Methods (POC) == | == Percentage of Completion Calculation Methods (POC) == | ||
− | + | As explained previously, in order to calculate the BCWP, project managers need to estimate the POC, which describes the actual progress of the project. There are many methods to evaluate progress, some objective and others subjective. This article will divide the POC calculation methods according to the division presented in the article ''Analysis and application of earned value management to the Naval Construction Force'', pp.18-20 <ref name="Hayes">Hayes, R. (2001). ''Analysis and application of earned value management to the Naval Construction Force''. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library</ref> and will briefly explain the most relevant limitations. | |
− | As explained previously, in order to calculate the BCWP, project managers need to estimate the POC, which describes the actual progress of the project. There are many methods to evaluate progress, some objective and others subjective. This article will divide the POC calculation methods according to the division presented in the article ''Analysis and application of earned value management to the Naval Construction Force'' <ref name="Hayes">Hayes, R. (2001). ''Analysis and application of earned value management to the Naval Construction Force''. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library</ref> and will briefly explain the most relevant limitations | + | |
# '''Discrete effort''': | # '''Discrete effort''': | ||
Line 206: | Line 192: | ||
#:* '''Percent Complete with Milestone Gates Method''': a variation of the milestone method which allows to report subjective percentages of completion to the activity until the milestone is reached; | #:* '''Percent Complete with Milestone Gates Method''': a variation of the milestone method which allows to report subjective percentages of completion to the activity until the milestone is reached; | ||
#:* '''Earned Standards''': determines the percentage of completion according to standards derived from historical data, time and motion studies and other methods. It is challenging to apply one unique standard as every project has its own specific characteristics and is influenced by factors which vary from project to project. | #:* '''Earned Standards''': determines the percentage of completion according to standards derived from historical data, time and motion studies and other methods. It is challenging to apply one unique standard as every project has its own specific characteristics and is influenced by factors which vary from project to project. | ||
− | # '''Apportioned Effort''': associates activities which are closely correlated in terms of planning and performance. An example is | + | # '''Apportioned Effort''': associates activities which are closely correlated in terms of planning and performance. An example is using the same percentage of completion for both production control and production. |
# '''Level of Effort (LoE)''': it assumes that the progress of activities is proportional to time. This method should be avoided as it assumes that BCWP is always the same as BCWS. In this way, SV and SPI will always be equal to 0 and 1 respectively and misleading cost variances will be generated <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref>. | # '''Level of Effort (LoE)''': it assumes that the progress of activities is proportional to time. This method should be avoided as it assumes that BCWP is always the same as BCWS. In this way, SV and SPI will always be equal to 0 and 1 respectively and misleading cost variances will be generated <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref>. | ||
− | As a result, some methods are by nature more subjective, like level of effort, apportioned effort, percent complete method, | + | As a result, some methods are by nature more subjective, like level of effort, apportioned effort, percent complete method, while others are more objective and therefore suit controlling activities, such as milestone, fixed formula and equivalent unit methods. Project managers should avoid the use of subjective methods since their level of accuracy is questionable and, if not completely possible, impose a limit on the number of activities controlled with such logics <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref>. |
== Application of EVM == | == Application of EVM == | ||
− | |||
The following section provides a practical application of the concepts of EVM explained in the previous chapters. The assumption of this example is that, at the beginning of day 16, controlling and monitoring activities are conducted to evaluate the performance of the project. The EVM structure previously discussed will be applied in this example step by step. | The following section provides a practical application of the concepts of EVM explained in the previous chapters. The assumption of this example is that, at the beginning of day 16, controlling and monitoring activities are conducted to evaluate the performance of the project. The EVM structure previously discussed will be applied in this example step by step. | ||
− | === | + | === Definition of the time-phased budget === |
The following table is given, with activities, predecessors, planned duration and costs. | The following table is given, with activities, predecessors, planned duration and costs. | ||
Line 254: | Line 239: | ||
|120 | |120 | ||
|} | |} | ||
− | To calculate the BCWS, it is useful to create the network of the project in order to check which activities should have been completed on day 16 (figure | + | To calculate the BCWS, it is useful to create the network of the project in order to check which activities should have been completed on day 16 (figure 8, where the critical path has been highlighted in red). |
− | [[File:Network.png|left|500px|thumb|Figure | + | [[File:Network.png|left|500px|thumb|Figure 8: Network and critical path (own figure)]] |
+ | :<math>\mathrm{BCWS_{16}}=\mathrm{\sum Expected\ cost*Percentage\ complete}={\mathrm{100%}}*{\mathrm{30}}+{\mathrm{100%}}*{\mathrm{40}}+{\mathrm{100%}}*{\mathrm{70}}+\frac{ {\left ({\mathrm{16}}-{\mathrm{13}} \right )}}{\mathrm{4}}*{\mathrm{40}}+\frac{ {\left ({\mathrm{16}}-{\mathrm{15}} \right )}}{\mathrm{10}}*{\mathrm{60}}+{\mathrm{0%}}*{\mathrm{120}}={\mathrm{176}}</math> | ||
+ | === Monitoring time and costs === | ||
+ | It is assumed that the monitoring of costs results in ''ACWP''<sub>16</sub>=''90''. | ||
− | + | === Deviation analysis === | |
− | + | In this example, the percentage of completion method is used to calculate BCWP and it is assumed that the control account manager provided the following information: | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | === | + | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | In this example, the percentage of completion method is used to calculate BCWP and it is assumed that the control account manager provided the following information | + | |
{| class="wikitable" style="text-align: center;" | {| class="wikitable" style="text-align: center;" | ||
Line 316: | Line 275: | ||
Therefore the BCWP in day 16 is given by: | Therefore the BCWP in day 16 is given by: | ||
− | :<math>\mathrm{BCWP_{16}}=\mathrm{\sum Expected\ cost*Percentage\ of\ completion} = {\mathrm{100%}}*{\mathrm{30}} + {\mathrm{100%}}*{\mathrm{40}}+{\mathrm{25%}}*{\mathrm{70}}+{\mathrm{50%}}*{\mathrm{40}}+{\mathrm{0%}}*{\mathrm{60}}+{\mathrm{0%}}*{\mathrm{120}}={\mathrm{107.5}}</math> | + | :<math>\mathrm{BCWP_{16}}=\mathrm{\sum Expected\ cost*Percentage\ of\ completion}={\mathrm{100%}}*{\mathrm{30}}+{\mathrm{100%}}*{\mathrm{40}}+{\mathrm{25%}}*{\mathrm{70}}+{\mathrm{50%}}*{\mathrm{40}}+{\mathrm{0%}}*{\mathrm{60}}+{\mathrm{0%}}*{\mathrm{120}}={\mathrm{107.5}}</math> |
==== Relative indices ==== | ==== Relative indices ==== | ||
− | |||
:<math> | :<math> | ||
\mathrm{CPI}=\frac{\mathrm{BCWP}}{\mathrm{ACWP}}={\mathrm{1.19}}\qquad\qquad\qquad\qquad | \mathrm{CPI}=\frac{\mathrm{BCWP}}{\mathrm{ACWP}}={\mathrm{1.19}}\qquad\qquad\qquad\qquad | ||
Line 326: | Line 284: | ||
==== Absolute indices ==== | ==== Absolute indices ==== | ||
− | |||
:<math> | :<math> | ||
\mathrm{CV}={\mathrm{BCWP}}-{\mathrm{ACWP}}={\mathrm{17.5}}\qquad\qquad | \mathrm{CV}={\mathrm{BCWP}}-{\mathrm{ACWP}}={\mathrm{17.5}}\qquad\qquad | ||
\mathrm{SV_m}={\mathrm{BCWP}}-{\mathrm{BCWS}}={\mathrm{-68.5}} | \mathrm{SV_m}={\mathrm{BCWP}}-{\mathrm{BCWS}}={\mathrm{-68.5}} | ||
</math> | </math> | ||
+ | |||
The indices show that the project is efficient and late compared to the schedule. | The indices show that the project is efficient and late compared to the schedule. | ||
− | It is also useful to calculate the schedule variance expressed in time units to verify how much days the project is late. In this exercise, the trend of the BCWS in day 16 is constant as no new activity is started | + | It is also useful to calculate the schedule variance expressed in time units to verify how much days the project is late. In this exercise, the trend of the BCWS in day 16 is constant as no new activity is started and no activity is finished compared to day 15. In this time period only activities 4 and 5 are occurring, therefore only their expected costs and durations are considered: |
:<math> | :<math> | ||
Line 368: | Line 326: | ||
</math> | </math> | ||
− | === To Complete | + | === To Complete Indices === |
:<math> | :<math> | ||
\mathrm{TCPI}=\frac{ {\left ({\mathrm{BAC}}-{\mathrm{BCWP}} \right )}} {\left ({\mathrm{New\ Cost}}-{\mathrm{ACWP}} \right )}=\frac{ {\left ({\mathrm{360}}-{\mathrm{107.5}} \right )}} {\left ({\mathrm{360}}-{\mathrm{90}} \right )}={\mathrm{0.94}} | \mathrm{TCPI}=\frac{ {\left ({\mathrm{BAC}}-{\mathrm{BCWP}} \right )}} {\left ({\mathrm{New\ Cost}}-{\mathrm{ACWP}} \right )}=\frac{ {\left ({\mathrm{360}}-{\mathrm{107.5}} \right )}} {\left ({\mathrm{360}}-{\mathrm{90}} \right )}={\mathrm{0.94}} | ||
Line 381: | Line 339: | ||
</math> | </math> | ||
− | Coherently with the results in step 3, | + | Coherently with the results in step 3, the to complete indices suggest that CPI index can be worsened, while to be able to finish the project in day 37, SPI has to be improved from 0.61 to 1.2, which corresponds to a 96.72% increase. According to criteria of the U.S. Department of Defense explained in section 3.5, this is unlikely to occur. |
− | == | + | == Practical real life case for schedule variance calculation == |
− | [[File: | + | [[File:Special_2.png|400px|thumb|Figure 9: Example of practical case for Schedule Variance calculation (own figure, created based on <ref name="PoliSV"> Pozzi A. Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). ''Sistemi Organizzativi: SV<sub>tempo</sub> - Modalità di calcolo''. Class lecture.</ref>)]] |
− | During the monitoring of projects, often real life situations are not as expected from a theoretical point of view. In | + | During the monitoring of projects, often real life situations are not as expected from a theoretical point of view. In section 3.3 schedule variance expressed in time units was discussed, under the circumstances that BCWS curve does not change trend in the considered period of time. The formula to calculate it is: |
:<math> | :<math> | ||
Line 392: | Line 350: | ||
</math> | </math> | ||
− | However, there are some situations in which this formula is not accurate and may approximate too much the value of SV<sub>t</sub>. According to studies from the Department of Management, Economics and Industrial Engineering of Politecnico di Milano <ref name="PoliSV"> Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). ''SV<sub>tempo</sub> - Modalità di calcolo''. | + | However, there are some situations in which this formula is not accurate and may approximate too much the value of SV<sub>t</sub>. According to studies from the Department of Management, Economics and Industrial Engineering of Politecnico di Milano <ref name="PoliSV"> Pozzi A. Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). ''Sistemi Organizzativi: SV<sub>tempo</sub> - Modalità di calcolo''. Class lecture.</ref>, a way to verify this is to analyze the BCWS in the periods of time which range from the Earned Schedule to Time Now. If its trend is constant, then the simplified formula can be applied. Otherwise, the following pragmatic steps are suggested: |
#Subtract (or add if ''SV''<sub>m</sub> is negative) from ''SV''<sub>m</sub> the values of ''BCWS''<sub>period</sub> for each time period until ''SV''<sub>m</sub> is equal to 0 (which corresponds to the point in which BCWS and BCWP meet). This will return the interval to which ''SV''<sub>t</sub> belongs to; | #Subtract (or add if ''SV''<sub>m</sub> is negative) from ''SV''<sub>m</sub> the values of ''BCWS''<sub>period</sub> for each time period until ''SV''<sub>m</sub> is equal to 0 (which corresponds to the point in which BCWS and BCWP meet). This will return the interval to which ''SV''<sub>t</sub> belongs to; | ||
− | #To determine the decimal values, use the simplified formula | + | #To determine the decimal values, use the simplified formula. The numerator corresponds to the remaining ''SV''<sub>m</sub> after having subtracted ''BCWS''<sub>period</sub> in step 1, while the denominator is the ''BCWS''<sub>period</sub> in the period of time of ''SV''<sub>t</sub>. |
An example is presented to better understand this process. | An example is presented to better understand this process. | ||
− | In figure | + | In figure 9 it can be seen that BCWS changes trend from ES to Time Now. Under the hypothesis that ''SV<sub>m</sub> = -110€'', ''BCWS<sub>1</sub> = 60'' and ''BCWS<sub>2</sub> = 30'', applying the simplified formula of section 3.3 returns ''SV<sub>t</sub> = -3.67''. However, looking at the graph it can be seen that it is actually in between -2 and -3. Applying step 1, ''SV''<sub>m</sub> is closest to 0 when adding ''BCWS''<sub>2</sub> and ''BCWS''<sub>1</sub>. This corresponds to ''SV''<sub>t</sub> being smaller than -2. Finally, applying step 2, the decimals are: |
− | :<math>\frac{\left ({\mathrm{SV_m}}+{\mathrm{BCWS_2}} \right )}{\mathrm{BCWS_1}}=\frac{\mathrm{- | + | :<math>\frac{\left ({\mathrm{SV_m}}+{\mathrm{BCWS_2}}+{\mathrm{BCWS_1}} \right )}{\mathrm{BCWS_1}}=\frac{\mathrm{-110+30+60}}{\mathrm{60}}=\mathrm{-0.34}</math> |
Therefore: | Therefore: | ||
− | :<math>\mathrm{SV_t}=\mathrm{ | + | :<math>\mathrm{SV_t}=\mathrm{-2}+\mathrm{0.34}=\mathrm{-2.34}</math> |
This approach is effective as it provides an accurate value for ''SV''<sub>t</sub> when the trend of the BCWS is not constant, however it may be challenging to implement for large projects where changes in the trend of the BCWS occur often. | This approach is effective as it provides an accurate value for ''SV''<sub>t</sub> when the trend of the BCWS is not constant, however it may be challenging to implement for large projects where changes in the trend of the BCWS occur often. | ||
Line 412: | Line 370: | ||
The following section includes limitations of EVM, as discussed in a variety of articles and books. | The following section includes limitations of EVM, as discussed in a variety of articles and books. | ||
− | *First of all, the calculation of the POC and thus the BCWP curve is a challenging part of EVM as there is a wide range of methods which can be used, as discussed in | + | *First of all, the calculation of the POC and thus the BCWP curve is a challenging part of EVM as there is a wide range of methods which can be used, as discussed in section 4 of this article. Project managers have to evaluate the trade-off between the inaccuracy of subjective methods and the demanding calculations required by discrete methods. Moreover, the choice of the tool for the BCWP calculation is not a controlling but a planning activity and therefore, when planning each activity, it is important to define also what is the best way to control it <ref name="Hayes">Hayes, R. (2001). ''Analysis and application of earned value management to the Naval Construction Force''. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library</ref>. Another aspect is that being that POC and BCWP are often approximated values, all the following indices calculated may be imprecise and thus should always be interpreted according to the context of the project. |
− | + | ||
− | + | ||
− | *Another problematic aspect concerns the application of formulas for WBEs at the initial stages of completion. Looking at EAC formula in | + | *Another problematic aspect concerns the application of formulas for WBEs at the initial stages of completion. Looking at EAC formula in section 3.4, the less work is done, the more BCWP will vary from BAC and EAC will diverge from ACWP, the actual work performed. This suggests that forecasting should be carried out with caution especially in the initial phases of the project, as small variations in SPI and CPI indices from 1, can lead to huge variations in the time and cost of the activities, which often do not correspond to reality. An example from the book ''L'organizzazione dell'impresa'' by Bartezzaghi Emilio will be taken into consideration. The first assumption is that there are two WBEs, one which is in the early stage (lower than 20% of completion) and another one in the final phases. The second assumption is that these two activities are on time and have the same negative cost variance. According to the formulas, ''CPI''<sub>1</sub> is smaller than ''CPI''<sub>2</sub> because ''WBE''<sub>1</sub> has just begun. According to the same logic, ''EAC''<sub>1</sub> is greater than ''EAC''<sub>2</sub> (scenario 2 of forecasting). This suggests that ''WBE''<sub>2</sub> is performing better than ''WBE''<sub>1</sub>. However, when calculating the TCPI, ''WBE''<sub>2</sub> should increase its performance tremendously compared to ''WBE''<sub>1</sub> in order to finish the project with the planned total budget. This is due to the fact that ''WBE''<sub>2</sub> is nearly finished and therefore it has less time to make up for the cost deviations. For this reason, project managers should impose a limit of variation of esteems of +/- 10% if the activity is already stable, so usually for ''BCWP=20%*BAC'' <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref>. |
− | *Another limitation to EVM with regards to forecasting is that there is always some degree of uncertainty on the different parameters that characterize a project. These parameters include the “activity durations or costs, resource use, the presence of precedence relations or even on the existence of an activity in the project network” (Vanhoucke M., 2016, ''Integrated Project Management Sourcebook'', p. 237). This makes forecasting in EVM a critical step that project managers have to approach carefully. A suggested solution proposed by Vanhoucke M. | + | *Another limitation to EVM with regards to forecasting is that there is always some degree of uncertainty on the different parameters that characterize a project. These parameters include the “activity durations or costs, resource use, the presence of precedence relations or even on the existence of an activity in the project network” (Vanhoucke M., 2016, ''Integrated Project Management Sourcebook'', p. 237). This makes forecasting in EVM a critical step that project managers have to approach carefully. A suggested solution proposed by Vanhoucke M. is for project managers to visualize the future trend of these parameters not as a point, but as a dataset, and therefore as a probability distribution. In this way, it is possible to apply simulation models that imitate the progress of parameters and to understand the overall future trend of the project. More on this can be read in the article ''RA4: Activity distributions'', p. 119 <ref name="graphs"> Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer</ref>. |
*Another critical point of EVM project managers should be aware of is in case of collaborations with external suppliers. If contracts are based on fixed prices, suppliers are not obliged to reveal their structure of costs. Hence, if there are issues with activities based on supply, it is possible to detect possible lateness but not inefficiency. This missing transparency on costs leads to CPI always being 1 and therefore to a lower level of accuracy during the controlling phase <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref>. | *Another critical point of EVM project managers should be aware of is in case of collaborations with external suppliers. If contracts are based on fixed prices, suppliers are not obliged to reveal their structure of costs. Hence, if there are issues with activities based on supply, it is possible to detect possible lateness but not inefficiency. This missing transparency on costs leads to CPI always being 1 and therefore to a lower level of accuracy during the controlling phase <ref name="SO">Bartezzaghi, E. (2019). ''L'organizzazione dell'impresa''. 4th ed. Milano: Rizzoli ETAS</ref>. | ||
Line 429: | Line 385: | ||
*'''Hayes, R. (2001). ''Analysis and application of earned value management to the Naval Construction Force''. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library''': this paper provides a concise description of EVM and summarizes the several findings of published literature on this topic. The first part of the paper also provides information on the origin of the methodology within government and how it evolved throughout the years to become a more user-friendly tool applicable also to private industries. Finally, it provides a practical application to Naval Construction Force project management, not only as a mere calculation of the indices but also as an analysis of the planning and execution phases, such as project monitoring and reporting. | *'''Hayes, R. (2001). ''Analysis and application of earned value management to the Naval Construction Force''. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library''': this paper provides a concise description of EVM and summarizes the several findings of published literature on this topic. The first part of the paper also provides information on the origin of the methodology within government and how it evolved throughout the years to become a more user-friendly tool applicable also to private industries. Finally, it provides a practical application to Naval Construction Force project management, not only as a mere calculation of the indices but also as an analysis of the planning and execution phases, such as project monitoring and reporting. | ||
*'''Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer''': this book deals with the theme of Integrated Project Management and Control, tackling not only EVM methodology, but also network and resource analysis, scheduling techniques such as PERT and Critical Path Method, schedule risk analysis, buffer management and more. In fact, it comprises of +70 articles which discuss about topics directly linked to EVM. In this way, it allows the reader to have a more holistic view and knowledge of baseline scheduling, risk analysis and project control and therefore understand how to combine EVM with other tools and techniques for project planning, execution and controlling. | *'''Vanhoucke, M. (2016). ''Integrated Project Management Sourcebook''. Gent, Belgium: Springer''': this book deals with the theme of Integrated Project Management and Control, tackling not only EVM methodology, but also network and resource analysis, scheduling techniques such as PERT and Critical Path Method, schedule risk analysis, buffer management and more. In fact, it comprises of +70 articles which discuss about topics directly linked to EVM. In this way, it allows the reader to have a more holistic view and knowledge of baseline scheduling, risk analysis and project control and therefore understand how to combine EVM with other tools and techniques for project planning, execution and controlling. | ||
− | *'''Miguel, A., Madria, W. and Polancos, R. (2019). Project Management Model: Integrating Earned Schedule, Quality, and Risk in Earned Value Management. In: ''2019 IEEE 6th International Conference on Industrial Engineering and Applications''. De La Salle University Manila, Philippines: Department of Industrial Engineering''': this article provides project managers with an updated version of EVM which allows to overcome one of the most important limitations of this tool, which is the lack of quality and risk performance measurement. A new model is proposed | + | *'''Miguel, A., Madria, W. and Polancos, R. (2019). Project Management Model: Integrating Earned Schedule, Quality, and Risk in Earned Value Management. In: ''2019 IEEE 6th International Conference on Industrial Engineering and Applications''. De La Salle University Manila, Philippines: Department of Industrial Engineering''': this article provides project managers with an updated version of EVM which allows to overcome one of the most important limitations of this tool, which is the lack of quality and risk performance measurement. A new model is proposed and demonstrates how quality problems affect the cost and schedule of a project and how, from risk indices, preventive actions can be taken. Moreover, these new indices are applied to a sample project in order to validate it from a practical point of view. Finally, this article highlights how the new model allows to identify more accurate schedule deviations and thus represent the real time delay. |
== References == | == References == | ||
<references/> | <references/> |
Latest revision as of 15:35, 28 February 2021
By Martina Rampazzo
Earned value management (EVM) is a methodology for performance measurement which can be applied to individual projects across programs and portfolios [1]. EVM is used in the planning, executing and controlling phases of the PMI Project Management Standard and mainly involves the knowledge areas of scope, time, cost, communication and integration [2]. More specifically, EVM falls into the project cost management and plan schedule and cost management phases of the PMI Standard of Project Management [3].
Figure 1 shows how EVM relates to project management phases and the activities which it comprises. While it might appear as mainly related to monitoring and controlling, EVM brings to the project managers’ attention the importance of performance measurement since the planning phase, with the need for accurate planning and for the realization of a project which is easy to execute and measure.
This article will describe the EVM methodology applied to projects, with motivations of its relevance, prerequisites for a successful implementation as well as concrete explanations and applications of each of its key metrics. While EVM is a topic already widely discussed in project management from a theoretical point of view, this article will outline how to apply the tool to practical real life projects. Finally, the main limitations of EVM will be discussed thoroughly, including suggestions for project managers on how to face these challenges.
[edit] Why project managers should use EVM?
EVM is a tool created by the U.S. Department of Defense in 1967 and later used to monitor Department of Education projects, such as the U.S. Large Hadron Collider (LHC) of CERN [4]. The ability to connect cost and schedule, to identify project performance indicators and express cost and technical performance in an understandable way, led to the diffusion of this tool and to its increased application in the field of project management [5]. EVM encompasses earned value analysis, which consists in defining a set of indices to monitor the project’s schedule and cost. Subsequently, this data is used to also calculate variance and trend analysis, as well as predictions for the future. Therefore, EVM provides a holistic view on the project’s progress and identifies deviations from the plan and budget, allowing project managers to react to these discrepancies by implementing corrective actions.
[edit] The prerequisites for a successful implementation of EVM
There are prerequisites project managers should be aware of in order to implement the methodology in the best possible way. These activities range from planning to monitoring, and consist of:
- Applying the work breakdown structure (WBS - The work breakdown structure in project management) in order to decompose all the projects' activities in control accounts, which are manageable work units with specific scope, cost and schedule. Subsequently, human and material resources have to be allocated to each work package using the organization breakdown structure (OBS) [2];
- Assigning management responsibility to each of the control account [2];
- Planning how to keep track of physical work progress and how to assign budgetary earned value for each activity [2];
- Implementing change management plans to ensure EVM remains relevant if the project scope changes [6];
- Using an adequate cost collection system to track actual cost and outstanding invoices [6];
- Conducting reporting activities in order to interpret the data obtained and subsequently communicate it to the relevant stakeholders [2].
[edit] How to implement EVM
The EVM methodology comprises four main phases:
- Defining the time-phased budget
- Monitoring time and costs
- Analyzing deviations and defining relevant indices
- Forecasting
EVM consists in examining the relationship between three types of curves:
- Budgeted Cost of Work Scheduled (BCWS): the planned and scheduled work - also called PV (planned value)
- Budgeted Cost of Work Performed (BCWP): the actual work performed according to the control account - also called EV (earned value)
- Actual Cost of Work Performed (ACWP): the actual expenditures of the control account up to the period of time in which the curve is analyzed - also called AC (actual cost)
[edit] Definition of the time-phased budget
The first step of EVM is representing the BCWS, also called the baseline of the project, which represents the cumulative cost of the activities for each period of time and therefore aggregates the budgeted cost of all control accounts. The curve can be obtained thanks to the Gantt chart, which displays the scheduled activities of the project in each unit of time. An example is provided below to clarify this process.
The following set of activities is given, with information on predecessors, scheduled time and budgeted cost.
Activity | Predecessor | Time | Cost |
---|---|---|---|
A | / | 2 | 15 |
B | A | 4 | 20 |
C | A, B | 1 | 30 |
D | B | 4 | 10 |
After creating the Gantt diagram (Gantt Chart in Project Management), the BCWS is drawn so that cumulated costs across all scheduled activities are displayed for each time period. For example, in the first month only activity A occurs, so only its cost (15€) will be added to the BCWS. On the second month, activity A is still taking place so the cumulative cost will be 30€.
[edit] Monitoring time and costs
Monitoring of costs during the life of a project allows to trace the ACWP, which is the actual cost of work performed. This is extremely relevant as the real costs spent on a project often diverge from the planned ones, as many unforeseen events can occur. Usually actual costs are calculated by checking the actual division of work among manpower and using tools such as cost and time reports, which show how the resources of a project team spent their time and the total amount of expenditures [7].
[edit] Deviation analysis
BCWS and ACWP alone do not provide any information on the nature of a potential deviation. For example, if ACWP > BCWS, it might be that the project either is inefficient, so actual expenditures are higher than the budget, or work is being performed earlier compared to the schedule. For this reason traditional cost management is not precise enough and it is essential to analyze a third curve, the BCWP.
The BCWP can be calculated by multiplying the percentage of completion (POC) with the budget at completion (BAC), which is the total budget of the project. The different methods to calculate the POC will be described further in section 4.
A useful way to conduct deviation analysis is to group the three metrics into one graph, as shown in figure 4. This analysis generates 2n scenarios, where n is the number of parameters being studied. Being that with EVM the parameters are time and cost, the possible scenarios are four:
- Project late compared to the schedule and inefficient
- Project late compared to the schedule and efficient
- Project on time/early compared to the schedule and efficient
- Project on time/early compared to the schedule and inefficient
Other than graphically, it is also possible to evaluate time and costs with indices, both relative and absolute, with the former expressing deviations in percentage, while the latter in monetary units.
[edit] Relative indices
Relative indices are cost performance index (CPI) and schedule performance index (SPI). If these indices are greater than one, then the project is efficient and ahead of schedule respectively.
[edit] Absolute indices
Absolute indices provide the same information of the relative ones but with different formulas, as shown below. In this case, it is preferred to have values larger than 0 for both cost variance (CV) as well as schedule variance (SVm).
It is important to notice that schedule variance is expressed in monetary units instead of time units, which is more challenging to interpret. This topic was widely discussed from the 1970s, as EVM originally did not include schedule deviations in time units. According to the article Earned Schedule: An Emerging Enhancement to Earned Value Management by Lipke W. and Henderson K., this situation led over time to project managers using the EVM methodology primarily to understand costs rather than schedule [5]. However, in 2002 the earned schedule concept was introduced, a metric which indicates the instant of time in which the BCWS is equal to the BCWP. If these two curves do not match, the projection of the first one onto the second one is the amount of work performed which should be earned according to the schedule (BCWS). The earned schedule is the time from when the project begins up to the projection of this intersection onto the time axis, as shown in figure 5.
In this way, schedule variance can be expressed in time units by subtracting the current period (which in this article will be referred to as Time Now) from the earned schedule. If this value is greater than zero, then it means the project is ahead of schedule.
Moreover, if the trend of the BCWS is constant in the interval of time considered, meaning that the same activity is taking place during the entire time, then the schedule variance in time units can also be expressed with the following formula (where BCWS* is the trend of the curve):
The case in which the BCWS is not constant will be discussed in section 6 of this article.
[edit] Forecasting
By calculating deviation indices, project managers have a picture of the project’s performance in that specific moment. However, before implementing any corrective actions, it is necessary to understand what would be the final arrival point of the project if it continued with the same trend. In fact, identifying, planning, and mobilizing resources to implement corrective actions are time consuming and expensive activities, and may not be necessary if the final performance of the project is within the acceptable range.
The key metrics to forecast future trends are EAC and SAC, which stand for Estimate At Completion and Schedule at Completion. In addition to these metrics, there is also Variance at Completion, which will not be covered in this article (if interested, read more about it at Practice Standard for Earned Value Management of Project Management Institute, p. 19 [2]). From a graphical point of view, these metrics are obtained by extending the ACWP until the end of the project.
Mathematically, it is important to define which type of effects the deviation analysis in step 3 has on the project. The possible scenarios are three.
[edit] Scenario 1: The effect of the issue on the project is limited
This is the case of deviations from original planning due to external factors which impacted the project but have ended their effect. For example, this is the case of higher prices for raw materials and therefore higher costs which impact only limited initial activities of the project.
[edit] Scenario 2: The effect of the issue on the project is extended
The second scenario corresponds to an issue impacting not only current activities, but also the entire project. There are also other alternatives to this calculation which can be found at Practice Standard for Earned Value Management of Project Management Institute, pg. 21 [2].
[edit] Scenario 3: Both types of issues affect the project
Practically speaking, it is possible that the project falls into a grey zone in between the two scenarios and that there are two components of a deviation, one for each of the two scenarios. In this case, studies from the Department of Management, Economics and Industrial Engineering of Politecnico di Milano suggest the following steps to calculate EAC and SAC [9]. The suggested process is valid if cost and time deviations of scenario 1 are efficiency (Lower cost1 in the formula) and anticipation compared to the schedule (Earlier schedule1 in the formula). In the opposite case in which scenario 1 deviations are inefficiency and lateness, the formulas of step 1 and 3 will have the opposite sign.
- Remove the positive deviations with limited effect and calculate the new ACWP* and BCWP*;
- Calculate CPI* and SPI* and the corresponding EAC* and SAC* with the values obtained in step 1. These are the forecasted values which account only for deviations of scenario 2;
- Calculate EAC and SAC by reintroducing the deviations of scenario 1
[edit] To Complete Indices
The last step of EVM consists in defining the SPI and CPI indices the project should have in order to reach the desired schedule and cost targets. To evaluate their actual concrete feasibility, To Complete Performance Index (TCPI) and To Complete Schedule Performance Index (TSPI) are calculated:
Project managers should interpret these indices to understand whether it is really feasible to maintain them until the end of the project. A research conducted by the U.S. Department of Defense concluded that once a work breakdown element (WBE) is over 20% of its completion, CPI and SPI indices should not be increased by 10% [10] because the WBE is considered stable and therefore the final performance of a project will not diverge significantly.
[edit] Percentage of Completion Calculation Methods (POC)
As explained previously, in order to calculate the BCWP, project managers need to estimate the POC, which describes the actual progress of the project. There are many methods to evaluate progress, some objective and others subjective. This article will divide the POC calculation methods according to the division presented in the article Analysis and application of earned value management to the Naval Construction Force, pp.18-20 [11] and will briefly explain the most relevant limitations.
- Discrete effort:
- Milestone Method: assigns a weight to each milestone. Once this is completed, the percentage of completion will increase of the value of the milestone. It suits longer projects and requires more than 2 milestones;
- Fixed Ratio Formula Method: a variation of the previous method which assumes only 2 milestones, one at the beginning of an activity and the second one at the end, with weights that may vary but have to add up to 100%. The most common ratios used are 0/100, 50/50 and 25/75;
- Equivalent Unit Method: consists in counting the number of completed units and comparing it to the total units which need to be accomplished. It is applicable only if the activities allow to count physical units, therefore it suits repetitive tasks;
- Percent Complete Method: applies a percentage of completion according to the progress of the activity. It is easier to apply for projects where performance is measurable. It is also used as a subjective method where the control account manager estimates the percentage of completion according to his experience and knowledge;
- Percent Complete with Milestone Gates Method: a variation of the milestone method which allows to report subjective percentages of completion to the activity until the milestone is reached;
- Earned Standards: determines the percentage of completion according to standards derived from historical data, time and motion studies and other methods. It is challenging to apply one unique standard as every project has its own specific characteristics and is influenced by factors which vary from project to project.
- Apportioned Effort: associates activities which are closely correlated in terms of planning and performance. An example is using the same percentage of completion for both production control and production.
- Level of Effort (LoE): it assumes that the progress of activities is proportional to time. This method should be avoided as it assumes that BCWP is always the same as BCWS. In this way, SV and SPI will always be equal to 0 and 1 respectively and misleading cost variances will be generated [10].
As a result, some methods are by nature more subjective, like level of effort, apportioned effort, percent complete method, while others are more objective and therefore suit controlling activities, such as milestone, fixed formula and equivalent unit methods. Project managers should avoid the use of subjective methods since their level of accuracy is questionable and, if not completely possible, impose a limit on the number of activities controlled with such logics [10].
[edit] Application of EVM
The following section provides a practical application of the concepts of EVM explained in the previous chapters. The assumption of this example is that, at the beginning of day 16, controlling and monitoring activities are conducted to evaluate the performance of the project. The EVM structure previously discussed will be applied in this example step by step.
[edit] Definition of the time-phased budget
The following table is given, with activities, predecessors, planned duration and costs.
Activity | Predecessor | Expected Duration | Expected Cost |
---|---|---|---|
1 | / | 5 | 30 |
2 | 1 | 8 | 40 |
3 | 1 | 10 | 70 |
4 | 2 | 4 | 40 |
5 | 3 | 10 | 60 |
6 | 4, 5 | 12 | 120 |
To calculate the BCWS, it is useful to create the network of the project in order to check which activities should have been completed on day 16 (figure 8, where the critical path has been highlighted in red).
[edit] Monitoring time and costs
It is assumed that the monitoring of costs results in ACWP16=90.
[edit] Deviation analysis
In this example, the percentage of completion method is used to calculate BCWP and it is assumed that the control account manager provided the following information:
Activity | Percentage of Completion |
---|---|
1 | 100% |
2 | 100% |
3 | 25% |
4 | 50% |
5 | 0% |
6 | 0% |
Therefore the BCWP in day 16 is given by:
[edit] Relative indices
[edit] Absolute indices
The indices show that the project is efficient and late compared to the schedule.
It is also useful to calculate the schedule variance expressed in time units to verify how much days the project is late. In this exercise, the trend of the BCWS in day 16 is constant as no new activity is started and no activity is finished compared to day 15. In this time period only activities 4 and 5 are occurring, therefore only their expected costs and durations are considered:
[edit] Forecasting
In this example, scenarios 1 and 2 for forecasting are applied. The calculations show that issues with an impact on the entire project tend to amplify the effect on the esteems both in case of positive and negative deviations.
[edit] Scenario 1: The effect of the issue on the project is limited
[edit] Scenario 2: The effect of the issue on the project is extended
[edit] To Complete Indices
Coherently with the results in step 3, the to complete indices suggest that CPI index can be worsened, while to be able to finish the project in day 37, SPI has to be improved from 0.61 to 1.2, which corresponds to a 96.72% increase. According to criteria of the U.S. Department of Defense explained in section 3.5, this is unlikely to occur.
[edit] Practical real life case for schedule variance calculation
During the monitoring of projects, often real life situations are not as expected from a theoretical point of view. In section 3.3 schedule variance expressed in time units was discussed, under the circumstances that BCWS curve does not change trend in the considered period of time. The formula to calculate it is:
However, there are some situations in which this formula is not accurate and may approximate too much the value of SVt. According to studies from the Department of Management, Economics and Industrial Engineering of Politecnico di Milano [12], a way to verify this is to analyze the BCWS in the periods of time which range from the Earned Schedule to Time Now. If its trend is constant, then the simplified formula can be applied. Otherwise, the following pragmatic steps are suggested:
- Subtract (or add if SVm is negative) from SVm the values of BCWSperiod for each time period until SVm is equal to 0 (which corresponds to the point in which BCWS and BCWP meet). This will return the interval to which SVt belongs to;
- To determine the decimal values, use the simplified formula. The numerator corresponds to the remaining SVm after having subtracted BCWSperiod in step 1, while the denominator is the BCWSperiod in the period of time of SVt.
An example is presented to better understand this process.
In figure 9 it can be seen that BCWS changes trend from ES to Time Now. Under the hypothesis that SVm = -110€, BCWS1 = 60 and BCWS2 = 30, applying the simplified formula of section 3.3 returns SVt = -3.67. However, looking at the graph it can be seen that it is actually in between -2 and -3. Applying step 1, SVm is closest to 0 when adding BCWS2 and BCWS1. This corresponds to SVt being smaller than -2. Finally, applying step 2, the decimals are:
Therefore:
This approach is effective as it provides an accurate value for SVt when the trend of the BCWS is not constant, however it may be challenging to implement for large projects where changes in the trend of the BCWS occur often.
[edit] Limitations
The following section includes limitations of EVM, as discussed in a variety of articles and books.
- First of all, the calculation of the POC and thus the BCWP curve is a challenging part of EVM as there is a wide range of methods which can be used, as discussed in section 4 of this article. Project managers have to evaluate the trade-off between the inaccuracy of subjective methods and the demanding calculations required by discrete methods. Moreover, the choice of the tool for the BCWP calculation is not a controlling but a planning activity and therefore, when planning each activity, it is important to define also what is the best way to control it [11]. Another aspect is that being that POC and BCWP are often approximated values, all the following indices calculated may be imprecise and thus should always be interpreted according to the context of the project.
- Another problematic aspect concerns the application of formulas for WBEs at the initial stages of completion. Looking at EAC formula in section 3.4, the less work is done, the more BCWP will vary from BAC and EAC will diverge from ACWP, the actual work performed. This suggests that forecasting should be carried out with caution especially in the initial phases of the project, as small variations in SPI and CPI indices from 1, can lead to huge variations in the time and cost of the activities, which often do not correspond to reality. An example from the book L'organizzazione dell'impresa by Bartezzaghi Emilio will be taken into consideration. The first assumption is that there are two WBEs, one which is in the early stage (lower than 20% of completion) and another one in the final phases. The second assumption is that these two activities are on time and have the same negative cost variance. According to the formulas, CPI1 is smaller than CPI2 because WBE1 has just begun. According to the same logic, EAC1 is greater than EAC2 (scenario 2 of forecasting). This suggests that WBE2 is performing better than WBE1. However, when calculating the TCPI, WBE2 should increase its performance tremendously compared to WBE1 in order to finish the project with the planned total budget. This is due to the fact that WBE2 is nearly finished and therefore it has less time to make up for the cost deviations. For this reason, project managers should impose a limit of variation of esteems of +/- 10% if the activity is already stable, so usually for BCWP=20%*BAC [10].
- Another limitation to EVM with regards to forecasting is that there is always some degree of uncertainty on the different parameters that characterize a project. These parameters include the “activity durations or costs, resource use, the presence of precedence relations or even on the existence of an activity in the project network” (Vanhoucke M., 2016, Integrated Project Management Sourcebook, p. 237). This makes forecasting in EVM a critical step that project managers have to approach carefully. A suggested solution proposed by Vanhoucke M. is for project managers to visualize the future trend of these parameters not as a point, but as a dataset, and therefore as a probability distribution. In this way, it is possible to apply simulation models that imitate the progress of parameters and to understand the overall future trend of the project. More on this can be read in the article RA4: Activity distributions, p. 119 [8].
- Another critical point of EVM project managers should be aware of is in case of collaborations with external suppliers. If contracts are based on fixed prices, suppliers are not obliged to reveal their structure of costs. Hence, if there are issues with activities based on supply, it is possible to detect possible lateness but not inefficiency. This missing transparency on costs leads to CPI always being 1 and therefore to a lower level of accuracy during the controlling phase [10].
- Finally, EVM focuses only on schedule and costs of a project but lacks information on risk and quality, which are key aspects to determine the success of a project. The article Project Management Model: Integrating Earned Schedule, Quality, and Risk in Earned Value Management suggests new indices to combine with traditional EVM in order to measure quality performance and risk assessment [13].
[edit] Annotated Bibliography
This section includes references for further reading on EVM and its application to project management:
- Project Management Institute, Inc. (2005). Practice Standard for Earned Value Management. Pennsylvania, USA: Project Management Institute, Inc.: this book represents the standards for EVM methodology, with a strong focus on how it is connected to the project management process and when project managers should apply it. It provides a detailed list of the steps of the methodology as well as considerations on how EVM fits different situations depending on the degree of uncertainty and significance of the project as well as the frequency and granularity of the performance measurement. The final chapters are then dedicated to the prerequisites for the application of EVM and guidance on the use of its key metrics.
- Hayes, R. (2001). Analysis and application of earned value management to the Naval Construction Force. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library: this paper provides a concise description of EVM and summarizes the several findings of published literature on this topic. The first part of the paper also provides information on the origin of the methodology within government and how it evolved throughout the years to become a more user-friendly tool applicable also to private industries. Finally, it provides a practical application to Naval Construction Force project management, not only as a mere calculation of the indices but also as an analysis of the planning and execution phases, such as project monitoring and reporting.
- Vanhoucke, M. (2016). Integrated Project Management Sourcebook. Gent, Belgium: Springer: this book deals with the theme of Integrated Project Management and Control, tackling not only EVM methodology, but also network and resource analysis, scheduling techniques such as PERT and Critical Path Method, schedule risk analysis, buffer management and more. In fact, it comprises of +70 articles which discuss about topics directly linked to EVM. In this way, it allows the reader to have a more holistic view and knowledge of baseline scheduling, risk analysis and project control and therefore understand how to combine EVM with other tools and techniques for project planning, execution and controlling.
- Miguel, A., Madria, W. and Polancos, R. (2019). Project Management Model: Integrating Earned Schedule, Quality, and Risk in Earned Value Management. In: 2019 IEEE 6th International Conference on Industrial Engineering and Applications. De La Salle University Manila, Philippines: Department of Industrial Engineering: this article provides project managers with an updated version of EVM which allows to overcome one of the most important limitations of this tool, which is the lack of quality and risk performance measurement. A new model is proposed and demonstrates how quality problems affect the cost and schedule of a project and how, from risk indices, preventive actions can be taken. Moreover, these new indices are applied to a sample project in order to validate it from a practical point of view. Finally, this article highlights how the new model allows to identify more accurate schedule deviations and thus represent the real time delay.
[edit] References
- ↑ Cable, J. H., Ordonez, J. F., Chintalapani, G. and Plaisant, C. (2004). Project portfolio earned value management using Treemaps. Paper presented at PMI® Research Conference: Innovations, London, England. Newtown Square: Project Management Institute. (PMI)., p. 1
- ↑ 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 Project Management Institute, Inc. (2005). Practice Standard for Earned Value Management. Pennsylvania, USA: Project Management Institute, Inc. (PMI).
- ↑ Project Management Institute, Inc. (2017). Guide to the Project Management Body of Knowledge (PMBOK® Guide) (6th Edition). Pennsylvania, USA: Project Management Institute, Inc. (PMI)., pp. 173-270
- ↑ Ferguson J., Kissler K.H. (2002). Earned Value Management. CERN-AS-2002-010
- ↑ 5.0 5.1 Lipke W. and Henderson K.(2010). Earned Schedule: An Emerging Enhancement to Earned Value Management. In: CROSSTALK The Journal of Defense Software Engineering, pp. 26-29
- ↑ 6.0 6.1 Lukas J.A. (2008). 2008 AACE INTERNATIONAL TRANSACTIONS. Earned Value Analysis – Why it Doesn't Work, pp. 6-9
- ↑ Andawei, M. (2014). Project cost monitoring and control: A case of cost/time variance and earned value analysis. IOSR Journal of Engineering (IOSRJEN), Vol. 04, Issue 02, p. 23.
- ↑ 8.0 8.1 8.2 8.3 Vanhoucke, M. (2016). Integrated Project Management Sourcebook. Gent, Belgium: Springer
- ↑ 9.0 9.1 Pozzi A. Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). Sistemi Organizzativi: Stime a finire - Scostamenti Contingenti e Strutturali. Class lecture.
- ↑ 10.0 10.1 10.2 10.3 10.4 Bartezzaghi, E. (2019). L'organizzazione dell'impresa. 4th ed. Milano: Rizzoli ETAS
- ↑ 11.0 11.1 Hayes, R. (2001). Analysis and application of earned value management to the Naval Construction Force. California, USA: Naval Postgraduate School (U.S.). Dudley Knox Library
- ↑ 12.0 12.1 Pozzi A. Department of Management, Economics and Industrial Engineering, Politecnico di Milano. (2020). Sistemi Organizzativi: SVtempo - Modalità di calcolo. Class lecture.
- ↑ Miguel, A., Madria, W. and Polancos, R. (2019). Project Management Model: Integrating Earned Schedule, Quality, and Risk in Earned Value Management. In: 2019 IEEE 6th International Conference on Industrial Engineering and Applications. De La Salle University Manila, Philippines: Department of Industrial Engineering