Decision tree analysis

Revision as of 12:19, 7 May 2023

Abstract

In every persons personal and professional life, they are always faced with decisions. These decisions are both small and large and can have great impact on organizations and their goals. Making the “right” decision can often be difficult, which is why numerous tools have been developed over the years to help with this. One of those tools is decision tree analysis.

Decision tree analysis is a method that uses graphical representation to show the decision-making process given certain conditions. It’s most often used to determine the optimal decision based on data and to estimate the potential consequences of a decision when faced different circumstances. The history of decision tree analysis is complex, with several mathematicians and others developing it over time. However, in the industrial environment, decision making usually involves analysing the data to reach a conclusion. Decision tree analysis has, over the years, become increasingly more used in real life, and numerous case studies show its usefulness in improving efficiency in organizations and customer satisfaction. A common use of decision tree analysis is to help with project-selection, which is a necessary part of decision-making process. A number of different instances call for the use of decision tree analysis, and the procedure has bee shown to provide important benefits in a lot of different instances. ^[1]

Decision tree analysis can be used in project, program, and portfolio management to help with the decision-making process in relation to project selection, prioritization as well as risk management. Decision tree analysis can assist managers and other people responsible for making decisions in determining the best course of action and effectively allocate resources by examining many scenarios and potential outcomes.

Overview

Decision trees are structures, similar to flowcharts, and are often used in decision analysis for both visual and analytical support tool. When competing options, based on their projected values, decision trees are particularly helpful. In the decision tree, there are nodes which represent different types of events or actions. Connected to the nodes are branches which represent all the possible outcomes for each event or action. In decision trees, there are typically three different types of nodes:^[2]

• The decision node
  • These are used to represent the decision that need to be made based on the information at hand.
  • Typically represented as a square
• The chance node
  • These are used to represent events that are out of control, for example a coin toss
  • Typically represented as a circle
• The end node
  • Used to represent the final outcome of the whole decision-making progress
  • Typically represented as a triangle

Decision trees in project management

Using decision tree analysis can be a powerful tool that project managers can use to help them make informed decisions in relation to project management. This method can add value to projects, with thorough analysis of all available options and their possible risks.

There are many ways that decision tree analysis can be used in project management, for example project selection, risk management, resource allocation and project execution.Cite error: Closing </ref> missing for <ref> tag ^[3].

Medicine: decision tree analysis is used to make clinical decisions, diagnose diseases, and determine the fate of patients ^{[4] [5]}.

Marketing: Customer segmentation, marketing targeting, and product recommendation all use decision tree analysis ^{[6] [7]}.

Engineering: In production and engineering, decision tree analysis is used for fault diagnosis, quality control, and process optimization ^{[8] [9]}.

Environmental science: decision tree analysis is used in species distribution modeling, land use planning, and environmental impact evaluation ^{[10] [11]}.

Limitations

Overfitting: Decision trees are susceptible to overfitting, which happens when the model interprets training data as noise rather than the underlying pattern ^{[12] [13]}.

Instability: Decision trees are sensitive to small changes in the data or model parameters and can be unstable. This can lead to various tree structures or predictions^{[14] [15]}.

Bias: Decision trees may be biased toward factors with a high complexity or number of categories, which could lead to an over- or under-representation of particular categories ^{[16] [17]}.

Interpretability: When dealing with big or complex trees that have numerous branches or nodes, decision trees can be challenging to understand and interpret ^{[18] [19]}.

References

1. ↑ Kapil Mittal, Dinesh Khanduja, Puran Chandra Tewari. (2017). An Insight into “Decision Tree Analysis”. WWJMRD, 3(12), 111-115
2. ↑ Kamiński, B.; Jakubczyk, M.; Szufel, P. (2017). "A framework for sensitivity analysis of decision trees". Central European Journal of Operations Research. 26 (1): 135–159.
3. ↑ Tang, F., Zeng, G., Deng, L., Huang, G., Li, X., & Wang, X. (2015). Decision tree models for effective credit scoring in peer-to-peer online microloan platforms. Decision Support Systems
4. ↑ Chen, J., Guo, Y., Li, S., Li, J., & Li, J. (2019). A decision tree approach to predicting the survival of gastric cancer patients. Journal of Cellular Biochemistry
5. ↑ Leite, F. N., Oliveira, C. A., Cunha, A. M., Körbes, D., Fumagalli, F., & Leite, J. S. (2018). Decision trees for predicting breast cancer recurrence using clinical data. Expert Systems with Applications
6. ↑ Cite error: Invalid <ref> tag; no text was provided for refs named Kotsiantis
7. ↑ Verbeke, W., Dejaeger, K., Martens, D., Hur, J., Baesens, B., & Vanthienen, J. (2014). A novel profit-based classification model for customer base analysis
8. ↑ Al-Marwani, A., Ramachandran, M., & Subramanian, R. (2020). A review on the application of decision tree and random forest algorithms in engineering. Journal of Advanced Research in Dynamical and Control Systems
9. ↑ Chen, G., Gao, X., & Li, C. (2015). Decision tree-based quality control for ultrasonic welding of lithium-ion battery. Journal of Materials Processing Technology.
10. ↑ Figueiredo, R. O., Rocha, J. C. V., & Tavares, R. A. (2019). Decision tree models for environmental impact assessment. Environmental Modelling & Software
11. ↑ Pu, J., Tang, Q., & Yao, X. (2020). A comparative study of decision tree algorithms for modeling the spatial distribution of forest soil nutrients. Science of The Total Environment
12. ↑ Kuhn, M., & Johnson, K. (2013). Applied predictive modeling. Springer
13. ↑ Quinlan, J. R. (1993). C4.5: Programs for machine learning. Morgan Kaufmann
14. ↑ Cite error: Invalid <ref> tag; no text was provided for refs named Breiman
15. ↑ Cite error: Invalid <ref> tag; no text was provided for refs named Hastie
16. ↑ James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning. Springer
17. ↑ Zadrozny, B., & Elkan, C. (2002). Transforming classifier scores into accurate multiclass probability estimates. Journal of Machine Learning Research
18. ↑ Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015). Intelligible models for healthcare: Predicting pneumonia risk and hospital 30-day readmission. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
19. ↑ Lakkaraju, H., Bach, S. H., & Leskovec, J. (2016). Interpretable decision sets: A joint framework for description and prediction. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining