SCRUM - An Agile Project Management Framework

Developed by MH

Scrum is an agile project management framework especially popular for software development. It is based on short work cycles of 2-4 weeks(sprints) with the aim of creating incremental business value. The workforce is organized in small teams, with cross-disciplinary skills and knowledge, who receives continuous feedback from key stakeholders after each sprint. The constant feedback and dialogue with stakeholders are key to delivering true business value and keeping the project on track. Scrum was created by Jeff Sutherland and Ken Schwaber, both ex-soldiers from the Vietnam war, which later both became a part of the software industry and had a shared frustration with late deliveries, poor quality, and user dissatisfaction . They were inspired to create Scrum by Hirotaka Takeuchi and Ikujiro Nonaka, who compared a new development approach to the movement of a rugby team, in their paper “The New New Product Development Game”, this became the inspiration for the roles and team. They found the inspiration for the values and management of the teams in the theory of Empirical Process Control, which builds on Transparency, Inspection, and Adaptation. The article will focus on what scrum is and why it can be beneficial for software development compared to the traditional waterfall development method. This will include an overview of Scrum roles, events & artifacts, followed by sections on benefits & limitations.

In order to overcome the traditional challenges of software development, which builds on the assumption of constant demands and full sign of on requirements before beginning, a more agile approach, Scrum, has gained its justification. The ability of Scrum to cope with the reality of modern software development with ever-changing demands, the challenge of capturing all requirements from the beginning, the acceptance of failure, and the need for testing while developing, but most importantly the acceptance of changing preferences and requirements from the client as the development evolves, has made it a popular framework for software development.

Application of Scrum

The agile foundation for Scrum

Figure 1. A comparison of the Waterfall and Scrum framework, showing the different approaches to delivering including the project phases. Inspired by pmi-macedonia.mk

Scrum is widely used due to its efficient framework for organizing a team and their tasks in order to deliver continuous business value. The implementation of Scrum is often driven by the wish to become more responsive to changing demands from stakeholders. With a technological scene changing faster than ever, there is an increasing need to use a development process where priorities and requirements can be changed during the development. Software development was previously often based on the linear waterfall model where everything is signed of and specified before the project is started, see figure 1. When developing software, the timeline will often be multiple years, in this period requirements and priorities will often change. In contrast to this approach, there is Scrum, which is based on short sprints, where the most value-adding tasks from the backlog are completed in self-organized teams and immediately shared with the end-user to get continuous feedback. Instead of one final delivery at the end, the idea of Scrum is to develop small incremental updates, with flexibility for changes, which in small steps will fulfill the scope. Scrum also includes the phases: Initiating, Planning, Executing, Monitoring & Controlling, and Closing, all known from the standard for project management, PMBOK Guide . Instead of performing the phases one time like the waterfall model, the phases will be continuously repeated in each sprint, to make it possible for adjustments and reprioritization, this will often be considered as the ability to being agile.

The Scrum framework is based on the 12 agile principles, which were signed by the 2 founders of Scrum together with 15 other prominent individuals, all frustrated with traditional software development. The 12 Agile principles are based on 4 core values:

Individuals and Interactions over Processes and Tools

The focus is on what will create value. It is people who will interact, communicate as needed and develop the results, they should therefore be prioritized above strict process and tool requirements.

Working Software over Comprehensive Documentation

Instead of spending hours on specified and technical documentation of requirements, the developer should be trusted, that he or she will be able to use the time more efficient to make working software, which will create business value.

Customer Collaboration over Contract Negotiation

Instead of following the traditional approach of the waterfall model, where everything is negotiated prior to work start. The customer or stakeholders should be included during the work and be part of the collaboration, to assure the work makes business value.

Responding to Change over Following a Plan

Instead of seeing a change as an expense, changes should be welcomed and incorporated, to create additional business value.

The 12 principles can be read in full in the Agile Manifesto. Even though the founders of Scrum signed the agile manifesto, it is a common misunderstanding that Scrum and agile are the same thing. As mentioned above, agile is a set of values and principles. In order to adopt an agile way of working, the members of the scrum team will need to work under these principles and beliefs. The implementation of Scrum can push you towards a more agile way of working but cannot do it alone.

How to organize for Scrum

The Scrum Team

The implementation of Scrum will lead to a new way of organizing the staff in order to make sure the roles of the Scrum team can be fulfilled. The definition of the Scrum team follows the Scrum guide. A Scrum team is a small team of professionals, consisting of one Scrum Master, one Product Owner, and Developers, in total they should not exceed 10 individuals. The team has no sub-teams or hierarchy and works towards the same product goal. A Scrum team is self-managed and has cross-functional roles and knowledge to make sure the team has the skills to create business value in each sprint. In traditional software development, there is a Product Manager who will both be organizing and assigning the tasks among the developers, which also means the Product Manager will be held responsible for the results. In the Scrum framework, the team is self-managed and thereby responsible for both distributing the work among each other, but also for developing the right thing. In this way, the accountability is placed at the developers, which are also the ones with the capability of developing the software. The scrum framework trust that when the developers have the responsibility, they will produce a better product.

Product Owner

The responsibility of the product owner is to maximize the business value created by the Scrum team, by understanding the stakeholder demand and business landscape. The role as Product Owner is held by one person, in order to gain success with Scrum it is crucial that the decisions of the product owner are respected by the organization, the product owner must be able to make decisions, which will not later be overruled. The product owner has the responsibility for the following points:

• Effective managing, development, and prioritization of the product backlog
• Clearly communicate product goal and product backlog items
• Keep stakeholders informed and included as necessary
• Execution of Sprint planning and Sprint Review sessions

The product owner will often be the “middleman” between the business and developers and must be able to find compromises. Strong communication skills, negotiation skills, proactivity, diplomatic, and result-driven will often be favorable personality traits for a product owner .

Developers

The developers are the ones who will produce the real work of each sprint. Atlassian, a key tech provider for many software companies using Scrum, presents the typical skill-set of the developers, like design, UX, programming, testing, and deployment . The developers hold the responsibility of estimating and planning the tasks for the sprint based on the sprint backlog. They make the definition of when a task can be considered “done”. Lastly, the developers are also accountable for daily adjustments of the sprint planning as they gain knowledge and learn about possible issues, in order to obtain the sprint goal .

Scrum Master

This role is not responsible for delivering on the task from the Sprint Backlog. The Scrum Master is there to help the team follow the Scrum practices and thereby increase the effectiveness of the team. This can also include working with the organization to understand how the Scrum team works and when the rest of the organization will see results. In order to support the team, the Scrum Master will often coach the team to master self-management, cross-disciplinary functions, solve challenges and impediments which can be obstacles to progress. The Scrum master will help the Product Owner as requested to find techniques and tools for effective product goal definition, management of the product backlog, and stakeholder collaboration. In addition, the Scrum master is involved with the rest of the organization to make sure they understand Scrum and the consequences of adoption. This will often include training and implementation of Scrum in the organization. Furthermore, the Scrum Master will often be involved in conflicts or challenges between the stakeholders and the Scrum team .

How to perform Scrum

Project management as presented by the PMBOK standard splits a project into 5 phases: Initiating, Planning, Executing, Monitoring & Controlling, and Closing. These phases can be compared to the way work is organized in the Scrum framework.

Considering figure 2, the initiating phase can be compared to the process that will happen regarding the Backlog. In this process the Product Owner will receive and gather inputs from the End-users, Customers, Team, and other relevant stakeholders. But instead of using this to create the full plan of the entire project, the product owner will prioritize them and find the most important. The product owner will then together with the development team begin the planning phase for the upcoming sprint, here will the inputs be further refined and receive a time estimate. This phase will also include a definition of a Sprint goal, the objective which the team aims to achieve during the sprint. Hereafter, the Executing process will follow, this will in Scrum terminology be considered the sprint. This is the part where the actual work will be completed, and the sprint goal is hopefully obtained – the Scrum team are self-managed and will get the work done in the manner that works best for them. Considering the task of monitoring and controlling the progress, the Scrum team will benefit from the manageable number of tasks, as they only plan work for a short period of time and secondly a part of the sprint planning included the task of estimating time for the task, which can be used to make a burndown chart of keeping track of expected progress for the team. Lastly is the closing phase of the project this can be considered the part where the sprint review is performed, and the increment pushed to the end-users to create instant business value. What then makes the true difference to working with Scrum is the continuous repetition of this cycle, as it is illustrated in figure 2, in order to constantly improve and keep on track with requirements and priorities from the customer. To gain a better understanding of the events and artifact, an explanation of each of them follow.

Artifacts & Events

Figure 2. Overview of the Sprint and the including events and artifacts shows the iterative process where all events are a part of the timeboxed sprint. Illustration of the Scrum Framework by Scrum.org.

Sprint

A sprint is a time timeboxed period, within the Scrum team completes their planned task and performs the reoccurring events in order to obtain the sprint goal. The length of the sprint is always the same, usually 2 weeks, but can be up to 4 weeks. The next sprint starts right after the previous was completed, which also means all events and activities are a part of the sprint. In order to create a clear direction from the beginning of the sprint, the sprint goal cannot be changed, and quality not decreased. If the sprint goal becomes obsolete during the sprint, the product owner has as the only one the power to cancel the sprint.

Sprint Planning

The Sprint planning is the first activity of the sprint. In accordance with the Scrum guide, the sprint planning included 3 tasks that must be addressed and should be limited to 4 hours for a 2-week sprint. In order to make a realistic estimate of what can be accomplished in the sprint, the developers must know their capacity or time available in the sprint, often called velocity.

1. Definition of the sprint goal. The product owner will present how the value of the product can be increased in the current sprint, this will be used as the outset for collaboration by the entire team, to define the sprint goal.
2. The developers will in collaboration with the product owner select the items from the product backlog to include in the current sprint. This task included continuous refinement of the tasks, the definition of done, and time estimates, altogether this will make a more trustworthy estimate of what can be obtained in the sprint.
3. The developers plan based on the chosen tasks from the product backlog, how they turn the task into valuable increments in accordance with the sprint goal. This task is solely completed by the developers.

Definition of Done

It might seem like a rather simple question when something is done. But as presented by Atlassian, a team without a clear definition of done will often find themselves asking whatever a task is done? A clear definition will help the team to identify when a task is done and can be presented as an increment for review

Sprint Backlog

During the sprint planning, the team has refined and made the definition of done for each of the tasks from the backlog prioritized for the sprint. These tasks are sometimes defined as user-stories and will be placed in the sprint backlog. The sprint backlog will be the overview of the user-stories there are to be completed during the sprint and should make it possible to fulfill the sprint goal.

Daily Scrum

This event is the only reoccurring event every day of the sprint. It is a short 15-minute meeting, often hold in the morning as a standup, with the goal of reducing complexity it should take place at the same place and time every day. The goal of the meeting is for the developers to share progress and possible obstacles. The Scrum Guide has no formal instructions of the daily scrum, the important is that the format fits with your team: online, standup, chat, or tossing a ball – what works for you is the right choice. Many teams will have each developer present what they did yesterday, plans for today and whether they are blocked by anything .

Increment

Figure 3. Incremental deliveries vs One Final Delivery. Illustrated with the example of a car, in reality, it would be very costly to develop a car with incremental deliveries – but works nicely as illustration for an incremental process. Inspired by Arijit Sarbagna, Dzone.com

At the end of the sprint the scrum team has in the optimal scenario completed all the tasks from the sprint backlog, even though this is not the case, the sprint will still be complete as the timebox is coming to an end. The tasks which have not been completed will have to become a part of the backlog and go through the prioritization phase again to make it to the backlog of the next sprint. The tasks which have resulted in changes, new features, or other relevant software updates to present for the stakeholders will be presented on the Sprint Review. Increments are a part of the agile way of working, where the focus is to make constant small improvements, in order to keep stakeholders informed and receive feedback as build. This can be seen as a process where features are added after the software is already taken into use, this is also known as Continuous Development/Continuous Integration. This is mainly used for software, but to make it more illustrative it is showed with the example of car development in figure 3. Where incremental updates will focus on adding value, the first increment will be to make a product that can drive, then something more comfortable or faster, determined by what create business value. In traditional waterfall development, the focus will often be to finish the wheels, then the cabin, and so on. This might seem more effective, but have a high risk of not fulfilling the stakeholders' demand, as the solution cannot be adjusted while developed. Remember the car example is only for illustrative matters, the focus is on software development.

Sprint Review

The goal of this session is to inspect and review the results of the sprint. This is often done with a presentation of deliverables by the scrum team for stakeholders. During this review, the goal is to have a dialogue about the results and the value in regards to the overall product. In terms of gathering a strong sense of ownership and engagement of the development team, this session can be used as a form of a celebration of what has been achieved and should have a casual vibe .

Sprint Retrospective

This is the chance for the scrum team to reflect upon the last sprint. What went well and what would they like to do even better, this should hopefully lead to initiatives that can increase quality and effectiveness in the future sprints. The scrum guide suggests the results of the sprint are evaluated in regards to the individuals, interactions, processes, tools, and the Definition of Done. Some of these initiatives that the team would like to change or implement can be added to the sprint backlog of the next sprint if required. To obtain the true value of the Sprint Retrospective, there must be a high level of transparency, honesty and trust to the other team members, this will allow talking about some of the true challenges that the team might face. Afterwards the team will be stronger and be able to overcome every challenge, to create this transparent and safe atmosphere the scrum master plays a crucial role.

Why use Scrum for software development?

One of the main challenges when developing software is the changing requirements from the receiver through the development period. The requirements and priorities for the product will at the end of the development period, will in most cases have changed since the development began. This challenge is captured in the book: Agile Product Management with Scrum her is a 2-year software development project using the waterfall framework described. During the project, the focus was put on the plan and the budget, and they managed to complete the project on time and within budget. Unfortunately, the market situation of the customer after the 2-year development period was not as assumed and the software was therefore useless, no business value was created, and the resources wasted. They did not allow for changes while the development was ongoing.

The smart reader will argue that this is not an argument for Scrum, which is true. This is a clear example of one of the main challenges with traditional software development, where an agile approach is beneficial. By adopting Scrum, you will work in short sprints, from which you will receive continuous feedback from stakeholders at review sessions to make sure the result will add business value. This way of working will allow for flexibility and changing requirements, which is a great advantage when developing software.

Figure 4. The level of risk following the progress comparing the Scrum and Waterfall framework during software development. Inspired by James Fremann, edrawsoft.com

Another important aspect that is often considered in project management is risk. When developing software one of the major risks is to develop the “wrong” software, as presented above. Comparing the waterfall framework and the Scrum framework in this light, the risk of developing the wrong end product has been illustrated in figure 4. As the Scrum framework is based on iterative deliveries whit continuous review and implementation, the risk will be limited to developing the wrong thing in one sprint, compared to the waterfall method, where the entire work is completed before implementation.

Limitations of Scrum

In order to make a successful implementation of Scrum, it is of great importance that the rest of the organization is ready for a new way of working. The importance of implementing the 2 key characteristics of the Scrum framework, “Cross-functional” and “Self-managed” teams is presented together with possible constraints in the book: Navigating Hybrid Scrum Environments . Cross-functional means the team must contain the required skills to develop the product. Traditional teams often consist of people with the same skills. Having all the required skills in the teams prevents delays from dependencies from other parts of the organization. The second benefit is connected to being self-managed. When a team has no Product Manager, the team will be responsible for the work distribution and the solutions themselves. In this way, the team holds all the skills they need to deliver the product, combined with the responsibility. Combining capabilities and self-management will give the teams a greater sense of responsibility, resulting in better products. Scrum will often fail to become a success, in organizations where the teams are not “Cross-functional” and “Self-managed”. This will often happen if the product owner turns into a traditional Product Manager, whit the role of distributing and assigning work to the team. When the Product Owner starts to manage the team, he or she will also become responsible for the results. The creativity of the developers will be limited to the orders of the product manager. Trying to transform traditional teams with the same skills to Scrum teams will remove their capability of being “Cross-functional” why they will often be delayed due to dependencies to other people in the organization.

The team size is another important matter to touch upon, according to the Scrum guide, the teams should have a maximum of 10 participants. In many large organizations much more than 10 people are working on developing a product. Many of these organizations have seen the promising results of Scrum and want to adopt the framework. This can be a challenging task while keeping the ability to make fast changes and keep flexibility, the Scrum guide suggests splitting the group into multiple development teams with the same product backlog, product goal, and product owner. One of the main challenges when scaling the Scrum framework is to keep the teams self-managed, as more teams are working on the same product, the question of how they should be organized arises . There are multiple frameworks, that try to address this challenge, to mention a few Scaled Agile Framework (SAFe), The Large-Scale Scrum Framework (LeSS), or the Scrum@Scale could all be relevant to consider for scaling Scrum.

The focus of this article is Scrum used for software development, but before jumping right into implementing Scrum for software development or for other product development projects, it is important to consider what kind of product is being delivered. One of the key concepts of Scrum is incremental deliveries and here is it important to consider what can be delivered incrementally. After the architecture of the software is developed and put in place, you could say the skeleton of the software, you can start building on incremental updates, which the end-user can see and understand. But what about other projects, earlier on in figure 3, there where an example of developing a car incrementally, but is that even realistic. Probably not so much, the cost of first developing a skateboard, then a bike, and then end up with a car, would simply be too costly and therefore not be a realistic application of Scrum. This is often considered as the constraints of physicality; some products will not benefit from being developed with the Scrum framework. In relation to software development, it benefits from the flexibility of the computer and the possibility of constant adding on.

Annotated bibliography

The Scrum guide

The guide for Scrum written by Ken Schwaber and Jeff Sutherland. The guide is continuously updated, with the last update in 2020. The guide takes you through the roles, events, and artifacts you need to know in order to adopt Scrum in only 20 easy read pages.

Agile Manifesto

The Agile Manifesto is signed by 17 individuals frustrated with traditional software development, including Ken Schwaber and Jeff Sutherland the originators of Scrum. All 17 individuals working within or around software development. The agile manifesto includes 12 principles and 4 values, to reduce the challenges of software development by making it more agile. Values with are important to incorporate to obtain the full advantage of Scrum.

Navigating Hybrid Scrum Environments

There are many books describing Scrum, the roles, artifacts and events. This book takes is a steep deeper and tries to answer the question why. This will give you a much better understanding of the reasons for the different roles, artefacts and event. The highlight of the book is the focus on why the self-management and cross-disciplinary teams are so important for the success of Scrum and why it is challenging to scale these principles. The book is written by Frederik M. Fowler who have worked as software developer for more than 35 years and today is the highest-level certified Scrum Master.