SOAPs: How workload automation is evolving according to Gartner®Gartner’s Workload Automation Trends

Learn about the evolution of job scheduling and workload automation solutions into Service Orchestration and Automation Platforms (SOAPs).

Changes to IT environments and processes have continued to skyrocket in recent years. Digital transformation initiatives are now characterized by cloud adoption, workload automation (WLA) and process orchestration across complex ecosystems.

As a result, the automation strategies and tools you choose for enterprise use cases must evolve. Traditional approaches and cloud automation solutions can’t meet the needs of the new IT environment and the changing face of business.

Let’s take a look at the future of automation, according to Gartner, and the key role of SOAPs.

A new world of IT operations

Organizations have embraced new technologies to deliver the cost reduction and improved operational performance promised by digital transformation. Self-contained on-premises data centers have shifted to containerized infrastructures and multi-cloud or hybrid cloud environments. New business applications and services have also expanded the breadth of most companies’ digital infrastructures, as APIs and web services enable easier and faster connectivity with traditional ERPs and other enterprise applications. And many organizations have increased their use of big data for machine learning, artificial intelligence and analytics.

These technological changes also reflect a shift in business and IT team priorities, as CIOs, IT professionals and automation software all play a big role in improving customer experience and competitive differentiation. Organizations need greater agility and innovation from their IT and Infrastructure and Operations (I&O) leaders for IT process optimization and to achieve value-based KPIs, rapid time-to-market and profitability.

Business leaders are reacting by making significant changes to IT automation strategies and workflows. In the 2024 Gartner® Magic Quadrant™ for SOAPs report, Gartner analysts Hassan Ennaciri, Chris Saunderson, Daniel Betts and Cameron Haight state:

By 2027, 90% of organizations that currently deliver workload automation will be using Service Orchestration and Automation Platforms (SOAPs) to orchestrate workloads and data pipelines in hybrid environments across IT and business domains.

They also share that the SOAP market is expected to grow to an estimated $6.3 billion by 2027, with a compound annual growth rate (CAGR) of 6.2%. 

Why workload automation must evolve

Traditional WLA solutions evolved from job scheduling tools. While WLA delivers on the key values of operational efficiency, human error reduction and cost savings, its initial design still carries many limitations in functionality.

In traditional workload automation, workflows are still managed by careful coordination of scheduled tasks. However, customer expectations for responsiveness and competitive differentiation require business tasks to run in near-real time. 

Workload automation capabilities have also traditionally been focused on core workflows around ERPs or other siloed technical or operational domains, with many organizations operating multiple workload automation tools independently. This type of automation leaves gaps that lead to inefficiency, errors and manual processes, with no clear visibility into the performance of the overarching business processes the automation is intended to support.

The inability to deploy flexible WLA strategies also impedes business growth. Without collaboration and automation inside and outside of IT, business and IT teams face siloed capabilities.

In all these cases, the limitations of the traditional approach to workload automation prevent IT and I&O leaders and teams from shifting their automation strategy to focus on the higher-value goals of innovation, agility and customer service.

Gartner’s SOAP model for workload automation

In Gartner’s analysis, the model for workload automation must adapt to address these strategic and operational shifts. 

Fundamentally, they believe that the scope of workload automation must expand both horizontally and vertically to deliver automation of a full business process, where each business process is viewed not as a set of discrete tasks but a complete cross-platform service coordinated from end to end.

SOAPs adapt to new use cases for data pipelines, application architectures and cloud-native infrastructure. This expands the role of traditional workload automation and complements and integrates with DevOps toolchains. The result? Enhanced operational efficiency, standardized processes and cost savings, all while providing customer-focused agility.

Gartner has identified six capabilities that differentiate SOAPs from traditional IT workload automation and will be essential for business and IT operations.

• Workflow orchestration to enable end-to-end coordination of a business process across its underlying technologies and present a unified view of that process. Through this orchestration, IT teams can eliminate gaps in automation to gain efficiency and insight that can ensure and even optimize performance.
• Event-driven automation to react to events or data in real time, running processes to handle them as they occur rather than queuing or delaying for batch processing.
• Scheduling, monitoring, visibility and alerting gives IT operational information to meet SLAs and proactively resolve issues and keeps business users up to date on the metrics and processes they care about.
• Self-service automation to empower business users, developers and other teams to directly interact with and initiate automated workflows.
• Resource provisioning to perform configuration and provisioning of compute, network, storage and other resources needed for DevOps initiatives, including development, testing and deployment of IT infrastructure.
• Managing data flows to orchestrate the data lifecycle through ingestion, transformation and storage pipelines as real-time streams, batched transactions or file transfer.

The 2024 Gartner® Magic Quadrant™ for SOAPs report shares that “SOAPs remain an evolving market, representing the transformation of a mature market for workload automation tools to meet modern infrastructure, application, data and business process requirements.” 

Gartner®’s 2024 Magic Quadrant™ for SOAP report

Get the complete 2024 Gartner® Magic Quadrant™ for SOAPs report to learn more about the SOAPs market and why Redwood was named a Leader, positioned furthest in Completeness of Vision.

A unified view of the automated enterprise

The new requirements for workload automation extend its role and value beyond its traditional scope and use cases, but SOAPs do not replicate or replace other specialized IT automation software. Rather, they become a central hub that orchestrates business processes through integrations and other complementary forms of IT automation technologies such as Robotic Process Automation (RPA), DevOps and infrastructure management toolchains.

However, IT organizations with multiple workload automation tools can and should consolidate them into a single business process automation platform to eliminate the costs, inefficiency and fragmented views that result from these separate tools.

Workload automation performs a critical role within IT operations, but it must evolve to adapt to technological advancements and changing business needs to deliver more value to the organization and its customers.

Read more about the growing importance of SOAPs — get your copy of the 2024 Gartner® Magic Quadrant™ for SOAPs report.

Magic Quadrant is a trademark of Gartner, Inc. and/or its affiliates.