After a long day resolving too many incidents, you may go home to binge watch Netflix and fall asleep at 8pm. After receiving the “Are You Still Watching” message one too many times (trust us, we’ve been there too) you eventually give up. But when you’re contending with putting the day’s incidents and unnecessary escalations behind you, zoning out to the latest Stranger Things is sometimes necessary. Hopefully you’re not having nightmares about when the next critical incident happens or the workload of tomorrow. After all, dealing with the volume of events generated by IT monitoring tools is a challenge only 52% find manageable while 13% struggle and 1% are just completely overwhelmed. Manageable isn’t positive, but at least it’s not escalated phone calls at 3am!
Working in an enterprise IT Operations team means you’re handling hundreds, even thousands, of incidents weekly. Incidents are flooding in from end users or monitoring tools watching numerous applications, IT infrastructure systems, devices and network elements. We’re not saying give up binge watching, but we are recommending to give up burdensome manual incident resolution.
Resolving incidents quickly protects operational efficiency, employee productivity, customer satisfaction, service level agreements, revenue, etc. So, what’s the answer? Say it with me now: Automation. Don’t get scared now.
Consider the number of incidents you experience – there are all kinds of use cases, severity, and criticality. Automation has a significant role to play validating, diagnosing, and resolving these incidents, including reducing Mean Time to Acknowledge (MTTA) and Resolve (MTTR); improving service delivery; eliminating human errors; and supporting the business better without headcount.
But there is a trick to automation and this is where Netflix comes in. You’re enjoying a program and the next episode is auto played. When a show is over, they suggest another show you may like based on your past viewing. Is that the dream? Can the same be done with Incident Resolution automation?
Automation projects often prove to be time consuming, expensive endeavors lacking justification to further invest. Automation is not as easy as watching television, but your methodology could be.
Beyond “play next” and without the judgement of “yes, I’m still watching, please stop asking”, Netflix provides where to go next. When it comes to Incident Resolution automation, so does Resolve. Automating based on our use cases means your IT automation is driving you forward. It’s the age-old crawl, walk, run adage. To succeed, you need:
And never forget the people of the solution, because at the end of the day, it’s the people that make up your team and will have the capacity to work on other projects with automation in play.
Get started. Press play. What is the #1 use case that can be taken care of with end-to-end automation? Fully automate reoccurring, simple use cases that burden your Service Desk or get escalated. Automate tasks in the incident resolution process can yield immediate value, including:
With minimal investment of time and development resources, the above incidents can be validated, diagnosed, and resolved automatically to give you more time to chill – or, really, to work on more prudent projects and remove the noise of the alerts for simple tasks.
When you’ve conquered episode 1, tell the automation you’re still “watching” and press play for the next episode.
Validating whether an event is truly a problem incident and not just a duplicate or something already taken care of is often a time consuming task which can sit in an agent’s queue for a too-long time. Your L1s probably also lack permission to even handle them on their own! Mute the noise by automating the validity of your alerts, particularly:
When tackling simple use cases with IT automation, it’s easy to see the benefits quickly. In fact, with end-to-end automation, you may not even notice how many incidents Resolve is handling in the background.
Like Netflix, once you’ve rolled out automation to handle password resets, server health checks, and application performance issues, it’s time to play the next series – more complex for more impact.
Validating, diagnosing, and resolving with incident resolution IT automation empowers everyone to tackle more complex use cases with human-guided automation. Where human intervention is required, frontline operators should be given context-specific guidance and steps in a larger runbook for incident resolution. Escalations to Level 2 and Level 3 become less frequent and shift knowledge left. This tackles frequent and more challenging use cases like:
While addressing the more complex above use cases, take care of some tasks to ensure the success of this phase as well as provide a foundation for potential self-service, from customer portal or ERP outages to firewall and VPN Throughput Saturation.
With ongoing improvements, Resolve also provides analytics and dashboards for insight into the entire resolution lifecycle and enables cross-department collaboration for accelerated remediation. Empowering end users to solve frequent incidents without calling the Service Desk reduces false alerts and enable SMEs to retain tribal knowledge with complex automations rolled out without developers.
Although it may sound too easy, getting started with automation is the first step. Outlining the next steps, and the next use cases to tackle, is a strategy to free up your operations team with IT Automation. Resolve provides the capabilities to get started small, with the simple use cases like password resets, and scales out to core services and other use cases.
Automating network health checks & diagnostics accelerates service restoration during severe weather