Driving a Simple Performance Baseline

Adopting an Application Performance Management (APM) strategy will help you manage the quality of the customer experience. The challenge is that APM has evolved into a mosaic of monitoring tools, analytic engines, and event processors that provide many solutions to different problem sets.

When you step back and look at the big picture it all comes into focus, but when you’re trying to rationalize one technology over another, things aren’t so clear at close range. Product overlaps, ongoing costs, and ownership come into question, and then someone will eventually inquire about the benefits they are receiving from these tools sets.

You will be tempted to demonstrate all the bells and whistles the products provide in hoping to convince them that the value outweighs the complexity. Don’t overlook the profound impact a childlike view can have with understanding application performance. “Sometimes the questions are complicated and the answers are simple.” – Theodor Seuss Geisel (aka. Dr. Seuss).

It is important to show how an APM solution can tie into existing systems, by articulating the big picture, so that IT leaders can conceptualize the value coming from the new solution. How you articulate the Manager of Managers (MoM) concept and how it will support the APM strategy is essential for buy-in. See Figure 1.

Manager of Managers (MoM)

MoM

As you begin, start by identifying the dual purpose toolsets (i.e. provisioning and monitoring), already in the organization to incorporate as part of the APM solution. Then consider choosing a technology that is “application aware” to spear-head your real-user-monitoring (RUM) initiative. When done correctly, Application Aware Network Performance Monitoring (AANPM) can become the linkage between silos, providing relevant performance data in a context that all groups will understand, and subsequently trust. For more on this read, APM & MoM – Symbiotic Solution Sets.

Application Aware Network Performance Monitoring (AANPM)

I have found that the simplicity and ease of use with agent-less monitoring (i.e. wire data analytics) is a great place to start. It should have the capability to provide insight for the protocols specific to your critical applications (e.g. XML, SQL, PHP, etc.).

Since agentless monitoring is “always on” it will be ready to monitor any new applications launched into production within its purview. There’s no need to worry about managing a fully burdened application life cycle for a typical agent installation, although when the time comes agent monitoring is recommended to fully instrument an application.

Baseline the end-user-experience (EUE)

For example, when expanding a critical business application across our northern locations we used agentless monitoring to present a dashboard that answered specific performance questions about availability and user response times. It was a basic graph with two data elements across one dimension of time, making it easy to compare the current end-user-experience (EUE) to its normal baseline. A somewhat elementary but very effective way to communicate the real-time performance back to the Developers and IT Leadership at the same time during the rollout. See Figure 2.

mom_fig_2

 

As the application usage increased with user load, we noticed that performance rose well above the normal baseline. We observed an increase in application operation time, which had a direct correlation to page aborts indicating user frustration. Then the system reached the point of critical mass and started presenting HTTP 500 errors. Based on a simple performance breakdown showing server time over its threshold and network time within baseline, the Developers were directly engaged and the Network Team was on standby. See Figure 3.

mom_fig_3

Given this starting point, the Development team began troubleshooting the performance discrepancy early on and before mid-day they had identified the root cause and added a new Index to one of the very large data sets that was being called frequently.

Conclusion

As you strive to achieve new levels of sophistication when creating performance dashboards don’t overlook the simplicity of highlighting just a few metrics on one page that mean something to the support team. This will take an understanding of the application and knowledge of how the metrics are being collected to be succinct. Be patient, just as water seeks its own level, an application performance baseline will eventually emerge as you track the real-time performance metrics outlining the high and low watermarks of the application.

This article was first published on LinkedIn at – Link


Larry Dragich (LinkedIn) Director of Customer Experience Management at a large insurance company. He is actively involved with Larry_Dragichindustry leaders sharing knowledge of Application Performance Management (APM) best practices, resource allocation, and approaches for implementation. He has been working in the APM space since 2006 where he built the Enterprise Systems Management team which is now the focal point for IT performance monitoring and capacity planning activities.  Larry is also a regular blogger on APMdigest, and a contributing editor on Wikipedia focused on defining the APM space and how it ties into the critical ITIL processes many companies are now using.

Related Posts

  • APM and MoM – Symbiotic Solution SetsAPM and MoM – Symbiotic Solution Sets This article first appeared in APM Digest over two years ago and its approach for enterprise monitoring is valid now more than ever. As the APM market shifts, and complimentary technologies for monitoring applications and the infrastructure overlap, there is a growing need to articulate […]
  • Gartner Announces Cool Vendors in Application Performance Monitoring and IT Operations AnalyticsGartner Announces Cool Vendors in Application Performance Monitoring and IT Operations Analytics We decided to rename our cool vendors research this year, since we regularly were featuring technologies which were not related directly to performance demands, but also included general analytics technologies applied to infrastructure and operations professionals needs. In the research […]
  • Magic Of Monitoring And The Future Of APMMagic Of Monitoring And The Future Of APM As We Saw It Then - At the time when we were looking for a monitoring solution (2006-2007) APM as we know it today had yet to be defined. There was no Gartner MQ, real-user-monitoring (RUM) was too high level, “agent monitoring” brought concerns of overhead and complexity, instrumenting […]
  • Application Aware–Infrastructure Performance Management – Virtualization PracticeApplication Aware–Infrastructure Performance Management – Virtualization Practice For years, Gartner has insisted that if an APM tool does not cover each of its “Five Dimensions of APM,” one of which is deep code analysis, then it is not an APM tool. Gartner has therefore defined APM to be relevant only to custom-developed applications. Well, it has finally woken up […]