People, Person, Computer, Electronics, LCD Screen, Laptop, Pc

Application Observability with Kubernetes

As all industries are increasing getting reinvented with technology, an increasing number of companies are writing software to drive revenue growth. The cloud platform providers such as Amazon, Microsoft and Google provide a large number of application and data services via API and do so an increasingly new set of vendors like Paypal, Twilio, Stripe, Shopify and Google Maps. This makes it very easy for developers to quickly build and deploy application components. Products like Kubernetes and Docker make it easy to deploy these components. Products like Mulesoft and Google Apigee make it easy to extend existing on-prem enterprise applications with APIs. As applications are deployed on mobile devices and all traditional devices becoming connected devices, the number of application components is growing exponentially. In serverless architectures like Amazon Lambda every function call is an application component and they are ephemeral and instantiated only on use.

While application components glued together with APIs makes it easy and fast for developers to build new application functionality, it fundamentally changes what is needed to operate these applications for consistent performance. The applications increasingly start looking like a dynamic network of application components where the interactions between these components play a much bigger role in the customer experience. The traditional approach to end-point based application monitoring with instrumentation and agents from companies like New Relic, AppDynamics, Datadog, Dynatrace, Amazon XRay etc. is necessary but no longer sufficient. This traditional approach may work longer if an organization can get most of its developers to consistently use instrumentation for all code that can impact performance and limit the use of cloud and external vendors API services. In the long term, Ops needs the ability to deeply understand the interactions between application components many of whom may be third-party services and look for early signals in the content of the APIs to smoothly run their applications. This creates the need for a new class of product such as Netsil for Application Observability.

Kubernetes Monitoring Needs Maps

The operations teams from companies like Twitter, Google and Yahoo where members of the Netsil team come from have been building tools in house for application observability. Starting with grants from the National Science Foundation, Netsil has been able to develop fundamental technology for very efficient in-memory processing of network bitstream against a grammar specification of APIs to reconstruct full content of every API transaction and package it for easy deployment within an enterprise perimeter or as SaaS. The result is that they can deliver complete application observability independent of the application stack, application component location, developer consistency and use of third party services. It is like Google Maps for distributed cloud apps. Kubernetes production deployments have emerged as the most common deployment use case for Netsil. Most Kubernetes cluster run multiple applications and Netsil allows the operators to identify issues on all their applications before they become critical and so they can sleep well at night.

Originally published at https://www.linkedin.com on September 20, 2017.


Application Observability with Kubernetes was originally published in Mayfield Viewpoints on Medium, where people are continuing the conversation by highlighting and responding to this story.

Read more >

Published on Sep 20, 2017

Other people viewed

Product Lead, Audiophile

Massdrop United States United States
We are searching for a Product Lead to help expand our Massdrop Made collaborations program for the Audiophile community. In this role, you will organize collaborations with enthusiast designers and top-tier manufacturers, and help to develop new ...

Product Lead, Blades & Everyday Carry

Massdrop United States United States
We are searching for a Product Lead to help expand our Massdrop Made collaborations program for the Blades & Everyday Carry communities. In this role, you will organize collaborations with enthusiast designers and top-tier manufacturers, and h...

Product Lead, Mechanical Keyboards

Massdrop United States United States
We are searching for a Product Lead to help expand our Massdrop Made collaborations program for the Mechanical Keyboards community. In this role, you will organize collaborations with enthusiast designers and top-tier manufacturers, and help to de...

Data Engineer

Massdrop United States United States
OverviewAs a Data Engineer on the Data team you'll provide intelligence to the rest of the company that will enable making better product decisions. You'll work directly with the CTO to pioneer use of the latest advances in large scale data proces...