People, Person, Computer, Electronics, LCD Screen, Laptop, Pc

Application Observability with Kubernetes

As all industries are increasing getting reinvented with technology, an increasing number of companies are writing software to drive revenue growth. The cloud platform providers such as Amazon, Microsoft and Google provide a large number of application and data services via API and do so an increasingly new set of vendors like Paypal, Twilio, Stripe, Shopify and Google Maps. This makes it very easy for developers to quickly build and deploy application components. Products like Kubernetes and Docker make it easy to deploy these components. Products like Mulesoft and Google Apigee make it easy to extend existing on-prem enterprise applications with APIs. As applications are deployed on mobile devices and all traditional devices becoming connected devices, the number of application components is growing exponentially. In serverless architectures like Amazon Lambda every function call is an application component and they are ephemeral and instantiated only on use.

While application components glued together with APIs makes it easy and fast for developers to build new application functionality, it fundamentally changes what is needed to operate these applications for consistent performance. The applications increasingly start looking like a dynamic network of application components where the interactions between these components play a much bigger role in the customer experience. The traditional approach to end-point based application monitoring with instrumentation and agents from companies like New Relic, AppDynamics, Datadog, Dynatrace, Amazon XRay etc. is necessary but no longer sufficient. This traditional approach may work longer if an organization can get most of its developers to consistently use instrumentation for all code that can impact performance and limit the use of cloud and external vendors API services. In the long term, Ops needs the ability to deeply understand the interactions between application components many of whom may be third-party services and look for early signals in the content of the APIs to smoothly run their applications. This creates the need for a new class of product such as Netsil for Application Observability.

Kubernetes Monitoring Needs Maps

The operations teams from companies like Twitter, Google and Yahoo where members of the Netsil team come from have been building tools in house for application observability. Starting with grants from the National Science Foundation, Netsil has been able to develop fundamental technology for very efficient in-memory processing of network bitstream against a grammar specification of APIs to reconstruct full content of every API transaction and package it for easy deployment within an enterprise perimeter or as SaaS. The result is that they can deliver complete application observability independent of the application stack, application component location, developer consistency and use of third party services. It is like Google Maps for distributed cloud apps. Kubernetes production deployments have emerged as the most common deployment use case for Netsil. Most Kubernetes cluster run multiple applications and Netsil allows the operators to identify issues on all their applications before they become critical and so they can sleep well at night.

Originally published at https://www.linkedin.com on September 20, 2017.


Application Observability with Kubernetes was originally published in Mayfield Viewpoints on Medium, where people are continuing the conversation by highlighting and responding to this story.

Read more >

Published on Sep 20, 2017

Other people viewed

Senior Machine Learning Engineer

Qventus Mountain View California United States Mountain View, California, United States
Want to unlock insights from data to help doctors and nurses? Apply to be on our data science team! Have you ever found yourself or a loved one waiting hours and hours in a hospital Emergency Room to get care? Did you ever feel there weren't ...

Enterprise Account Executive

SmartRecruiters Austin Texas United States Austin, Texas, United States
The SmartRecruiters Enterprise Account Executive will sell with insight, network, be able to build rapport and credibility with your clients, and create demand unique to our solution, by understanding their business/industry challenges, and what m...

Enterprise Sales Engineer

SmartRecruiters San Francisco California United States San Francisco, California, United States
This opportunity will target strategic enterprise customers globally. Many of the customers are looking to transform their recruiting and HR operations processes, and we can show them the added value SmartRecruiters will give them. SmartRecruiters...

Senior Data Scientist

SmartRecruiters Berlin Berlin Germany Berlin, Germany
We are looking for a Senior Data Scientist to join our Search & Analytics team that builds innovative, data-driven recruiting services. You'll solve complex data problems like predicting how well a candidate will fit a job. Working closely wit...