#errplane

InfluxDB

InfluxDB is a time series, events, and metrics database. It's written in Go and has no external dependencies. That means once you install it there's nothing else to manage (like Redis, HBase, or whatever). It's designed to be distributed and scale horizontially, but be useful even if you're only running it on a single box.

Design Goals

Stores metrics data (like response times and cpu load. e.g. what you'd put into Graphite).

Stores events data (like exceptions, user analytics, or business analytics).

HTTP(S) interface for reading and writing data. Shouldn't require additional server code to be useful directly from the browser.

Security model that will enable user facing analytics dashboards connecting directly to the HTTP API.

Horizontally scalable.

On disk and in memory. It shouldn't require a cluster of machines keeping everything in memory since most analytics data is cold most of the time.

Simple to install and manage. Shouldn't require setting up external dependencies like Zookeeper and Hadoop.

Ability to compute percentiles and other functions on the fly.

Ability to automatically downsample data on different windows of time.

Can efficiently and automatically clear out raw data daily to free up space. However, some time series will keep data forever, while others will keep only a rolling window (like the last 30 days)

Should be able to add on custom real-time and batch analytics processing.

Pubsub interface

Ability to automatically expand storage, but adding storage nodes is not something that is done frequently. However, should make node replacement quick and easy.

New Post has been published on http://projectopenhand.biz/y-combinator-backed-errplane-launches-comprehensive-performance-monitoring-and-alert-service-for-web-apps/3077

Y Combinator-Backed Errplane Launches Comprehensive Performance Monitoring And Alert Service For Web Apps

Errplane, a new Y Combinator-backed service for monitoring performance, uptime and errors for any type of web application, just officially launched its service. Currently, Errplane argues, developers need a number of different services like New Replic, Pingdom and Airbrake to effectively monitor their apps. Errplane unifies all of these functions into one single service, because, as the company’s CEO and co-founder Paul Dix told me last week, all of these separate tools ultimately rotate around the same goal you are trying to accomplish.

About a third of the current Y Combinator class is already using the service, as well as a number of other companies, including Garry Tan’s PostHaven for Posterous exiles, VHX, Brewster, Amicus and RingRevenue. Across all of these beta customers, the system currently handles about 30 million data points per day.

Errplane provides developers with an easy to use API that ensure that an apps’ vital signs constantly flow into Errplane’s database, including request response time, exceptions and other performance stats. With a bit of extra code, developers and also enable heartbeat tracking (to ensure background processes haven’t failed), information about background job completion time and more detailed information about user behavior.

The service, of course, also provides numerous options for getting alerts when something fails, including the ability to get SMS alerts, emails and chatroom messages in Hipchat, Campfire and similar tools.

To get started, developers only have to insert a few lines of code and the system should be ready to go. Currently, Errplane offers libraries for Ruby on Rails and Node.js, but the company plans to add support for JavaScript, Java, PHP and .NET very soon. While the team is currently focusing on web platforms, Dix told me that it’s also considering to branch out into mobile and an iOS version will likely launch once the team has the major web platforms covered.

One nice features of Errplane, as Dix told me, is that the service provides a default dashboard, but because it offers a comprehensive API, developers can also integrate it with their existing dashboards or build their own dashboards from scratch. The API exposes all of the data the service collects and while some of its competitors often just provide developers with 1-minute averages, Errplane gives you full access to all of your stats. Indeed, one of the things the team learned from its beta customers is that they didn’t just want to see average but that they wanted to be exposed to all of the data.

Interestingly, the team used Google’s Go programming language for a number of critical components. The team previously experimented with using Cassandra and Scala for its datastore, but eventually settled on Go, which seems to be making inroads with developers lately as we’ve heard from a number of companies about its advantages lately. Cloudflare, for example, recently told us it is using it for its Railgun implementation.

Looking ahead, the Errplane team hopes to make the system even smarter and provide developers with an early warning system before major issues actually occur. Before that, though, Errplane plans to provide users with more user interface options and new ways to visualize their data.