#high scalability

Sponsored Post: Loupe, Etleap, Aerospike, Stream, Scalyr, VividCortex, Domino Data Lab, MemSQL, InMemory.Net, Zohocorp

Who’s Hiring? 

Need excellent people? Advertise your job here! 

Fun and Informative Events

On-demand Webinar. Fast & Frictionless – The Decision Engine for Seamless Digital Business. In this session, guest speakers Michele Goetz, Principal Analyst at Forrester Research and Matthias Baumhof, VP Worldwide Engineering at ThreatMetrix, discuss: How risk-based authentication leveraging digital…

One model at a time: Integrating and running Deep Learning models in production at EyeEm

This is a guest by Michele Palmia, now @EyeEm, good times @IBM, @UniPd and @UCC.

We’ve now been running computer vision models in production at EyeEm for more than three years – on literally billions of images. As an engineer involved in building the infrastructure behind it from scratch, I both enjoyed and suffered the many technical challenges this task raised. This journey has also taught me…

New Book: Explain the Cloud Like I’m 10

What is the cloud? Why is it called a cloud? How does the cloud work? What does it mean when something is ‘in the cloud’?

I wrote a new book: Explain the Cloud Like I’m 10, answering those questions for the complete beginner. It makes the perfect gift for Halloween. And Thanksgiving. And Christmas. Oh, and birthdays too!

The irony is, if you read HighScalability, you’re not the target audience 🙂

Stuff The Internet Says On Scalability For October 20th, 2017

Hey, it’s HighScalability time: 

  Cassini’s last image of Saturn, stitched together from 11 color composites, each a stack of three images taken in red, green, and blue channels. (Jason Major)  

If you like this sort of Stuff then please support me on Patreon.

21 billion: max bitcoins ever; #2: Alibaba’s cloud?; 1M MWh: Amazon Wind Farm Texas with 100 Turbines is live; $1000: cost to track…

ButterCMS Architecture: a Mission-Critical API Serving Millions of Requests per Month

This is a guest post by Jake Lumetta, co-founder and CEO of ButterCMS.

ButterCMS lets developers add a content management system to any website in minutes. Our business requires us to deliver near-100% uptime for our API, but after multiple outages that nearly crippled our business, we became obsessed with eliminating single points of failure. In this post, I’ll discuss how we use Fastly’s edge…

http://www.rightscale.com/blog/cloud-management-best-practices/benchmarking-load-balancers-cloud # the canonical benchmark of LBs on AWS

https://harish11g.blogspot.com/2012/07/aws-elastic-load-balancing-elb-amazon.html # see point 4, but this was also 4 years ago

https://www.jayway.com/2015/04/13/600k-concurrent-websocket-connections-on-aws-using-node-js/ # EC2 without ELB, using node.js and kernel tuning

http://blog.flux7.com/blogs/aws/must-know-facts-about-aws-elb

http://shlomoswidler.com/2009/07/elastic-in-elastic-load-balancing-elb.html # testing elasticity in ELB (mostly overlaps with AWS whitepaper below)

https://docs.aws.amazon.com/general/latest/gr/aws_service_limits.html # service limits for AWS in general; useful reference

https://aws.amazon.com/articles/1636185810492479 # AWS whitepaper on best practices for evaluating ELB

https://aws.amazon.com/documentation/elastic-load-balancing/ # formal ELB documentation

https://lab.getbase.com/how-we-discovered-limitations-on-the-aws-tcp-stack/

https://coderwall.com/p/__z9ia/scale-php-on-ec2-to-30-000-concurrent-users-server

https://blog.unitedheroes.net/archives/p/4633/how-many-sockets-does-aws-support-anyway/ # AWS EC2 websockets support per instance