PLAY PODCASTS
Episode 65: The High-level WTF on "Scheduling"
Episode 65

Episode 65: The High-level WTF on "Scheduling"

We spend this week talking about workload scheduling, starting with Mesos. It's a fun ride from CONTROL-M to Lambda, along with Cloud Foundry and serverless. So get ready to beat a horse into glue. Plus, how to handle gifts for father's day and the usual recommendations at the end.

Software Defined Talk

June 10, 201655m 22sExplicit

Audio is streamed directly from the publisher (aphid.fireside.fm) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.

Show Notes

SPONSOR

Show notes

Father’s Day

MesosCon

  • Platform Infrastructure at Twitter: The Past, Present and - Future - Chris Pinkham, VP of Engineering, Twitter
  • Forgot to talk about this, but here are my notes from the MesosCon presentation by Twitter
  • Former Nimbula founder (Oracle acquisition), early AWS founder.
  • Twitter's kinda big deal, maybe you've heard of them. Over 1000 services manage Twitter, over 1,000,000 cores.
  • http://twitter.github.io
  • Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn't sustainable, need an open source community.
  • The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
  • 30,000 node Mesos cluster (probably largest). "We don't like being the biggest of anything, we find the edge cases." 130,000,000 containers launched daily.
  • Some of their acquisitions were in public cloud, they don't move them in-house. They're actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS. Users: Time Warner, Twitter (30,000 host deployment), Apple Siri.

What exactly is scheduling?

  • BMC CONTROL-M
  • Coté gets Matt to "checks out" his crudes understanding. (Spoiler: Checks out.)

Serverless, what’s the deal?

Mid-roll

BONUS LINKS!

Not covered in show:

Somebody’s using Kubernetes

  • Hear the tale!
  • Concur & Barkly Protects
  • Both shops did customizations to the codebase (AWS AZ & ELB support, Prometheus)

AWS & Australia News

Coté’s revamped Pivotal Conversations Podcast

Typosquatting Package Managers

  • Seriously messed up.
  • “In the thesis itself, several powerful methods to defend against typo squatting attacks are discussed. Therefore they are not included in this blog post.”

A Docker on every HPE Server

  • Running on HPE
  • Reference Architectures!
  • HPE 3PAR and SiteScope plugins!
  • Maybe Brandon can regale us with some history: tales of The Mercury Wars!
  • Also, some ALM stuff. Sadly, I don’t have access to the IDC reports on this, however, they’re expecting big things: “IDC's analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014–2019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%”
  • erry-one doin’ it! What’s up with Chef’s ALM/CD stuff? Pivotal circle of code vision, with ConcourseCI.

Recommendations