Software Engineering Daily

Time series data are simply measurements or events that are tracked, monitored, downsampled, and aggregated over time. This could be server metrics, application performance monitoring, network data, sensor data, events, clicks, trades in a market, and many other types of analytics data (influxdata.com). The platform InfluxData is designed for building and operating time series applications. InfluxData is engineered for growth with enterprise-grade security, ingests metrics, events and logs in a high-performing time series database, and platform analytics for detecting and resolving problems. In this episode we talk to Russ Savage, Director of Product Management at InfluxData. Sponsorship inquiries: [email protected]

Domain names are the address of your website that people type into the browser URL bar. Once purchased, a domain name is stored on your behalf by custodians like Google domains. Blockchain domains, on the other hand, are similar to regular domain names except they are stored and controlled in your cryptocurrency wallet. The company Unstoppable Domains provides blockchain domains that enable users to do things like keep a universal username across apps and websites, act as a website URL, act as a payment address for wallets, and much more. Replace cryptocurrency addresses with human readable names! In this episode we talk to Matthew Gould, Founder and CEO of Unstoppable Domains. Sponsorship inquiries: [email protected]

Pay-as-you-go pricing has become a strong selling point for modern SaaS companies as well as cloud-based companies. Public cloud providers, for example, typically only charge you for only what you use. But implementing this option is challenging because it requires advanced platform analytics. The company Octane is a drop-in metered billing system that gives you flexibility to bill how you want. They offer expressive price plans that bill on usage, include base rates, add-ones, discounts, and trials. Their services can be integrated easily with simple APIs and SDKs, and generate detailed breakdowns of customer usage and spending with customizable reports and dashboards. In this episode we talk to Akash Khanolkar, Co-founder at Octane. Sponsorship inquiries: [email protected]

Whether sending messages, shopping in an app, or watching videos, modern consumers expect information and responsiveness to be near-instant in their apps and devices. From a developer’s perspective, this means clean code and a fast database. Apache Druid is a database built to power real-time analytic workloads for event-driven data, like user-facing applications, streaming, and anything else that requires instant data visibility. Druid offers lower latency for OLAP-style queries, time-based partitioning, fast search and filter, and out-of-the-box integration with Apache Kafka, AWS Kinesis, HDFS, AWS S3, and more (Druid.apache.org). In this episode we talk with Eric Tschetter, Field CTO at Imply, Fellow at Splunk, and experience developing large swaths of backend infrastructure largely focusing on Druid. We discuss the use cases and power of Apache Druid. Sponsorship inquiries: [email protected]

This episode was published on the GeekWire podcast. Subscribe to GeekWire for more great content. Facebook CEO Mark Zuckerberg told employees recently that the company’s long-term goal is to “bring the metaverse to life” — helping to create an interconnected world of physical, virtual and augmented reality spaces that will reshape the way we work, interact with each other, create new things, and generally experience life. So how exactly will Facebook approach such an audacious plan? A new book called “Move Fast: How Facebook Builds Software” doesn’t delve into the metaverse, specifically. But in looking at Facebook’s engineering practices — the way the company makes stuff — the book examines the digital DNA of the social network, sheds new light on its most infamous motto, and explains the inner workings of a company that wants to reshape the human experience, again. Facebook influences the engineering culture and economy not just in its hometown of Menlo Park, Calif., but also in its development offices in the Seattle area, where it employs 7,000 people. And of course, ultimately, Facebook’s internal practices end up influencing people around the world who use its products. On this episode of the GeekWire Podcast, we talk with the author of the book, Jeff Meyerson, the longtime host of the Software Engineering Daily podcast, about the ways Facebook, Microsoft, Amazon and Google make things, and what those different approaches tell us about where they’re taking us. Listen above, or subscribe to GeekWire in any podcast app.

Auren Hoffman is the CEO of SafeGraph. In this episode we discuss data as a service and more. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

Serverless computing is a cloud computing solution that lets developers deploy applications to containers without managing the servers themselves. Servers and resources are provisioned automatically, pay only for what you use, and experience little to no errors or downtime (ionos). Google Cloud Run is a managed compute platform that enables you to run containers that are invocable via requests or events. Cloud Run is serverless, transparent, and easy to use. Common use cases include web services like REST APIs, data processing, automation, and modernization (cloud.google.com). In this episode, we talk with Steren Giannini, Senior Product Manager at Google. Sponsorship inquiries: [email protected]

According to Fugue’s new State of Cloud Security 2020 report, cloud misconfiguration remains the top cause of data breaches in the cloud, and millions of database servers are currently exposed across cloud providers. Some of the leading reasons are a lack of adequate oversight and too many APIs and interfaces to govern. (securityaffairs.co). Argos Security is a SaaS that detects and remediates misconfigurations of cloud assets within minutes. Argos detects and pinpoints exploitable issues in cloud environments, delivers a complete, real-time view of your cloud security posture, gives meaningful alerts and few false flags, and integrates in minutes with AWS, GCP, and Azure. In this episode, we talk with David O’Brien, Founder of Argos Security. Sponsorship inquiries: [email protected]

Latency is the time it takes to get from point A to point B. In programming, this might be the time from a user selecting their photos library to the pictures reaching their computer screen from the database. Fly.io is a simple platform for running full-stack apps and databases close to your users. Some available features include provisioning CPU, memory and storage based on your app’s demand, zero-configuration private networking and global load balancing, metrics and alerting, and managing SSL certificates at any scale. Fly.io beta is launching highly available PostgreSQL clusters with a single command and creating read replicas in different cities. In this episode, we talk with Kurt Mackey, Social Media Manager at Fly.io. Sponsorship inquiries: [email protected]

Direct-to-Consumer companies sell their products without going through a traditional middleman like an outlet store or wholesaler. By posting content on platforms like TikTok, Facebook, and YouTube, companies can reach millions of users.TikTok, for example, has an estimated 1 billion monthly active users (wallaroomedia). The company Kindred Studios helps direct-to-consumer companies create consistent, beautiful content that holds viewers’ attention and generates sales. They showcase your products’ fine details and selling points with product videos, mood photography, stop motion videos, texture photography, and many other content categories. In this episode, we talk to Daniel Snow, Co-Founder of Kindred Studios, as well as The Snow Agency. He specializes in the eCommerce space and joins us to discuss social media and content creation. Sponsorship inquiries: [email protected]

Ryan Noon is the CEO of Material Security. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

The term “boilerplate code” refers to code sections that are repeated across many projects with little to no variation. Every developer is familiar with boilerplate code, whether it be pom.xml files in Java or setting up React.js applications, tweaking boilerplate code for every project is inevitable. Actually, the company Wasp believes writing boilerplate code doesn’t have to be a part of web app development. Wasp is an open-source, declarative DSL for developers who want modern frontend, backend, and deployment experiences without writing boilerplate code. With Wasp, you can describe high-level features with Wasp DSL and write the rest of your logic in React, Node.js, and Prisma. In this episode, we talk to Matija Sosic, CEO and Co-Founder at Wasp. Sponsorship inquiries: [email protected]

Kubernetes is an open-source container orchestration system. It makes managing container clusters possible as well as deploying code changes to these containers. Microservice architecture is widely used today in large part because of Kubernetes. However, using it can require a large time commitment due to its learning curve. The company Okteto empowers developers to innovate and deliver cloud-native applications faster than ever. Okteto CLI lets developers deploy realistic replicas of their stack on Kubernetes and updates it for continuous deployments. It also manages different code environments, self-service access, and container scaling automatically. In this episode, we talk with Ramiro Berreleza, Founder and CEO of Okteto, about managing Kubernetes clusters with Okteto. Sponsorship inquiries: [email protected]

Blockchain protocols like Bitcoin and Ethereum have changed the cyber world dramatically in the last decade. They’ve created communities of like-minded developers, generated new financial markets, and popularized “decentralization” in computer networks. However, they require large resources to operate which makes scaling difficult and transactions expensive. Hedera is a decentralized public network that takes the previous innovations a step further. The Hedera Consensus and Token service enables developers to make tokens and create publicly verifiable and scalable timestamps for any application at an incredibly fast speed, highest grade security, and extremely low bandwidth consumption. In this episode, we talk to Leemon Baird, Founder and Chief Scientist at Hedera Hashgraph. We discuss proof-of-stake public networks, the hashgraph consensus, and the future of blockchains. Sponsorship inquiries: [email protected]

Enterprise data warehouses store all company data in a single place to be accessed, queried, and analyzed. They’re essential for business operations because they support managing data from multiple sources, providing context, and have built-in analytics tools. While keeping a single source of truth is important, easily moving data from the warehouse to other applications is invaluable. The company Hightouch provides tools that easily move data from your warehouse to important business tools like Salesforce, Apache Airflow, Tableau and more. Hightouch uses SQL to move and transform your data and tracks every row to avoid moving data that hasn’t changed. Failed rows are retried, and all changes to rows are logged. In this episode, we talk to Tejas Manohar, Founder of Hightouch. We talk about reverse ETL, managing data across multiple systems, and how Hightouch helps companies operationalize their data warehouse. Sponsorship inquiries: [email protected]

In this episode we discuss venture capital and more with Preface Ventures Founder and General Partner Farooq Abbasi. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

In today’s containerized world, it’s common to encounter similar issues with known solutions across multiple pods. For most people there are 2 solutions: go pod-by-pod finding and fixing the problem, or do that while also spending months trying to automate that process. This is significant time and manual labor. The company Shoreline orchestrates real-time debugging and automated repair across fleets. Shoreline makes it easy to define metrics, alarms, actions, and bots from the CLI that take action like draining and terminating nodes tagged for retirement or finding TLS certificates that are close to expiring. For unknown issues, Shoreline lets you debug across every pod from a single CLI rather than SSHing pod-by-pod, like running a command to grep for errors. In this episode, we talk with Anurag Gupta, Founder and CEO of Shoreline. Full disclosure: Shoreline is a sponsor of Software Engineering Daily. Sponsorship inquiries: [email protected]

Prophecy enables all your teams on Apache Spark with a unique low-code designer. While you visually build your Dataflows - Prophecy generates high-quality Spark code on Git. Then, you can schedule Spark workflows with Prophecy’s low-code Airflow. Not only that, Prophecy provides end-to-end visibility into your dataflows with Metadata Search and Column Level Lineage. For Enterprises, in addition to developing new workflows, data teams also need to migrate thousands of old proprietary ETL workflows to the Cloud. For that, Prophecy has built a Transpiler that automatically converts AbInitio, Informatica, SSIS and Alteryx workflows to high-quality Spark code. Learn more at www.prophecy.io. In this episode, we speak with Raj Bains, who is the founder & CEO of Prophecy. Previously, Raj was the product manager of Apache Hive at Hortonworks through the IPO. He also headed product management and marketing for a NewSQL database startup. Raj continues to actively code in compiler and database technologies. His engineering roles include developing a NewSQL database, building CUDA at NVIDIA as a founding engineer, and working as a compiler engineer for Microsoft Visual Studio. Full disclosure: Prophecy is a sponsor of Software Engineering Daily. Sponsorship inquiries: [email protected]

In the previous episode, Pulsar Revisited, we discussed how the company DataStax has added to their product stack Astra Streaming, their cloud-native messaging and event streaming service that’s built on top of Apache Pulsar. We discussed Apache Pulsar and the added features DataStax offers like injecting machine learning into your data streams and viewing real-time analytics. In today’s episode we’re going to continue this conversation with Enrico Olivelli, a Senior software engineer at DataStax and an ASF Member with The Apache Software Foundation. Apache Pulsar has released a number of exciting upgrades and enhancements in their recent 2.8.0 release. How will these changes affect Astra Streaming and what can users look forward to in future Astra Streaming releases? Sponsorship inquiries: [email protected]

Apache Pulsar is a cloud-native, distributed messaging and streaming platform originally created at Yahoo! and now a top-level Apache Software Foundation project (pulsar.apache.org). Pulsar is used by many large companies like Yahoo!, Verizon media, Tencent, and Splunk. The company DataStax, an open, multi-cloud stack for modern data apps, has added to their product stack Astra Streaming Beta, their cloud native messaging and event streaming service that’s built on top of Apache Pulsar. Astra Streaming provides tools for streaming, queueing, and stream processing as a natural complement to their other services like Astra DB. You can integrate high quality video services with added features like injecting machine learning and viewing real-time analytics. In this episode we talk with Jonathan Ellis, CTO and co-founder at DataStax. Sponsorship inquiries: [email protected]

If you’ve ever googled a CS or programming question, you likely found an answer (or many) on Stack Overflow. Founded in 2008 and named after a common computing error, Stack Overflow empowers the world to develop technology through collective knowledge. More than 100 million people visit Stack Overflow every month making it one of the 50 most-visited websites in the world. Stack Overflow’s products include its market-leading knowledge sharing and collaboration platform, Stack Overflow for Teams, in addition to Stack Overflow Reach & Relevance, which is focused on advertising. Stack Overflow for Teams is a knowledge sharing and collaboration solution that developers and managers already know and trust. It’s for companies who need to increase productivity, decrease cycle times, accelerate time to market, and protect institutional knowledge. In this episode we talk with Tom Limoncelli, a manager at Stack Overflow, author, and tech advocate. Full disclosure: Stack Overflow is a sponsor of Software Engineering Daily. Sponsorship inquiries: [email protected]

In 2003, Google developed a robust cluster management system called Borg. This enabled them to manage clusters with tens of thousands of machines, moving them away from virtual machines and firmly into container management. Then, in 2014, they open sourced a version of Borg called Kubernetes, or K8s. Now, in 2021, CockroachDB is a distributed database designed with Kubernetes architecture in mind. CockroachDB uses regular SQL and scales by automatically distributing data and workload demands. Their databases survive machine, datacenter, and region failures, and provide guaranteed ACID compliant transactions. In this episode, we talk to Spencer Kimball, CEO at Cockroach Labs, about distributed databases and containerization. Full disclosure: Cockroach Labs is a sponsor of Software Engineering Daily. Sponsorship inquiries: [email protected]

Governments, consumers, and companies across the world are becoming more aware and attentive to the risks and causes of climate change. From recycling to using solar power, people are looking for ways to reduce their carbon footprint. Markets like the financial sector, governments, and consulting are looking for ways to understand climate data to make smart decisions and manage risk. The company Sust Global was founded as a way to deliver sustainable change and climate resilient action. Sust Global uses an AI-powered platform that combines climate science, satellite-derived data, and geospatial data sets to quantify climate change. Companies can use this analysis to evaluate risk to assets, better understand future commodities like metal, and plan for future supply chain challenges and climate perils. In this episode we talk to Josh Gilbert, CEO at Sust Global. Josh explains Sust Global’s mission and product, and discusses how companies use Sust Global to prepare and respond to climate change. Sponsorship inquiries: [email protected]

Big data analytics is the process of collecting data, processing and cleaning it, then analyzing it with techniques like data mining, predictive analytics, and deep learning. This process requires a suite of tools to operate efficiently. Data analytics can save companies money, drive product development, and give insight into the market and customers. The company Imply provides the necessary tools for safe and efficient large scale analytic workloads. Their tools help minimize operational complexity so that deploying container clusters, or bare metal, or public and hybrid clouds is simple. Infra also monitors their performance, uptime, and scale. They also create fully interactive visualizations that update with real-time data, and plenty of other tools. In this episode, we talk with Jad Naous, VP of Engineering and Product at Imply, about big data analysis and real-world use cases. Sponsorship inquiries: [email protected]

Ashmeet Sidana is the founder of Engineering Capital.

DevOps has shortened the development life cycle for countless applications and is embraced by companies around the world. But managing and monitoring multiple environments is still a major pain point, particularly when companies need to mix cloud and legacy systems. Knowing when services go down and quickly pinpointing the cause is essential for continuous development. The company Better Stack provides services for DevOps teams. Their first service, Logtail, provides SQL-compatible structured log management. Query logs like you query a database. Their second service, Better Uptime, is an infrastructure monitoring platform that monitors uptime and, when issues occur, sends voice calls, SMS, and plenty other types of alerts with screenshots and error logs of the incident. Juraj Masar, Co-Founder and CEO at Better Stack, joins us to discuss DevOps and Better Stack. Sponsorship inquiries: [email protected]

Data science is an interdisciplinary field that combines strong technical skills with industry knowledge to perform a large range of jobs. Data scientists solve business questions with hands-on work cleaning and analyzing data, building machine learning models and applying algorithms, and generating dynamic visuals and tools to understand the world from the data it generates. Amazon Web Services provides tools for storing data, moving it, analyzing it, and executing algorithms and models on it. In this episode we talk to Chris Fregly, author of the book Data Science on AWS. Chris works at AWS full time on AI and machine learning projects, and joins us to discuss his book and data science more broadly. What does it take to become a data scientist, who’s his book for, and what are the latest advancements in the field? Sponsorship inquiries: [email protected]

In this episode we discuss the new Move Fast book, as well as many aspects of the current state of software engineering. Daliana Liu interviews Jeff Meyerson, host of Software Daily and author of Move Fast. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

Big Data has exploded the past decade as cloud computing and more efficient hardware made scaling essentially limitless. Products like Uber revolve entirely around analyzing data to provide rides. According to an EMC/IDC study, there was approximately 5.2TB of data for every person in 2020. That estimate was made before the transition to remote work, which likely makes it much higher. The term “data lineage” refers to the collection, origin, storage, transfer, and use of data over time. Given the size of the Big Data industry and related industries, maintaining a thorough data lineage, even within small companies, can be very difficult. It becomes especially challenging at scale. What innovative tools make understanding all this information possible? Can data really continue growing at this rate? In this episode we talk with Julien Le Dem, CTO and Co-Founder at Datakin. We discuss the challenges, available tools, and future for big data and data lineage. Sponsorship inquiries: [email protected]

Here is the full audiobook for "Move Fast: How Facebook Builds Software". Continue listening to the end to hear my most recent album "Simulation".

We talk to a lot of exciting startups from all over the world about their tech products. Recently we’ve heard from people innovating in the blockchain space, cloud infrastructure, databases, and automation tools. However, in today’s episode, we’re going to talk about how these tech startups get investments to build their great products in the first place. When do teams begin seeking investments? How do they show the promise of their products? Today we’re talking with Sarah Guo, a Venture Capitalist and General Partner at Greylock. Greylock invests in market defining founders, like the teams at Airbnb, AppDynamics, Cloudera, Docker, Okta, and Dropbox. Sarah brings a lot of valuable experience in identifying companies with potential and we’re very excited to welcome her to today’s episode. Sponsorship inquiries: [email protected]

The company Dynatrace provides intelligent observability, continuous automation, and causation-based AI to help Cloud Ops, DevOps, and SRE teams transform faster, innovate more, and deliver better business outcomes. They offer application performance monitoring, infrastructure monitoring, cloud automation, application security, and much more. While being an industry leader in simplifying complex cloud applications, Dynatrace is continuously innovating and bringing a wide array of solutions to the market. Who is Dynatrace for and what can it really do for software development and DevOps teams? In this episode we’d like to get to know Dynatrace better with their VP, Chief Technical Strategist and Head of Innovation Lab, Aloïs Reitbauer. Aloïs drives product innovation at Dynatrace and knows more about their products than most. We discuss the use cases and benefits of Dynatrace as well as its involvement with open source projects. Sponsorship inquiries: [email protected]

In this episode we discuss coding bootcamps, fear, fitness, and more with Ruben Harris, CEO of Career Karma. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

When I left Amazon, it was not out of resentment or dissatisfaction. It was out of education. At Amazon, one can learn how to build Amazon. Amazon was not built through master planning, but through incremental, adjacent expansion. Once you see how to expand from a book store to the backbone of the Internet, you see how to expand from anything to everything. And so I started a podcast. We are hiring for Software Daily and for a new company, Supercompute. If you are interested in working with us, send me an email: [email protected]

SOC 2 is a security audit to prove that SaaS companies have secured their company and customer data. It’s often considered the minimum audit necessary to sell software. HIPAA is a federal law regulating how sensitive medical information about patients must be handled. ISO 27001 is the global benchmark for demonstrating your information security management system. What do these things have in common? They are all security standards that companies need to maintain and renew to be trustworthy to customers. They also take intense preparation with months of work, and hundreds of screenshots to prove compliance with auditors. The company Vanta provides automation tools to monitor your applications and maintain compliance. Fix items on your Vanta to-do list, and when you’re ready a Vanta-trained CPA will perform an audit with you. In this episode we talk with Christina Cacioppo, CEO at Vanta. We discuss the accreditation process and security needs for various companies and how Vanta is keeping companies in compliance. Sponsorship inquiries: [email protected]

There are over 4 billion people using email. Many people using email for business communicate quick questions to colleagues, send repetitive, template-based information to potential customers and freshly hired employees, and repeat a lot of the same phrases. We actually repeat phrases in a lot of written formats. How often do you copy and paste the same thing to multiple people? The company Text Blaze is making the workday a little faster, more productive, and convenient with their shortcut-to-snippet software product. With Text Blaze you can save any snippet of text or template, including templates that need fill-in-the-blank sections, to a keyboard shortcut. Then type that shortcut in Gmail, Google Docs, LinkedIn, or Salesforce, and wherever else you need to use your saved snippet. In this episode we talk to Scott Fortmann-Roe, CTO at Text Blaze. Sponsorship inquiries: [email protected]

Continuous integration is a coding practice where engineers deliver incremental and frequent code changes to create higher quality software and collaborate more. Teams attempting to continuously integrate new code need a consistent and automated pipeline for reviewing, testing, and deploying the changes. Otherwise change requests pile up in the queue and nothing gets integrated efficiently. The company LayerCI is a platform built to deliver a better remote infrastructure experience. It enables engineers to preview full stack staging environments for every commit and have a centralized CI/CD stack with full end-to-end testing. LayerCI can duplicate a fully provisioned environment so that end-to-end workflows can run in parallel and alongside unit tests. The result is faster code review, testing and deployment. Sponsorship inquiries: [email protected]

ELT is a process for copying data from a source system into a target system. It stands for “Extract, Load, Transform” and starts with extracting a copy of data from the source location. It’s loaded into the target system like a data warehouse, and then it’s ready to be transformed into a usable format for things like modern cloud applications. The company Meltano provides code that manages ELT pipelines through an open-source, self-hosted, CLI-first, debuggable, and extensible process. Meltano projects manage your Singer tap and target configurations to easily select which entities and attributes to extract. These pipelines track their own incremental replication state so they can pick up where the previous run left off. Once your raw data is in its target source, Meltano helps you transform it into a usable format. These pipelines can run on a schedule and be fed to supported orchestrators like Apache Airflow. In this episode we talk to Douwe Maan, founder and CEO of Meltano, about their product-market fit and delivery plans. Sponsorship inquiries: [email protected]

In this episode we discuss plug and play auth, password management, and crypto with Sean Li, co-founder and CEO of Magic. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

For some data problems, you may be more concerned with the state of data at a particular point. A ticket is booked, or it’s not. How many poetry submissions were made to the contest? This is relational data. For other problems, you’re concerned with the change in data over time. Solar energy consumption, for example, or price behavior. This is time-series data. TimescaleDB resembles a traditional postgreSQL database, but is supercharged for time-series data. TimescaleDB has queries that are 10x faster, is optimized for time-series and advanced time-series analytics, has automated continuous aggregations, columnar storage, and uses best-in-class algorithms and memory efficient structures to compress your data so you can store more at a much cheaper price. And for your questions that are not time-series dependent, TimescaleDB is still an efficient and cost effective relational database. In this episode we talk to Mike Freedman, Co-Founder and CTO of TimescaleDB. Sponsorship inquiries: [email protected]

The cloud has delivered amazing benefits like on-demand infrastructure that’s easy to use, pay-as-you-go subscription plans, and effortless scaling of applications. This flexibility minimizes the growing pains for businesses and explains why today’s startups and established companies are both building apps on the cloud. However, the costs of using the cloud stack up once companies reach large scale. Dropbox, for example, shifted away from the cloud in 2016 to opt for a custom built infrastructure in co-location facilities. They saved $75 million over 2 years and increased their gross margins from 33% to 67% due to this change. Actually, recent research suggests major companies spend 75%-80% of cost of revenue on their cloud bills. Should large companies shift away from the cloud like Dropbox did? Is it too late for some companies to untangle themselves from it? In this episode we talk with Martin Casado, Partner at Andreessen Horowitz and an expert in IT Infrastructure. We discuss the costs of cloud for small and large companies, and the financial implications of cloud infrastructure at scale. Show NotesMartin Casado's article on cloud costs Sponsorship inquiries: [email protected]

Uber is one of many examples we’ve discussed on this show that has changed the world with big data analysis. With over 8 million users, 1 billion Uber trips and people driving for Uber in over 400 cities and 66 countries, Uber has redefined an entire industry in a very short time frame. It’s difficult to find precise details about Uber’s big data infrastructure online, but we know they collect every possible data point about their drivers and riders. Matching riders and drivers, setting ride fares, predicting demand for cars - these are some examples of what Uber does with its data. In this episode we talk with Kevin Novak about Uber’s data science. What are some key details about their data infrastructure? What can people expect in the future from their data methodologies? How did a tech conference in Paris turn into one of the fastest growing, highest valued startups in the world? Sponsorship inquiries: [email protected]

The quantity and quality of a company’s data can mean the difference between a major success or major failure. Companies like Google have used big data from its earliest days to steer their product suite in the direction consumers need. Other companies, like Apple, didn’t always use big data analytics to drive product design, but they do now. The company Axiom has created a large suite of advanced browser robots that perform difficult tasks like consolidating data across many web applications, extracting data from public sites or from behind logins, data entry, user interface automation, file management and spreadsheet automation. These powerful tools enable people and businesses to collect valuable data to inform their decisions. In this episode we talk to Yaseer Sheriff, Co-Founder and CEO at Axiom. We discuss the value of big data, the opportunities their products enable, and how people can use their tools to improve their data collection practices. Sponsorship inquiries: [email protected]

In this episode we discuss software investing, business, and the future with David Rosenthal, co-host of the Acquired podcast. This interview was also recorded as our very first video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: [email protected]

Complete information games are games where every player has information about the game sequence, strategies, and payoffs throughout gameplay. Playing chess, for example, relies on knowing the location of every piece everywhere on the board. In an incomplete information game like Minecraft, you continually gain new information during gameplay. Until very recently, incomplete information was nearly impossible on blockchains because every transaction and party is public. However, applied zero-knowledge cryptography on Ethereum has advanced greatly the past 18 months and is changing the transparency of blockchains. In this episode we talk to Brian Gu, a creator of the new game Dark Forest. Dark Forest is a space-conquest game built on Ethereum where players discover and conquer planets in an infinite, procedurally-generated, cryptographically-specified universe. It uses zero-knowledge proofs to validate game moves on Ethereum without sharing information to other players about the moves. We discuss the technology behind Dark Forest and the possibilities of a potentially less transparent blockchain future. Sponsorship inquiries: [email protected]

Proof of Work cryptocurrency mining, as used on the Ethereum and Bitcoin blockchains, requires huge amounts of energy to validate transactions and generate new tokens. The alternative, Proof of Stake, needs large deposits of assets to be staked up front in order to work. While both consensus protocols have their own drawbacks, they are the current industry standards. The company Spacemesh developed a new consensus protocol with the goal of powering an energy-efficient, decentralized, secure, and scalable smart contracts global computer and a cryptocurrency in the permissionless settings. They call their protocol Proof of Space Time which works on a blockmesh structure rather than a blockchain. The Spacemesh protocol allows newcomers to contribute to the security of the cryptocurrency network via unused storage space on their hard drives, driving down energy consumption and enabling anyone with a computer to contribute. In this episode we talk to Anton Learner, Core Team Lead at Spacemesh. Sponsorship inquiries: [email protected]

The company StreamSets is enabling DataOps practices in today’s enterprises. StreamSets is a data engineering platform designed to help engineers design, deploy, and operate smart data pipelines. StreamSets Data Collector is a codeless solution for designing pipelines, triggering CDC operations, and monitoring data in flight. StreamSets Transformer uses Apache Spark to generate insights about your data across multiple different platforms. Their Control Hub is the single hub for managing all of your data pipelines, data processing jobs, and execution engines. In this episode we talk to Arvind Prabhakar, CTO at StreamSets. Arvind is also an Official Member of the Forbes Technology Council, and a Member, PMC Chair/Member, Committer, Mentor, and Contributor to multiple projects with the Apache Software Foundation. He was previously a Director of Engineering at Cloudera, and a Software Architect at Informatica before that. Sponsorship inquiries: [email protected]

Delivering Saas products involves a lot more than just building the product. Saas management involves customer relationship management, licensing, renewals, maintaining software visibility, and the general management of the technology portfolio. The company Blissfully helps businesses manage their SaaS products from within a complete IT platform with organization, automation, and security built in. The Blissfully platform offers a system of record for creating and maintaining a single source of truth for technology, a workflows and automations feature for defining and executing consistent IT processes, an IT collaboration feature, and a security and compliance feature. These features come together to form a comprehensive IT management platform. In this episode we talk with Aaron White, a Founder and CTO at Blissfully. Aaron was previously a Co-Founder and Board Member of Price Intelligently, and Vice President at Venrock before that. Sponsorship inquiries: [email protected]

Amundsen was started at Lyft and is the leading open-source data catalog with the fastest-growing community and the most integrations. Amundsen enables you to search your entire organization by text search, see automated and curated metadata, share context with co workers, and learn from others by seeing most common queries on a table or frequently used data. Powered by Amundsen, the company Stemma is a fully managed data catalog that bridges the gap between data producers and data consumers. Stemma adds features to Amundsen like showing meaningful data to individual users, adding metadata to data automatically, and documenting data on the fly. Stemma integrates with all the major data sources like Snowflake, Redshift, Google BigQuery, and Apache Airflow. In this episode we talk to Mark Grover, Founder at Stemma. Mark co-created Amundsen and authored the book Hadoop Application Architectures. He was an engineer at Cloudera before joining Lyft as a Product Manager. Sponsorship inquiries: [email protected]

Coinbase is a very popular and well trusted cryptocurrency platform for buying and selling digital assets like Bitcoin, Ethereum, and many more. With Coinbase you can manage your portfolio of cryptocurrencies in 1 place like you would for other investments. There are added features like scheduling recurring purchases of assets, time-delayed withdrawals from digital vaults, and mobile apps with sleek UIs for mobile access to the markets. Coinbase has gained trust as a platform for storing digital assets in secure offline storage, using servers covered by insurance policies, by following industry best practices and supporting a variety of the most popular digital currencies. In this episode we talk to Brent Walter, a Senior Engineering Manager at Coinbase. Brent was previously an Advisor at With Labs and various other companies, and was a Director of Software Engineering at Western Digital before that. Sponsorship inquiries: [email protected]