Practical AI

Daniel and Chris do a deep dive into The AI Index 2019 Annual Report, which provides unbiased rigorously-vetted data that one can use “to develop intuitions about the complex field of AI”. Analyzing everything from R&D and technical advancements to education, the economy, and societal considerations, Chris and Daniel lay out this comprehensive report’s key insights about artificial intelligence.Sponsors:DigitalOcean – DigitalOcean’s developer cloud makes it simple to launch in the cloud and scale up as you grow. They have an intuitive control panel, predictable pricing, team accounts, worldwide availability with a 99.99% uptime SLA, and 24/7/365 world-class support to back that up. Get your $100 credit at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:The AI Index 2019 Annual ReportStanford Institute for Human-Centered Artificial IntelligenceUpcoming Events: Register for upcoming webinars here!

Production ML systems include more than just the model. In these complicated systems, how do you ensure quality over time, especially when you are constantly updating your infrastructure, data and models? Tania Allard joins us to discuss the ins and outs of testing ML systems. Among other things, she presents a simple formula that helps you score your progress towards a robust system and identify problem areas.Featuring:Tania Allard – Website, GitHub, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:“What’s your ML score” talk“Jupyter Notebooks: Friends or Foes?” talkJoel Grus’s episode: “AI code that facilitates good science”PapermillnbdevnbvalBooks“DevOps For Dummies” by Emily FreemanUpcoming Events: Register for upcoming webinars here!

One of the things people most associate with AI is automation, but how is AI actually shaping automation in manufacturing? Costas Boulis from Bright Machines joins us to talk about how they are using AI in various manufacturing processes and in their “microfactories.” He also discusses the unique challenges of developing AI models based on manufacturing data.Sponsors:Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2019. Start your server - head to linode.com/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Costas Boulis – GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Bright MachinesBright Machines’ MicrofactoriesDigital twinsOther relevant Practical AI episodes: Deep Reinforcement LearningRobot hands solving Rubik’s cubesUpcoming Events: Register for upcoming webinars here!

Chris and Daniel talk with Greg Allen, Chief of Strategy and Communications at the U.S. Department of Defense (DoD) Joint Artificial Intelligence Center (JAIC). The mission of the JAIC is “to seize upon the transformative potential of artificial intelligence technology for the benefit of America’s national security… The JAIC is the official focal point of the DoD AI Strategy.” So if you want to understand how the U.S. military thinks about artificial intelligence, then this is the episode for you!Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Greg Allen – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:U.S. Department of Defense Joint Artificial Intelligence CenterSummary of the 2018 Department of Defense Artificial Intelligence StrategyFact Sheet: 2018 DoD Artificial Intelligence StrategyWhite House AI WebsitePractical AI – Episode #47 - GANs, RL, and transfer learning oh my!AlphaGoDefense Advanced Research Projects Agency - DARPAIntelligence Advanced Research Projects Activity - IARPALaw of WarUpcoming Events: Register for upcoming webinars here!

Wow, 2019 was an amazing year for AI! In this fully connected episode, Chris and Daniel discuss their list of top 5 notable AI things from 2019. They also discuss the “state of AI” at the end of 2019, and they make some predictions for 2020.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Google search and BERTBetter Language Models and Their ImplicationsWrite with TransformerHugging Face TransformersHugging Face receives 15M in fundingSolving Rubik’s Cube with a Robot HandTraining a single AI model can emit as much carbon as five cars in their lifetimesOther relevant Practical AI episodes:Robot hands and Rubik’s cubesBERT: one NLP model to rule them all OpenAI’s new “dangerous” GPT-2 language modelSocial AI with Hugging FaceUpcoming Events: Register for upcoming webinars here!

We have all used web and product search technologies for quite some time, but how do they actually work and how is AI impacting search? Andrew Stanton from Etsy joins us to dive into AI-based search methods and to talk about neuroevolution. He also gives us an introduction to Rust for production ML/AI and explains how that community is developing.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Andrew Stanton – GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Yahoo learning to rank challengeNEAT approach to neuroevolutionOpenAI evolutionary strategies for AtariRustPyO3, Rust binding for the Python interpreterBuzzsaw: A System for High Speed Feature EngineeringLinkedIn at KDDUpcoming Events: Register for upcoming webinars here!

Evan Sparks, from Determined AI, helps us understand why many are still stuck in the “dark ages” of AI infrastructure. He then discusses how we can build better systems by leveraging things like fault tolerant training and AutoML. Finally, Evan explains his optimistic outlook on AI’s economic and environmental health impact.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. Featuring:Evan Sparks – Website, GitHub, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Determined AIPrevious episode on Alpha pilotBlog post - AI Leadership And The Positive Impacts On Economy, Privacy, Environmental HealthBlog post - Announcing the future of AI infrastructureApache SparkMLlibAntique Candle Co.Joel Grus on AI code that facilitates good scienceUpcoming Events: Register for upcoming webinars here!

SpaCy is awesome for NLP! It’s easy to use, has widespread adoption, is open source, and integrates the latest language models. Ines Montani and Matthew Honnibal (core developers of spaCy and co-founders of Explosion) join us to discuss the history of the project, its capabilities, and the latest trends in NLP. We also dig into the practicalities of taking NLP workflows to production. You don’t want to miss this episode!Featuring:Ines Montani – GitHub, XMatthew Honnibal – GitHub, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:SpaCyAdvanced NLP with SpaCy courseThincExplosion AIProdigyFast.aiMachine learning yearningUpcoming Events: Register for upcoming webinars here!

GANs are at the center of AI hype. However, they are also starting to be extremely practical and be used to develop solutions to real problems. Jakub Langr and Vladimir Bok join us for a deep dive into GANs and their application. We discuss the basics of GANs, their various flavors, and open research problems.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Jakub Langr – Website, GitHub, LinkedIn, XVladimir Bok – Website, GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Ian Goodfellow NeurIPS paper 2014GAN TTSBooks“GANs in Action” by Jakub Langr and Vladimir BokUpcoming Events: Register for upcoming webinars here!

Streamlit recently burst onto the scene with their intuitive, open source solution for building custom ML/AI tools. It allows data scientists and ML engineers to rapidly build internal or external UIs without spending time on frontend development. In this episode, Adrien Treuille joins us to discuss ML/AI app development in general and Streamlit. We talk about the practicalities of working with Streamlit along with its seemingly instant adoption by AI2, Stripe, Stitch Fix, Uber, and Twitter.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. AI Demystified (FREE five-day mini-course) – Get an introduction to the most important concepts, types, and business applications for AI and Machine Learning. This course is 100% free. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Adrien Treuille – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Eterna GameStreamlitStreamlit articlesAwesome StreamlitR ShinyUpcoming Events: Register for upcoming webinars here!

There’s a lot of hype about knowledge graphs and AI-methods for building or using them, but what exactly is a knowledge graph? How is it different from a database or other data store? How can I build my own knowledge graph? James Fletcher from Grakn Labs helps us understand knowledge graphs in general and some practical steps towards creating your own. He also discusses graph neural networks and the future of graph-augmented methods.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. AI Demystified (FREE five-day mini-course) – Get an introduction to the most important concepts, types, and business applications for AI and Machine Learning. This course is 100% free. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:James Fletcher – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Grakn LabsGraphSAGEPrologueGraph Nets (TensorFlow)Grakn KGLIBGrakn example projects and tutorialsGrakn BlogUpcoming Events: Register for upcoming webinars here!

Everyone is talking about it. OpenAI trained a pair of neural nets that enable a robot hand to solve a Rubik’s cube. That is super dope! The results have also generated a lot of commentary and controversy, mainly related to the way in which the results were represented on OpenAI’s blog. We dig into all of this in on today’s Fully Connected episode, and we point you to a few places where you can learn more about reinforcement learning.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. AI Demystified (FREE five-day mini-course) – Get an introduction to the most important concepts, types, and business applications for AI and Machine Learning. This course is 100% free. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:OpenAI’s result of solving a Rubik’s Cube with a robotic hand: Blog postPaperExample push back on TwitterLearning resources:OpenAI Gym TutorialPyTorch RL TutorialTensorflow RL TutorialsUpcoming Events: Register for upcoming webinars here!

What’s the most practical of practical AI things? Data labeling of course! It’s also one of the most time consuming and error prone processes that we deal with in AI development. Michael Malyuk of Heartex and Label Studio joins us to discuss various data labeling challenges and open source tooling to help us overcome those challenges.Sponsors:DigitalOcean Managed Kubernetes – DigitalOcean makes it super simple to launch a Kubernetes cluster in minutes. Developers can now run and scale container-based workloads with ease on the DigitalOcean platform. Learn more and get started for free with a $50 credit at do.co/changelogKubeCon + CloudNativeCon (Amsterdam 2020) – Get an additional 10% off EARLYBIRD registration pricing with the code KCEUGOTIME — ends November 8th! Learn more and register. AI Demystified (FREE five-day mini-course) – Get an introduction to the most important concepts, types, and business applications for AI and Machine Learning. This course is 100% free. Featuring:Michael Malyuk – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:HeartexLabel StudioBooks“Paradigms of Artificial Intelligence Programming” by Peter NorvigUpcoming Events: Register for upcoming webinars here!

Times series data is everywhere! I mean, seriously, try to think of some data that isn’t a time series. You have stock prices and weather data, which are the classics, but you also have a time series of images on your phone, time series log data coming off of your servers, and much more. In this episode, Anais from InfluxData helps us understand the range of methods and problems related to time series data. She also gives her perspective on when statistical methods might perform better than neural nets or at least be a more reasonable choice.Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. KubeCon + CloudNativeCon (San Diego) – The Cloud Native Computing Foundation’s flagship Kubernetes community conference which gathers adopters and technologists from leading open source and cloud native communities. Learn more and register — get 10% off with the code KCNAPRACTICALAI19 Feel free to use the Convince Your Boss letter in part or in full so you can your team can attend. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Anais Dotis-Georgiou – XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:InfluxDataInfluxDBM-Competition benchmarksUpcoming Events: Register for upcoming webinars here!

We’ve mentioned ML/AI in the browser and in JS a bunch on this show, but we haven’t done a deep dive on the subject… until now! Victor Dibia helps us understand why people are interested in porting models to the browser and how people are using the functionality. We discuss TensorFlow.js and some applications built using TensorFlow.jsSponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. Changelog Weekly – We track, log, and contextualize what’s happening in software throughout the week and deliver it directly to your inbox on Sunday mornings. Head to changelog.com/weekly to browse the archives, subscribe, and push the easy button on your continuing education. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Featuring:Victor Dibia – Website, GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:data2visTJbotTensorFlow.jsHandtrack.jsConvNet PlaygroundJS PartyUpcoming Events: Register for upcoming webinars here!

The United States has blacklisted several Chinese AI companies working in facial recognition and surveillance. Why? What are these companies doing exactly, and how does this fit into the international politics of AI? We dig into these questions and attempt to do some live fact finding in this episode.Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:1 million ethnic Uyghurs in China have been held in “re-education camps”Surge in Chinese research related to surveillance of Muslim minoritiesUS AI Blacklist summary article from MIT Technology ReviewHikvision Their websiteHere’s what you need to know about Hikvision, the camera maker behind China’s mass surveillance systemChina’s Hikvision Has Probably Filmed YouiFlytek Their websiteWhy 500 Million People in China Are Talking to This AIMegvii Their websiteBehind the Rise of China’s Facial-Recognition GiantsMegvii, the Chinese startup unicorn known for facial recognition tech, files to go public in Hong KongYitu Their websiteAI Startup Yitu Seeks IPO on China’s New Tech BoardThis Chinese facial recognition start-up can identify a person in secondsLearning resources:TensorFlow 2.0 notebookUpcoming Events: Register for upcoming webinars here!

Chris and Daniel talk with Keith Lynn, AlphaPilot Program Manager at Lockheed Martin. AlphaPilot is an open innovation challenge, developing artificial intelligence for high-speed racing drones, created through a partnership between Lockheed Martin and The Drone Racing League (DRL).AlphaPilot challenged university teams from around the world to design AI capable of flying a drone without any human intervention or navigational pre-programming. Autonomous drones will race head-to-head through complex, three-dimensional tracks in DRL’s new Artificial Intelligence Robotic Racing (AIRR) Circuit. The winning team could win up to $2 million in prizes.Keith shares the incredible story of how AlphaPilot got started, just prior to its debut race in Orlando, which will be broadcast on NBC Sports.Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Keith Lynn – LinkedInChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:AlphaPilotAlphaPilot – Lockheed Martin AI Drone Racing Innovation ChallengeLockheed Martin and Drone Racing League Announce 2019 AlphaPilot TeamsLook ma, no hands: UCF arena to host fast-flying, autonomous drone racing in OctoberLockheed MartinLockheed Martin - WikipediaThe Drone Racing LeagueThe Drone Racing League - WikipediaLockheed Martin - TwitterThe Drone Racing League - TwitterNVIDIA - TwitterUpcoming Events: Register for upcoming webinars here!

Chris and Daniel take some time to cover recent trends in AI and some noteworthy publications. In particular, they discuss the increasing AI momentum in the majority world (Africa, Asia, South and Central America and the Caribbean), and they dig into Hugging Face’s recent model distillation results.Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. All Things Open – Exploring open source, open tech, and the open web in the enterprise. Raleigh, NC — October 13-15, 2019 The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:AI in the majority world:NeurIPS publications by country“Best” universities according to the Times Higher EducationICLR in EthiopiaGoogle AI offices: BangaloreGhanaBeijingDeep Learning IndabaSoutheast Asia Machine Learning SchoolFacebook’s AI for India summitAI SingaporeIndonesia AI research centerArtificial intelligence probes dark matter in the universeDistilBERT from Hugging FaceThree People-Centered Design Principles for Deep LearningPapers with codeUpcoming Events: Register for upcoming webinars here!

The All Things Open conference is happening soon, and we snagged one of their speakers to discuss open source and AI. Samuel Taylor talks about the essential role that open source is playing in AI development and research, and he gives us some tips on choosing AI-related side projects.Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. All Things Open – Exploring open source, open tech, and the open web in the enterprise. Raleigh, NC — October 13-15, 2019 Featuring:Samuel Taylor – Website, GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Tweet and mention @Changelog or @PracticalAIFM for a chance to win 1 of 5 free passes to the conference!“I want a free pass to @AllThingsOpen because…”All Things OpenSamuel’s All Things Open talk descriptionEpisode #17 - Fighting bias in hiringJupyterPandasScikit-learnUpcoming Events: Register for upcoming webinars here!

In this very special fully-connected episode of Practical AI, Daniel interviews Chris. They discuss High Performance Computing (HPC) and how it is colliding with the world of AI. Chris explains how HPC differs from cloud/on-prem infrastructure, and he highlights some of the challenges of an HPC-based AI strategy.Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:HPC course on UdacityGoogle ColabSIParCS internship at NCARUpcoming Events: Register for upcoming webinars here!

We’re talking with Sherol Chen, a machine learning developer, about AI at Google and AutoML methods. Sherol explains how the various AI groups within Google work together and how AutoML fits into that puzzle. She also explains how to get started with AutoML step-by-step (this is “practical” AI after all).Sponsors:DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog. Changelog Weekly – We track, log, and contextualize what’s happening in software throughout the week and deliver it directly to your inbox on Sunday mornings. Head to changelog.com/weekly to browse the archives, subscribe, and push the easy button on your continuing education. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Featuring:Sherol Chen – Website, GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Google cloudGoogle AITensorflowQuoc V. Le’s researchCloud AutoMLUpcoming Events: Register for upcoming webinars here!

David Yakobovitch joins the show to talk about the evolution of data science tools and techniques, the work he’s doing to teach these things at Galvanize, what his HumAIn Podcast is all about, and more.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:David Yakobovitch – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:GalvanizeHumAIn PodcastBooks“The Big Nine” by Amy WebbUpcoming Events: Register for upcoming webinars here!

Redis is a an open source, in-memory data structure store, widely used as a database, cache and message broker. It now also support tensor data types and deep learning models via the RedisAI module. Why did they build this module? Who is or should be using it? We discuss this and much more with Pieter Cailliau.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Pieter Cailliau – Website, GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:RedisRedis modulesRedisAIHangarHangar on GitHubUpcoming Events: Register for upcoming webinars here!

Chris and Daniel take the opportunity to catch up on some recent AI news. Among other things, they discuss the increasing impact of AI on studies of the ancient world and “good” uses of GANs. They also provide some more learning resources to help you level up your AI and machine learning game.Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:AI is impacting studies of the ancient world:Machine learning has been used to automatically translate long-lost languages:Machine learning is about to revolutionize the study of ancient games:Others studies: Deep Learning for Classical Japanese Literature:In Codice Ratio: Machine Transcription in the Vatican Secret Archive:Reading Medieval Manuscripts with Deep Learning Technology:The AI technique that could imbue machines with the ability to reasonA new way to use the AI behind deepfakes could improve cancer diagnosis:AIs are playing more games:DeepMind AI is secretly lurking on the public StarCraft II 1v1 ladderAn unbeatable poker bot offers glimpses of video game AI’s futureRelevant learning resources:NumPy implementations of a bunch of models (from scratch):Great new-ish NLP courses: Advanced NLP with spacy:New fast.ai course! A Code-First Introduction to NLP:Google Cloud - Deep Learning ContainersBooks“The Pragmatic Programmer” by David Thomas and Andrew Hunt“Data Science from Scratch” by Joel GrusUpcoming Events: Register for upcoming webinars here!

We’re talking with Joel Grus, author of Data Science from Scratch, 2nd Edition, senior research engineer at the Allen Institute for AI (AI2), and maintainer of AllenNLP. We discussed Joel’s book, which has become a personal favorite of the hosts, and why he decided to approach data science and AI “from scratch.” Joel also gives us a glimpse into AI2, an introduction to AllenNLP, and some tips for writing good research code. This episode is packed full of reproducible AI goodness!Sponsors:DigitalOcean – The simplest cloud platform for developers and teams Whether you’re running one virtual machine or ten thousand, makes managing your infrastructure too easy. Get started for free with a $50 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Joel Grus – XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Allen AIAllenNLPAllenNLP demo websiteWriting Code for NLP Research​I don’t like NotebooksJoel’s websiteAdversarial learning podcastBooks“Data Science from Scratch” by Joel GrusUpcoming Events: Register for upcoming webinars here!

Woo hoo! As we celebrate reaching episode 50, we come full circle to discuss the basics of neural networks. If you are just jumping into AI, then this is a great primer discussion with which to take that leap.Our commitment to making artificial intelligence practical, productive, and accessible to everyone has never been stronger, so we invite you to join us for the next 50 episodes!Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Learn more about neural networks with the following learning resources.Books“Deep Learning” by Ian Goodfellow, Yoshua Bengio, and Aaron Courville“Data Science from Scratch” by Joel GrusThere are literally too many others to name…Online Coursesfast.ai MOOCDeep Learning course by Google on Udacity (free)Practical Machine Learning with TensorFlow 2.0 Alpha (free Udacity course)deeplearning.ai Deep Learning SpecializationIntroduction to TensorFlow for Artificial Intelligence, Machine Learning, and Deep Learning (free Coursera course for TensorFlow 2)Intro to TensorFlow for Deep Learning by TensorFlow (free Udacity course for TensorFlow 2)WebsitesMicrosoft AI SchoolTensorFlow 2 DocsAmazon Machine Learning TrainingPyTorchFacebook AIGoogle AIUpcoming Events: Register for upcoming webinars here!

This week we bend reality to expose the deceptions of deepfake videos. We talk about what they are, why they are so dangerous, and what you can do to detect and resist their insidious influence. In a political environment rife with distrust, disinformation, and conspiracy theories, deepfakes are being weaponized and proliferated as the latest form of state-sponsored information warfare. Join us for an episode scarier than your favorite horror movie, because this AI bogeyman is real!Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Brain Science – For the curious! Brain Science is our new podcast exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human. It’s Brain Science applied — not just how does the brain work, but how do we apply what we know about the brain to transform our lives. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:The Dark Knight’s Tale (DeepFake)Official PyTorch Implementation of StarGAN - CVPR 2018Few-Shot Adversarial Learning of Realistic Neural Talking Head Models (YouTube)Few-Shot Adversarial Learning of Realistic Neural Talking Head Models (PDF)MelNet: A Generative Model for Audio in the Frequency DomainText-based Editing of Talking-head VideoBetter Language Models and Their Implications (GPT-2)Fake-porn videos are being weaponized to harass and humiliate women: ‘Everybody is a potential target’The National Security Challenges of Artificial Intelligence, Manipulated Media, and “Deepfakes” – 13 June 2019Student with access to TPU credits reproduced GPT2-1.5B and plan to release modelPapers With Code: fake+detectionIn Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye BlinkingA Retrospective Analysis of the Fake News Challenge Stance Detection TaskDeepfake debunking tool may protect presidential candidates. For now. SometimesThe Era of Fake Videos is HereS.3805 - Malicious Deep Fake Prohibition Act of 2018Practical AI episode #47 - GANs, RL, and transfer learning oh my!Synthetic Realities: Deep Learning for Detecting AudioVisual FakesMachine Learning for fake news detection: theory and practiceUpcoming Events: Register for upcoming webinars here!

Interpreting complicated models is a hot topic. How can we trust and manage AI models that we can’t explain? In this episode, Janis Klaise, a data scientist with Seldon, joins us to talk about model interpretation and Seldon’s new open source project called Alibi. Janis also gives some of his thoughts on production ML/AI and how Seldon addresses related problems.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Janis Klaise – GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:SeldonSeldon CoreAlibiBooks“The Foundation Series” by Isaac Asimov“Interpretable Machine Learning” by Christoph MolnarUpcoming Events: Register for upcoming webinars here!

Daniel and Chris explore three potentially confusing topics - generative adversarial networks (GANs), deep reinforcement learning (DRL), and transfer learning. Are these types of neural network architectures? Are they something different? How are they used? Well, If you have ever wondered how AI can be creative, wished you understood how robots get their smarts, or were impressed at how some AI practitioners conquer big challenges quickly, then this is your episode!Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:SUBSCRIBE ~> Brain Science — For the curious! We’re exploring the inner-workings of the human brain to understand behavior change, habit formation, mental health, and being human.RL (Reinforcement learning) Good overview articleHuman-level performance in Quake III–Capture the FlagPractical AI episode about Deep Reinforcement LearningPractical AI episode about OpenAI, reinforcement learning, robots, and safetyPyTorch RL tutorialGANs (Generative Adversarial Networks) Good overview articleThis is not a person websiteChristie’s AI art auctionOpenAI Generative modelsTensorFlow GAN tutorialTransfer learning Good overview articleForbes article on Google AutoMLPractical AI episode on BERTPractical AI episode on GPT-2How to build a State-of-the-Art Conversational AI with Transfer Learning -NAACL workshop on transfer learning for NLPUpcoming Events: Register for upcoming webinars here!

Andreas Madsen, a freelance ML/AI engineer and Distill.pub author, joins us to discuss his work visualizing neural networks and recurrent neural units. Andreas discusses various neural unites, RNNs in general, and the “why” of neural network visualization. He also gives us his perspective on ML/AI freelancing and moving from web development to AI research.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. strongDM – Manage access to any database, server, and environment. strongDM makes it easy for DevOps to enforce the controls InfoSec teams require. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Andreas Madsen – GitHub, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Distill.pub by AndreasTaylor approximation and other mathematics related to neural networksBooks“Programming Collective Intelligence” by Toby SegaranUpcoming Events: Register for upcoming webinars here!

Chris and Daniel take you on a tour of local and global AI events, and discuss how to get the most out of your experiences. From access to experts to developing new industry relationships, learn how to get your foot in the door and make connections that help you grow as an AI practitioner.Then drawing from their own wealth of experience as speakers, they dive into what it takes to give a memorable world-class talk that your audience will love. They break down how to select the topic, write the abstract, put the presentation together, and deliver the narrative with impact!Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. strongDM – Manage access to any database, server, and environment. strongDM makes it easy for DevOps to enforce the controls InfoSec teams require. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Local Meetups - Great for first steps, local help and relationship building, job connections, involvement in local projects, etc. Mostly free! PyDataTensorFlowPyTorchDeep Learningetc.Large industry conferences - Great to see what some of the larger companies and innovative startups are doing with AI, application and infra focused, etc. Expensive. O’Reilly AI, Strata Data, TensorFlow WorldQCon AI, QConSpark SummitMLConfApplied Machine Learning DaysPyConLiveWorxetc.Smaller, topical events or events focused on particular tools - Great if you are heavily invested in particular tech or a topic like NLP. In general you have to look around quite a bit to find these. TensorFlow dev summitSpacy IRLPyTorch developers conferenceAllenNLP SummitApplied Artificial Intelligence ConferenceDataSciConhttps://datascicon.tech/Etc.Research conferences - Meant to be an outlet for original research. Great to see how research orgs/institutions are pushing the boundaries and doing groundbreaking things. Hard to get into and very academic. NeurIPSEMNLPICLRCVPRetc.Some conference talks from the Practical AI hosts:Chris Benson’s upcoming talk at LiveWorx 2019 in Boston on Wednesday, June 12, 2019: Artificial Intelligence Strategy: Digital Transformation Through Deep LearningExamples of previous AI talks by Chris BensonBuilding GPU-Accelerated Workflows with TensorFlow and KubernetesFully Reproducible ML Deployment with Spark, Pachyderm, and MLeapUpcoming Events: Register for upcoming webinars here!

At the recent O’Reilly AI Conference in New York City, Chris met up with O’Reilly Chief Data Scientist Ben Lorica, the Program Chair for Strata Data, the AI Conference, and TensorFlow World.O’Reilly’s ‘AI Adoption in the Enterprise’ report had just been released, so naturally Ben and Chris wanted to do a deep dive into enterprise AI adoption to discuss strategy, execution, and implications.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $50 credit. Learn more at do.co/changelog. strongDM – Manage access to any database, server, and environment. strongDM makes it easy for DevOps to enforce the controls InfoSec teams require. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Featuring:Ben Lorica – Website, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:O’Reilly’s AI Adoption in the Enterprise: How Companies Are Planning and Prioritizing AI Projects in PracticeO’Reilly AI Conference 2019 | NYCUpcoming Events: Register for upcoming webinars here!

Can AI help quantum physicists? Can quantum physicists help the AI community? The answers are yes and yes! Dr. Shohini Ghose from Wilfrid Laurier University and Marcus Edwards from the University of Waterloo join us to discuss ML/AI’s impact on physics and quantum computing potential for ML/AI.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. strongDM – Manage access to any database, server, and environment. strongDM makes it easy for DevOps to enforce the controls InfoSec teams require. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Shohini Ghose – WebsiteMarcus Edwards – Website, GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Quantum Emulation project (email [email protected]/)Efforts to use Quantum Computing to accelerate ML/AI: from Googlefrom IBMXanadu: a dedicated ML platform for quantum computersOpenQASMRigettiQuantum open source foundationTED talk from Dr. GhoseUpcoming Events: Register for upcoming webinars here!

This week Daniel and Chris discuss the announcements made recently at TensorFlow Dev Summit 2019. They kick it off with the alpha release of TensorFlow 2.0, which features eager execution and an improved user experience through Keras, which has been integrated into TensorFlow itself. They round out the list with TensorFlow Datasets, TensorFlow Addons, TensorFlow Extended (TFX), and the upcoming inaugural O’Reilly TensorFlow World conference.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:TensorFlow Dev Summit 2019TensorFlow 2.0 alpha releaseTensorFlow DatasetsTensorFlow Extended (TFX)TensorFlow AddonsO’Reilly TensorFlow World conferenceUpcoming Events: Register for upcoming webinars here!

No, this isn’t science fiction! CTRL-labs is using neural signals and AI to build neural interfaces. Adam Berenzweig, from CTRL-labs R&D, joins us to explain how this works and how they have made it practical.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. O'Reilly Open Source Software Conference – OSCON has been ground zero for the open source community for 20 years. This year they’ve expanded to become a “software development conference” — because in 2019, software development IS open source. The program covers everything from open source, AI, infrastructure, blockchain, edge computing, architecture, and emerging languages. Use the code CHANGELOG20 to get 20% off Bronze, Silver, and Gold passes. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Featuring:Adam Berenzweig – Website, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:O’Reilly AI keynote from CTRL-labsCTRL-labs websiteCTRL-kitTED talk “The real reason for brains”IBM healthcare Practical AI episodeUpcoming Events: Register for upcoming webinars here!

While attending the NVIDIA GPU Technology Conference in Silicon Valley, Chris met up with Adam Stooke, a speaker and PhD student at UC Berkeley who is doing groundbreaking work in large-scale deep reinforcement learning and robotics. Adam took Chris on a tour of deep reinforcement learning - explaining what it is, how it works, and why it’s one of the hottest technologies in artificial intelligence!Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. O'Reilly Open Source Software Conference – OSCON has been ground zero for the open source community for 20 years. This year they’ve expanded to become a “software development conference” — because in 2019, software development IS open source. The program covers everything from open source, AI, infrastructure, blockchain, edge computing, architecture, and emerging languages. Use the code CHANGELOG20 to get 20% off Bronze, Silver, and Gold passes. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Featuring:Adam Stooke – GitHub, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:NVIDIA GTC: Doing More with More: Recent Achievements in Large-Scale Deep Reinforcement LearningAccelerated Methods for Deep Reinforcement LearningAccelerated Methods for Deep Reinforcement Learning - codeOpenAI Five - Dota 2AlphaStar: Mastering the Real-Time Strategy Game StarCraft IINVIDIA Graduate FellowshipCrunchbaseThe Hertz FoundationUpcoming Events: Register for upcoming webinars here!

Longtime listeners know that we’re always advocating for ‘AI for good’, but this week we have taken it to a whole new level. We had the privilege of chatting with James Hodson, Director of the AI for Good Foundation, about ways they have used artificial intelligence to positively-impact the world - from food production to climate change. James inspired us to find our own ways to use AI for good, and we challenge our listeners to get out there and do some good!Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. O'Reilly Open Source Software Conference – OSCON has been ground zero for the open source community for 20 years. This year they’ve expanded to become a “software development conference” — because in 2019, software development IS open source. The program covers everything from open source, AI, infrastructure, blockchain, edge computing, architecture, and emerging languages. Use the code CHANGELOG20 to get 20% off Bronze, Silver, and Gold passes. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Featuring:James Hodson – Website, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:AI For Good FoundationAI For Good Foundation Video LecturesKDD Earth Day“Fragile Earth” WorkshopDiscounted Membership for Practical AI Podcast Listeners!AI Experts: Moving forward with AI likely a series of small steps, not giant leapsUpcoming Events: Register for upcoming webinars here!

GIPHY’s head of R&D, Nick Hasty, joins us to discuss their recently released celebrity detector project. He gives us all of the details about that project, but he also tells us about GIPHY’s origins, AI in general at GIPHY, and more!Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. Discover.bot – A digital space for bot developers and enthusiasts of all skill levels to learn from one another, share stories, and move the bot conversation forward. Want to learn more about building bots? Get started with their Guide to Bot Building Frameworks. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Featuring:Nick Hasty – Website, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Blog post about the celeb detector projectGIPHY Enters the Open Source Community with Celebrity Detector (readwrite article)MTCNN method used in the celebrity detector projectGitHub repoDemo page3D projection of celeb face embeddingsComplete list of all celebs in the modelUpcoming Events: Register for upcoming webinars here!

Being that this is “practical” AI, we decided that it would be good to take time to discuss various aspects of AI infrastructure. In this full-connected episode, we discuss our personal/local infrastructure along with trends in AI, including infra for training, serving, and data management.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Our locally installed stuff:JupyterDockerPythonGoPostmanWhere we see AI workflows running:AWSGCPAzureKubernetes and KubeFlowOn-prem workstations: NVIDIALambda LabsSystem76Experimentation / model development:JupyterLabGoogle ColaboratoryAWS SageMakerData Science platforms: DominoDataBricksDataRobotH2O.aiPipelining and automation:PachydermAirflowLuigiModel optimization: OpenVinoTensorRTTensorFlow LiteServing:MXNetTensorFlow servingSeldonMonitoring/visibility:TensorBoardNetronKnock knockPrometheusElasticSearchUpcoming Events: Register for upcoming webinars here!

While at the NVIDIA GPU Technology Conference 2019 in Silicon Valley, Chris enjoyed an inspiring conversation with Anima Anandkumar. Clearly a role model - not only for women - but for anyone in the world of AI, Anima relayed how her lifelong passion for mathematics and engineering started when she was only 3 years old in India, and ultimately led to her pioneering deep learning research at Amazon Web Services, CalTech, and NVIDIA.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Anima Anandkumar – Website, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:Anima Anandkumar on WikipediaNVIDIA GTC SpeakerNVIDIA GTC Presentation: Role of Tensors in Machine LearningNVIDIA GTC Presentation: Infusing Physics into Deep Learning Algorithms with Applications to Stable Landing of DronesCalTech CMS TensorLabGoogle ScholarUpcoming Events: Register for upcoming webinars here!

Clément Delangue, the co-founder & CEO of Hugging Face, joined us to discuss fun, social, and conversational AI. Clem explained why social AI is important, what products they are building (social AIs who learn to chit-chat, talk sassy and trades selfies with you), and how this intersects with the latest research in AI for natural language. He also shared his vision for how AI for natural language with develop over the next few years.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. GitPrime – Download GitPrime’s 20 Patterns book, a field guide to help engineering managers recognize achievement, spot bottlenecks, and debug development processes with data. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Clément Delangue – Website, LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Hugging FaceVoice BolossTransformer model episodes: BERTGPT-2Hugging Face’s Pytorch pre-trained model repoRasaLyrebirdAllen Institute for AIAllenNLPOpenAIFast.aiBetaworks Synthetic campUpcoming Events: Register for upcoming webinars here!

The White House recently published an “Executive Order on Maintaining American Leadership in Artificial Intelligence.” In this fully connected episode, we discuss the executive order in general and criticism from the AI community. We also draw some comparisons between this US executive order and other national strategies for leadership in AI.Sponsors:Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogRollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Relevant learning resources:AI for EveryoneIntel AI list of Ethics toolkitsGovernment data Federal data portalChicago data portalReferences / notes:The White House Executive Order4 Experts Respond to Trump’s Executive Order on AITrump’s executive order on AI, explainedTrump to launch artificial intelligence initiative, but many details lacking (Science)National AI strategies overview (Medium article)China Is Leading in Artificial Intelligence–and American Businesses Should Take NoteChina plans to be a world leader in Artificial Intelligence by 2030Global AI talent ReportSUMMARY OF THE 2018 DEPARTMENT OF DEFENSE ARTIFICIAL INTELLIGENCE STRATEGY: Harnessing AI to Advance Our Security and ProsperityArtificial Intelligence Is Now a Pentagon Priority. Will Silicon Valley Help?DOD Takes Strategic Approach to Artificial IntelligenceBooks“AI Superpowers” by Kai-Fu LeeUpcoming Events: Register for upcoming webinars here!

While covering Applied Machine Learning Days in Switzerland, Chris met El Mahdi El Mhamdi by chance, and was fascinated with his work doing AI safety research at EPFL. El Mahdi agreed to come on the show to share his research into the vulnerabilities in machine learning that bad actors can take advantage of. We cover everything from poisoned data sets and hacked machines to AI-generated propaganda and fake news, so grab your James Bond 007 kit from Q Branch, and join us for this important conversation on the dark side of artificial intelligence.Sponsors:Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogRollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:El Mahdi El Mhamdi – Website, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:El Mahdi El Mhamdi on LinkedInGoogle ScholarPersonal blogWorld Health Organization | Ten threats to global health in 2019AggregaThorThe Hidden Vulnerability of Distributed Learning in ByzantiumMachine Learning with Adversaries: Byzantine Tolerant Gradient DescentAsynchronous Byzantine Machine Learning (the case of SGD)Upcoming Events: Register for upcoming webinars here!

This week we discuss GPT-2, a new transformer-based language model from OpenAI that has everyone talking. It’s capable of generating incredibly realistic text, and the AI community has lots of concerns about potential malicious applications. We help you understand GPT-2 and we discuss ethical concerns, responsible release of AI research, and resources that we have found useful in learning about language models.Sponsors:Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogRollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Relevant learning resources:Jay Alammar “Illustrated” blog articles: The illustrated transformerThe illustrated BERT, elmo, and coMachine Learning Explained blog: An In-Depth Tutorial to AllenNLP (From Basics to ELMo and BERT)Paper Dissected: “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” ExplainedReferences/notes:GPT-2 blog post from OpenAIGPT-2 PaperGPT-2 GitHub RepoGPT-2 PyTorch implementationEpisode 22 of Practical AI about BERTOpenAI’s GPT-2: the model, the hype, and the controversy (towardsdatascience)The AI Text Generator That’s Too Dangerous to Make Public (Wired)Transformer paperPreparing for malicious uses of AI (OpenAI blog)Upcoming Events: Register for upcoming webinars here!

While at Applied Machine Learning Days in Lausanne, Switzerland, Chris had an inspiring conversation with Anna Bethke, Head of AI for Social Good at Intel. Anna reveals how she started the AI for Social Good program at Intel, and goes on to share the positive impact this program has had - from stopping animal poachers, to helping the National Center for Missing & Exploited Children. Through this AI for Social Good program, Intel clearly demonstrates how a for-profit business can effectively use AI to make the world a better place for us all.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Anna Bethke – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:AI for Social Good at IntelNational Center for Missing & Exploited ChildrenData for DemocracyData KindDelta AnalyticsDriven DataPartnership on AITech Jobs for GoodApplied Machine Learning DaysUpcoming Events: Register for upcoming webinars here!

Chris sat down with Marta Martinez-Cámara and Miranda Kreković to learn how GirlsCoding.org is inspiring 9–16-year-old girls to learn about computer science. The site is successfully empowering young women to recognize computer science as a valid career choice through hands-on workshops, role models, and by smashing prevalent gender stereotypes. This is an episode that you’ll want to listen to with your daughter!Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Marta Martinez-Cámara – WebsiteMiranda Kreković – WebsiteChris Benson – Website, GitHub, LinkedIn, XShow Notes:GirlsCoding.orgGirlsCoding.org on TwitterGirlsCoding.org on LinkedInGirlsCoding on FacebookGirlsCoding.org at Applied Machine Learning DaysApplied Machine Learning DaysÉcole Polytechnique Fédérale de LausanneUpcoming Events: Register for upcoming webinars here!

Chris caught up with Jennifer Marsman, Principal Engineer on the AI for Earth team at Microsoft, right before her speech at Applied Machine Learning Days 2019 in Lausanne, Switzerland. She relayed how the team came into being, what they do, and some of the good deeds they have done for Mother Earth. They are giving away $50 million (US) in grants over five years! It was another excellent example of AI for good!Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Jennifer Marsman – GitHub, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:Jennifer Marsman’s blogAI for EarthProject Premonition (mosquitos/genomics)FarmBeats (agriculture)Wildbook (recognizing individual animals) #1Wildbook (recognizing individual animals) #2Repository of data setsMicrosoft Green TwitterUpcoming Events: Register for upcoming webinars here!

Fully Connected – a series where Chris and Daniel keep you up to date with everything that’s happening in the AI community.If you’re anything like us, your New Year’s resolutions probably included an AI section, so this week we explore some of the learning resources available for artificial intelligence and deep learning. Where you go with it depends upon what you want to achieve, so we discuss academic versus industry career paths, and try to set you on the Practical AI path that will help you level up.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:CoursesAmazon Machine Learning with AWSGoogle Machine Learning Crash Course with TensorFlow APIsMicrosoft Professional Program for Artificial IntelligenceCoursera / deeplearning.aiNVIDIA Deep Learning InstituteGoogle, Amazon, Microsoft: How do their free machine-learning courses compare?Stanford Machine Learning Videos on YouTubeBooks“Deep Learning” by Ian Goodfellow, Yoshua Bengio, and Aaron Courville“Natural Language Processing with PyTorch” by Delip Rao and Brian McMahan“Machine Learning With Go” by Daniel Whitenack and Janani Selvaraj(Daniel is too humble to put his own book in this list, so Chris inserted it above without Daniel’s knowledge - because it’s a damn fine book!)Hybrid resourcesMachine learning with TensorFlow crash course Intro to deep learning with PyTorch Spinning Up in Deep RLMeetupsPyData Atlanta Deep Learning MeetupUpcoming Events: Register for upcoming webinars here!

Ajay Royyuru and Guillermo Cecchi from IBM Healthcare join Chris and Daniel to discuss the emerging field of computational psychiatry. They talk about how researchers at IBM are applying AI to measure mental and neurological health based on speech, and they give us their perspectives on things like bias in healthcare data, AI augmentation for doctors, and encodings of language structure.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We catch our errors before our users do because of Rollbar. Resolve errors in minutes, and deploy your code with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Ajay Royyuru – WebsiteGuillermo Cecchi – Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:IBM 5 in 5: With AI, our words will be a window into our mental healthPredicting Cognitive Impairments with a Mobile ApplicationAutomated analysis of recent-onset and prodromal schizophreniaPrediction of psychosis across protocols and risk cohorts using automated language analysisUpcoming Events: Register for upcoming webinars here!

Fully Connected – a series where Chris and Daniel keep you up to date with everything that’s happening in the AI community.This week we look back at 2018 - from the GDPR and the Cambridge Analytica scandal, to advances in natural language processing and new open source tools. Then we offer our predications for what we expect in the year ahead, touching on just about everything in the world of AI.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We catch our errors before our users do because of Rollbar. Resolve errors in minutes, and deploy your code with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:2018 in ReviewFocus on more challenging ML problemsSemi-supervised learningDomain adaptationGenerative modelsReinforcement learningNLPELMOBERTFear about AIGDPR, trust and privacyCambridge analyticaFacial recognitionTons of open sourced tooling, modelsPredictions for 2019Focus on trust and transparencyBiasRegulationGDPR and transparency, interpretabilityWhat will other countries do regarding regulation?AI for goodBetter voice and conversational resultsAI assistantsVoice interfacesNLP advancesMore focus on product development, less on researchDeep learning will explode in production product / service developmentComputer vision, NLP, speech recognition will be table stakesIncreased accessibility of DL to software engineers / developersMore testing/toolingBetter training for data scientistsBetter integrations and infrastructureAutoMLOrganizational / Cultural ShiftsNew roles for data-based leadership - CDO, CAIO, etc.,Strategy - AI becoming first-class concernCompetitive Analysis - AI and data assessments mandatoryFragmentation into distinct subfields - AI, analytics, data science, prognosticsA changing relationship between humans and automationAI + robotics - first stepsPervasive AI + IoT - first stepsThe importance of creative expertise for humansHow to school your child today to prep for tomorrowNarrowly-scoped, highly-specific job functions at most riskUpcoming Events: Register for upcoming webinars here!