The Swyx Mixtape

a surprisingly good quality dense chat with Delta Institute https://www.youtube.com/watch?v=CYr1mSDNqKM

https://www.listennotes.com/podcasts/chit-chat-stocks/the-future-of-artificial-3ylaqngtMR7/[00:00:00]intro: Welcome to Chitchat Stocks on this show host Ryan Henderson and Brett Schaefer analyze businesses and riff on the world of investing. As a quick reminder, Chitchat Stocks is a CCM media group podcast. Anything discussed on Chitchat Stocks by Ryan, Brett, or any other podcast guest is not formal advice or recommendation.intro: Now, please enjoy this episode.Brett: Welcome in. We have another episode of the Chitchat Stocks podcast for you this week. We have a fantastic interview coming up with Shawn Wang from LatentSpace. It is a, I'll say covering anything AI. A lot of the stuff, you know, for me and Ryan, it might be going over our heads and it might be a little too hard technically for us, but that's what we brought on Shawn to the show today.Brett: For a lot of public market investors, this new [00:01:00] AI stuff, it's hard to You know, see what is, what is working, what's just a narrative, what all the stuff that's getting thrown at us during this boom times. So Shawn, we wanted to bring you back on the show. You came on, I think almost exactly two years ago now to talk more cloud stuff.Brett: Now we're really going to talk about cloud AI and how it is impacting the startup ecosystem. So Shawn, as we kick off the show. What is your relevant expertise in this booming AI field? swyx: Oh God, that's the million dollar question here. So I am so for, for listeners who haven't heard back the previous episode that I was on I was finance and public markets guy.swyx: And I was, I was in a hedge fund for my first career. And then I changed careers to tech where I worked at AWS and three unicorn Sort of developer tooling cloud startups. My relevant expertise is you know, on, on some [00:02:00] level, I, I'm just a software engineer that is building with AI now. And then on another level, I had, I actually, when I was an options trader back in the sales side, I actually did a lot of natural language processing of the Bloomberg chats.swyx: So I fed all of the Bloomberg chats into a pricing mechanism. Then built our global pricer. So our entire options desk was running off of that thing. This was about 13 years ago. So so you know, I, I've always had some involvement with like AI, but like, you know, it was never a big part of my identity and I think.swyx: The more foundation models came into focus, and foundation models is a very special term as opposed to traditional, maybe machine learning finance that a lot of your listeners might be familiar with then you start to build differently, and there the traditional software engineering skills become a lot more relevant.swyx: So relevant expertise now is that I, I guess I've sort of popularized and created the term of AI engineer, which you can talk about and created the industry such that Gartner now considers, considers [00:03:00] it like the peak of its hype right now. And I, I consider that both a point of success and also a challenge because I have to prove Gartner wrong that it has not peaked, but you know, they put us at the top of the hype cycle, which is kind of funny.swyx: Because I started it, so. Ryan: Yeah, it's it's a unique challenge but yeah, funny anecdote. Okay, so a lot has changed since we last spoke. Yeah. Pretty much this whole world of AI that everyone's talking about now or at least has become mainstream has, I believe that kind of kicked off right after the discussion or our last discussion.Ryan: So I guess the last discussion was really focused on the cloud computing industry broadly. And that was actually right around the time when AWS. Azure, GCP all the revenue growth rates were coming down and actually now with the hindsight bottoming. So my question for you is what has, I guess, [00:04:00] what has changed over the last two years and why has revenue growth at the big cloud providers re accelerated?swyx: Yeah, again, like, revenue growth at big cloud providers is due to factors that, you know, probably I don't have a full appreciation of. I also challenge the fact, the idea that everything has changed. You know, I think in some ways, this is just like the next wave of something that was just a broader, maybe like 20, 30 year long trend anyway.swyx: You know, we, we needed more cloud compute. Now we need even more cloud compute. Now we need more GPUs in the cloud instead of CPUs, right? Like, what's really changed? I don't know. Like, you know, people still want serverless everything. People still want orchestration. People still want you know, unlimited storage and bandwidth and all the sort of core components of cloud.swyx: In that sense, it hasn't really changed. I do think that if you see there are plots over time of the amount of money and flops invested in machine learning models, that actually used to follow a pretty log linear Moore's law type growth chart for the last like 40 years. [00:05:00] And then, You had 2022 happen and

https://podcast.scalingdevtools.com/episodes/swyx-2Plus, Shawn started the AI Engineer movement with his essay Rise of the AI Engineer and organized two incredible AI engineer conferences in the past twelve months - AI Engineer World's Fair and AI Engineer SummitAnd Shawn has angel invested in DevTools like Airbyte, Railway, Supabase, Replay.io, Stackblitz, Flutterflow, Fireworks.ai while running the DevTools angels community.Besides this, Shawn curates DX.tips (DevTools magazine) and in a past life wrote the Coding Career handbook, championed learn in public, cofounded Svelte Society and was previously Head of Developer Experience at Temporal, and a Developer Advocate at AWS and Netlify.Also, before this, Shawn had a very successful career in investment banking, trading, building data pipelines and performing quantitate portfolio management. I think this brings him a very unique perspective - I've always admired his ability to zoom out and see the big picture and the trends.Even though Shawn is now all-in on AI, he's still one of the go-to authorities on DevTools go-to-market.As you can tell, Shawn is someone I deeply admire. So I'm glad he came back.What we discuss:Organizing the AI Engineer ConferencesRise of the AI EngineerIntentionality and principles (yes we even talk about Alcoholics Anonymous)The AI CEOInvisible deadlinesIlya believing in AGI more than most people at OpenAIAre developers going to be obsolete? Thor convinced swyx to invest in SupabaseBuilding DevTools that work well with LLMsAngel investing in DevTools - why and howIs DevRel dead?How to hire DevRelWhy DX.tips existsLinks:Rise of the AI Engineer https://www.latent.space/p/ai-engineerLatent Space Podcast https://www.latent.space/swyx's Twitter https://x.com/swyxswyx's website https://www.swyx.io/swyx's LinkedIn https://www.linkedin.com/in/shawnswyxwang/smol.ai https://smol.ai/DevTools Angels https://github.com/sw-yx/devtools-angelsDX.tips https://dx.tips/DevRel's Death as Zero Interest Rate Phenomenon https://dx.tips/zirp AI Engineer Summit https://www.ai.engineer/summit/2023AI Engineer World's Fair https://www.ai.engineer/worldsfairCoding Career Handbook https://www.learninpublic.org/Shawn's previous appearance on Scaling DevTools https://podcast.scalingdevtools.com/episodes/swyx Eisenhower Matrix https://asana.com/resources/eisenhower-matrixThor from Supabase https://x.com/thorwebdevSolaris AI coworking space in SF https://www.solarissf.com/Browserbase https://www.browserbase.com/Indent https://indent.com/ and Fouad https://x.com/fouadmatinHow to do hackathons https://dx.tips/hackathonsHow to do conferences https://dx.tips/conf-guideHow to hire DevRel https://dx.tips/mailbox-first-devrel-hiringClimbing the ladder of abstraction with Amelia Wattenberger https://www.youtube.com/watch?v=PAy_GHUAICw...for the job. And they should not be doing that job and they should try something else to do. People pay for it because they need the job title to be filled more than they need that person. Those good people are very hard to reach.That's one thing there. I also mentioned some other things that I've found in the different roles in the category: Bottoms-up and open source have been very challenging in the growing a company success criteria. That's what different roles focus on: bottoms-up and open source, and particularly open source. You don't have to be open source.

https://sites.libsyn.com/493303/building-ai-in-2024-is-not-what-you-think-with-swyx

In episode 18 of Generationship, Rachel Chalmers sits down with Shawn "swyx" Wang to delve into AI Engineering. Shawn shares his journey from popularizing the term "AI Engineer" to navigating the rapid advancements in AI technology. Together, they explore the evolving demands and opportunities in AI, offering unparalleled insights into the future of this transformative field.https://www.heavybit.com/library/podcasts/generationship/ep-18-intelligence-on-tap-with-shawn-swyx-wang?utm_campaign=coschedule&utm_source=twitter&utm_medium=heavybit&utm_content=Ep.%20%2318,%20Intelligence%20on%20Tap%20with%20Shawn%20%22swyx%22%20Wang

https://www.listennotes.com/podcasts/plan-b-news-beat-ZoCrxdekY79/https://open.spotify.com/episode/45dTtNCiIxqySG1lU5addY?si=SeMrk4FBR_yGc4NtG8Ll5Q

High Agency Pod DescriptionIn this episode, I chatted with Shawn Wang about his upcoming AI engineering conference and what an AI engineer really is. It's been a year since he penned the viral essay "Rise of the AI Engineer' and we discuss if this new role will be enduring, the make up of the optimal AI team and trends in machine learning.Timestamps00:00 - Introduction and background on Shawn Wang (Swyx)03:45 - Reflecting on the "Rise of the AI Engineer" essay07:30 - Skills and characteristics of AI Engineers12:15 - Team composition for AI products16:30 - Vertical vs. horizontal AI startups23:00 - Advice for AI product creators and leaders28:15 - Tools and buying vs. building for AI products33:30 - Key trends in AI research and development41:00 - Closing thoughts and information on the AI Engineer World Fair Summit

Jeff Lawson just bought The Onion.This is one of my favorite episodes of their NPR podcast parody of Serial.https://www.listennotes.com/podcasts/a-very-fatal-murder/episode-5-part-1-did-my-tJbSp9yP2wU/

https://www.listennotes.com/podcasts/modern-web/modern-web-podcast-s12e03-rl_OLdGJHS8/

I made a new friend, Serena (sister of Malindi!) who was so impressive and thoughtful in the short time I have known her (cooking, language learning, finance/science management) that I asked her to write down her philosophy of Intentionality.[00:02:05] Elements of Intentionality - Taste and Standards[00:05:17] Elements of Intentionality - Intentionality is All or Nothing[00:06:50] Serena's path to Intentionality[00:10:24] Elements of Intentionality - Fantasy[00:10:55] Elements of Intentionality - Tenacity & Resilience[00:14:13] Where to be Intentional - Relationships[00:17:48] Where to be Intentional - Art[00:19:50] Where to be Intentional - Work[00:24:30] Elements of Intentionality - Stubbornness[00:26:03] Journaling?[00:28:28] Listing Intentions?[00:30:52] Applying Intentionality - on a medium priority[00:37:32] Dropping Intentions[00:42:18] Serena asks: Why do you want to live your life with intentionality? [00:43:21] Serena asks: What is Intentionality for you?[00:47:06] Serena asks: What has kept you from Intentionality?[00:50:52] Intetionality is Lonely [00:52:38] PSA: Serena's eggs are amazing[00:53:08] Back to Health[00:57:24] Intentionality Inspirations - Ramit Sethi and Ira Glass[01:03:02] I should write more[01:06:45] Closing - Intentionality and Fulfilment

"Navigating AI and Software 3.0: A Tech Career Guide for Developers": a more beginner oriented podcast interview for a new Youtuber: https://www.youtube.com/watch?v=i5qfKKct6dchere are the recommended resources for others who listened latent space university: https://www.latent.space/p/lsu-betaAI engineering 101+201 https://www.latent.space/p/aie-2023-workshopsAndrej Karpathy's software 2.0: https://karpathy.medium.com/software-2-0-a64152b37c35Voyager paper: https://arxiv.org/abs/2305.16291January 10, 2024

years after following him for his serverless content, i was glad to be on Yan Cui's pod to talk Rise of AI Engineer.https://realworldserverless.com/episode/92i

An essay I think about often, and recommend to people, that I need to internalize more. https://theamericanscholar.org/solitude-and-leadership/

https://podrocket.logrocket.com/software-3-and-the-ai-engineer

https://shoptalkshow.com/577/

this is a longer form conversation with an AI insider so we do get pretty in depth. sorry for the poor audio quality on my sidehttps://www.cognitiverevolution.ai/ai-engineers-pendants-and-tensions-between-openai-and-developers-with-swyx-of-latent-space/

https://www.youtube.com/watch?v=EIMi4Yt-AIg

I met up to podcast with quincy in round 2, which has all my personal updates since round 1.https://freecodecamp.libsyn.com/90-shawn-swyx-wang-from-dev-to-ai-founder

One of my biggest posts ever was https://www.latent.space/p/ai-engineer and we hosted a Twitter Space about it:https://twitter.com/swyx/status/1674895620870651909?s=20I felt like the space wasn't info dense enough for the main Latent Space pod but you get the full show as loyal swyx mixtape subscribers.

Video and pull quotes: https://www.humanskills.co/p/human-skills-012-productivity-and

smol developer took off this week. we convened a special twitter space to talk about what we should do next.

david cramer speaks on why he believes in open source businesses, and why specifically you should use BSL and not the other stuff.https://www.se-radio.net/2023/05/se-radio-563-david-cramer-on-error-tracking/ 1hr in

revived by https://www.swyx.io/how-to-find-podcasts-that-have-been-deletedhttps://softwareengineeringdaily.com/2019/12/19/no-code-with-shawn-wang/The software category known as “no-code” describes a set of tools that can be used to build software without writing large amounts of code in a programming language.No-code tools use visual interfaces such as spreadsheets and web based drag-and-drop systems. In previous shows, we have covered some of the prominent no-code products such as Airtable, Webflow, and Bubble. It is clear that no-code tools can be used to build core software infrastructure in a manner that is more abstract than the typical software engineering model of writing code.No-code tools do not solve everything. You can’t use a no-code tool to build a high performance distributed database, or a real-time multiplayer video game. But they are certainly useful for building internal tools and basic CRUD applications.We know that no-code tools can create value. But how do they fit into the overall workflow of a software company? How should teams be arranged now that knowledge workers can build certain kinds of software without writing code? And how should no-code systems interface with the monoliths, microservices, and APIs that we have building for years?Shawn Wang is an engineer with Netlify, a cloud provider that is focused on delivering high-quality development and deployment experience. Netlify is not a no-code platform, but Shawn has explored and written about the potential of no-code systems. Since he comes from a code-heavy background, he is well-positioned to give a realistic perspective on how no-code systems might evolve to play a role in the typical software development lifecycle.

https://overcast.fm/+-qMwI0I10/17:00

https://www.listennotes.com/podcasts/gamecraft/the-calculus-of-fun-ep-3-vaT0YeDE68S/

from the start https://overcast.fm/+-qMx_5Oqo

30 mins in to https://www.listennotes.com/podcasts/gamecraft/the-fall-and-rise-of-KIbFrC70q93/

30 mins in https://www.listennotes.com/podcasts/gamecraft/steal-this-game-ep-1-o1CHsvutpKV/

https://softwareengineeringdaily.com/2017/08/09/state-of-javascript-with-sacha-greif/

from https://www.listennotes.com/podcasts/gradient-dissent/emily-m-bender-language-aVzCO4T2gGs/further readinghttps://www.theverge.com/22309962/timnit-gebru-google-harassment-campaign-jeff-deanhttps://docs.google.com/document/d/1f2kYWDXwhzYnq8ebVtuk9CqQqz7ScqxhSIxeYGrWjK0/edit

https://www.listennotes.com/podcasts/fyi-for-your/the-evolution-of-ai-models-Fs_7Pd5f1aG/

From: https://www.youtube.com/watch?v=Oz4G9zrlAGs

from https://overcast.fm/+HaNPbG9CU/24:00to read: https://overcast.fm/+HaNPbG9CU/24:00

from: https://www.listennotes.com/podcasts/gradient-dissent/peter-boris-fine-tuning-iu5-hVreSF8/ from 15mins in

Video at https://www.youtube.com/watch?v=aZnzzMbA7Vg6:55 - Product versus Platform9:05 - Durable Functions13:49 - Coding Career Handbook for Junior to Senior Developers What Inspired You To Write It16:02 - What Most Developers Should Know after They Get Their First Job21:36 - How Did You Survive during the Pandemic and no Flight Policy23:34 - Jsconf Asia 2018 Talk25:20 - The Third Age of Javascript27:28 - Perspective On on the React Ecosystem27:51 - What Do You Think about React Ecosystem Right Now35:04 - Do You Learn English at a Very Early Age

Listen to the GCP podcast: https://www.listennotes.com/podcasts/google-cloud/gke-turns-7-with-tim-hockin-tnr2DzMUkY1/

https://www.youtube.com/watch?v=sKE1S7PK1fY 14.45mins inMy article on Google vs OpenAI: https://lspace.swyx.io/p/google-vs-openai

https://podcasts.mongodb.com/public/115/The-MongoDB-Podcast-b02cf624/f96bd55fTranscriptMichael Lynn: Welcome to the show. My name is Michael Lynn and this is the MongoDB Podcast. Thanks for joining us. Today on the show, Lena Smart, Chief Security Officer of MongoDB, and I team up to interview Dwight Merriman, co- founder and key contributor to MongoDB. Dwight Merriman is a true tech legend. In addition to co- founding and co- creating the MongoDB database and 10gen now called MongoDB, the company. He also co- founded and led several other well known successful companies including Business Insider, DoubleClick and Gilt Groupe. In today's interview, Dwight shares openly and honestly about the motivations behind creating the database, which now actually claims nearly half of the entire NoSQL market. He talks about the decision to build the database rather than use something that existed at the time. Dwight's friendly, easy to talk to, knowledgeable, and probably one of the smartest individuals that I've had the pleasure of chatting with. Without further ado, let's get to the interview. If you enjoy the content, please consider visiting Apple Podcasts or Spotify. Leave a rating and a comment if you're able, let us know what you think. Stay tuned. Hey, did you know that MongoDB University has been completely redesigned? That's right. Hands- on labs, quizzes, study guides and materials, bite- sized video lectures, programming language specific courses. You can learn MongoDB in the programming language of your choice, Node. js, Python, C#, Java, so many more. You can earn that MongoDB certification by validating your skills and leveling up your career. Visit learn. mongodb. com today.Lena Smart: So it is my absolute pleasure, and I'm so glad that you could make it in person today, to introduce Dwight Merriman. He is the first CEO of MongoDB, and you were still coding, I understand. You're also co- founder and director of MongoDB as of today. Are you still coding?Dwight Merriman: I'm still coding or tinkering a bit myself, but not on the database anymore. I think there's, to really dive in and work on it, there's a certain minimum number of hours a week you have to work on it, just to keep up with the code base and the state of everything, because it's not short, it's not a small program anymore.Lena Smart: Amazing. And also in the room we have Mike Lynn, who's our developer advocate, and I know that you'll likely have some questions.Michael Lynn: Yeah, for sure.Lena Smart: And just fire ahead, because probably this will be the most interesting person I'll speak to in a inaudible too.Michael Lynn: Well I'm fascinated already and I've got so many questions for Dwight, but I'm going to let you go ahead and ask away.Lena Smart: Cool. So the first question I have, and this has been a burning question of mine since I joined three and a half years ago, is how did you start the company? How did you start MongoDB?Dwight Merriman: Right, so when we started, actually the name of the company was 10gen, and this was around 2008, or I forget the date, maybe two months before that, I can't remember. The original, what we were really looking at, at the time, is as myself and our other co- founders like Elliot and Kevin, we've been working on various entrepreneurial projects, and we were seeing this repeated pattern where over and over. New product idea, you start building the system. At this point, I've been doing that for quite a long time. So knew what the best practices were at the time. But it was always around that timeframe, January, 2008, whenever it was, it just seemed like it was always a bit awkward. There was awkward and un- anesthetic, and it just seemed like there was a lot of duct tape and rubber bands. And even though those were best practices. You would talk to CTOs at the time, and they would say things like, " Putting memcached in front of databases is okay, and roll your own sharding in front of my MySQL sequel or Postgres is okay, but it isn't. It was because there wasn't a better way at the time. And everything, that was really when the cloud computing EC2 was really taking off. So it was very clear to us that cloud computing was the future, and a lot of the traditional products weren't very cloud- friendly. So if you have a database that scales vertically, so I can make it bigger, but then it's a mainframe, or a Sun 6500 or something like that, that's the opposite of a cloud principle, which is horizontal scalability and elasticity. And then if you tried to do it the other way, horizontally, it was usually rolling your own when it came to operational databases. And a lot of other things, but also just agile development was the way to go then, all iterative development. But a lot of the old tools, and this isn't just databases, but languages, everything, weren't really designed for that, because they were invented earlier. So it's not their fault. So we were just saying, " Gee, there's got to be a better way

Listen to the Future of Coding Podcast: https://www.listennotes.com/podcasts/future-of-coding/structure-of-a-programming-vBrU6CDIG_Z/ (21mins)

listen to John Gruber's pod https://www.listennotes.com/podcasts/the-talk-show-with/356-an-unranted-rant-with-pVwlyZT_AS9/ (5mins)https://en.wikipedia.org/wiki/Markdownhttps://twitter.com/swyx/status/1241578667916042240

Our big AI discussion with @ReamBraden and @swyx.Shawn just posted this new essay drawing on what we discussed here:Every Google vs OpenAI Argument, Dissectedfull episode: https://www.listennotes.com/podcasts/techmeme-ride-home/twtr-spc-the-big-ai-discussion-vb0hd4qmEHA/

Listen to the Moth https://www.listennotes.com/podcasts/the-moth/the-moth-radio-hour-pole-d7XZGOob8fs/ (15mins in)

Listen to the Huberman Lab podcast: https://www.listennotes.com/podcasts/huberman-lab/dr-layne-norton-the-science-QPRcFtj6kUL/ (52mins in)

Listen to the Art of Manliness: https://www.listennotes.com/podcasts/the-art-of-manliness/using-extended-fasting-to-QK28R5vd4IE/

From the Huberman Lab podcast: https://www.listennotes.com/podcasts/huberman-lab/dr-chris-palmer-diet-JsmfBwoKN6M/ 2h 23mins in