PLAY PODCASTS
Astral Codex Ten Podcast

Astral Codex Ten Podcast

1,164 episodes — Page 8 of 24

Is There An Illusion Of Moral Decline?

[Epistemic status: very uncertain about Part II; more convinced about Part III] I. This is the big question in the paper du jour, The Illusion Of Moral Decline, by Mastroianni and Gilbert (from here on: MG). It goes like this: people say that morality is declining. We know this because one million polls have asked people "do you think morality is declining?" and people always answer yes. MG go over these one million polls, do statistics to them, and find that people definitely think that morality is declining. People have thought this since at least 1949, when the first good polls were run - but realistically much longer. This could be (they say) either because morality is actually declining, or because of a bias. They argue that morality is not actually declining. In support, they marshal many polls asking questions like "Do you think most people are honest?" or "Do you think people treat you with respect?" and find that the answers mostly stay the same. Might this be because of definition creep - eg might people define "honest" relative to expectations, and expectations lower as morality declines? In order to rule this out, MG look at various objective questions that they think bear on morality, like "have you been mugged/assaulted recently?" or "have you donated blood in the past year?" They find that all of these have also stayed the same. Therefore, both people's subjective impressions of morality, and more objective proxies for social morality, have stayed the same. Therefore, morality is not actually declining. Therefore there must be a bias. https://astralcodexten.substack.com/p/is-there-an-illusion-of-moral-decline

Jul 6, 202321 min

Sure, Whatever, Let's Try Another Contra Caplan On Mental Illness

I. Bryan Caplan thinks he's debating me about mental illness. He's not. Sometimes he posts some thoughts he has been having about mental illness, with or without a sentence saying "this is part of my debate with Scott". Then I write a very long essay explaining why he is wrong. Then he ignores it, and has more thoughts, and again writes them up with "this is part of my debate with Scott". I would not describe this as debating. Call it unibating, or monobating, or another word ending in -bating which is less polite but as far as I can tell equally appropriate. Although he doesn't answer my rebuttals, he does diligently respond to various unrelated posts of mine, explaining why they must mean I am secretly admitting he was right all along. When I wrote about the scourge of witches stealing people's penises, Caplan spun it as me secretly admitting he was right all along about mental illness. Sometimes I feel like this has gone a bit too far - when I announced I had gotten married, Caplan spun it as me secretly admitting he was right all along about mental illness. Let it be known to all that I am never secretly admitting Bryan Caplan is right about mental illness. There is no further need to speculate that I am doing this. If you want to know my position vis-a-vis Bryan Caplan and mental illness, you are welcome to read my four thousand word essay on the subject, Contra Contra Contra Caplan On Psych. You will notice that the title clearly telegraphs that it is about Bryan Caplan and mental illness, and that (if you count up the contras) I am against him. If that ever changes, rest assured I will telegraph it in something titled equally clearly. https://astralcodexten.substack.com/p/sure-whatever-lets-try-another-contra

Jul 2, 202329 min

Every Flashing Element On Your Site Alienates And Enrages Users

Warning: This post might give vulnerable people new sensory sensitivities Everyone hates flashing banner ads, but maybe they're a necessary evil. Creators want money, advertisers demand a certain level of visibility for their ad buys, maybe sites are willing to eat the cost in user goodwill. Fine. But what's everyone else's excuse? https://astralcodexten.substack.com/p/every-flashing-element-on-your-site

Jul 1, 20236 min

"Through A Glass Darkly" In Asterisk Magazine

(Includes full article narration.) I have an article summarizing attempts to forecast AI progress, including a five year check-in on the predictions in Grace et al (2017). It's not here, it's at asteriskmag.com, a rationalist / effective altruist magazine: Through A Glass Darkly. This is their AI issue (it's not always so AI focused). https://astralcodexten.substack.com/p/through-a-glass-darkly-in-asterisk

Jul 1, 202338 min

Your Book Review: Public Citizens

[This is one of the finalists in the 2023 book review contest, written by an ACX reader who will remain anonymous until after voting is done. I'll be posting about one of these a week for several months. When you've read them all, I'll ask you to vote for a favorite, so remember which ones you liked] I. Today, pundits across the political spectrum bemoan America's inability to build. Across the country, NIMBYs and status-quo defenders exploit procedural rules to block new development, giving us a world where it takes longer to get approval for a single new building in San Francisco than it did to build the entire Empire State Building, where so-called "environmental review" is weaponized to block even obviously green initiatives like solar panels, and where new public works projects are completed years late and billions over budget—or, like California's incredible shrinking high-speed rail, may never be completed at all. Inevitably, such a complex set of dysfunctions must have an equally complex set of causes. It took us decades to get into this mess, and just as there's no one simple fix, there's no one simple inflection point in our history on which we can place all the blame. But what if there was? What if there was, in fact, a single person we could blame for this entire state of affairs, a patsy from the past at whom we could all point our censorious fingers and shout, "It's that guy's fault!" There is such a person, suggests history professor Paul Sabin in his new book Public Citizens: The Attack on Big Government and the Remaking of American Liberalism. And he isn't isn't a mustache-twirling villain—he's a liberal intellectual. If you know him for anything, it's probably for being the reason you know what a hanging chad is. That's right: it's all Ralph Nader's fault. https://astralcodexten.substack.com/p/your-book-review-public-citizens

Jun 30, 202333 min

Davidson On Takeoff Speeds

Machine Alignment Monday 6/19/23 The face of Mt. Everest is gradual and continuous; for each point on the mountain, the points 1 mm away aren't too much higher or lower. But you still wouldn't want to ski down it. I thought about this when reading What A Compute-Centric Framework Says About Takeoff Speeds, by Tom Davidson. Davidson tries to model what some people (including me) have previously called "slow AI takeoff". He thinks this is a misnomer. Like skiing down the side of Mount Everest, progress in AI capabilities can be simultaneously gradual, continuous, fast, and terrifying. Specifically, he predicts it will take about three years to go from AIs that can do 20% of all human jobs (weighted by economic value) to AIs that can do 100%, with significantly superhuman AIs within a year after that. As penance for my previous mistake, I'll try to describe Davidson's forecast in more depth. https://astralcodexten.substack.com/p/davidson-on-takeoff-speeds

Jun 25, 202339 min

Your Book Review: Njal's Saga

Finalist #5 in the Book Review Contest [This is one of the finalists in the 2023 book review contest, written by an ACX reader who will remain anonymous until after voting is done. I'll be posting about one of these a week for several months. When you've read them all, I'll ask you to vote for a favorite, so remember which ones you liked] I. I found Njal's Saga hard to follow. Halfway through, a friend reassured me it wasn't my fault. The medieval Icelanders had erred in releasing it as a book. It should have been the world's wackiest Phoenix Wright: Ace Attorney spinoff. Remember, medieval Iceland was an early attempt at anarcho-capitalist utopia. When Harald Fairhair declared himself King of Norway, the Norwegians who refused to bend the knee fled west to build a makeshift seastead on a frozen volcanic island. No lords, no kings, no masters. Only lawsuits. So, so many lawsuits. Once a year, the Icelanders would meet at the Althing, a free-for-all open-air law court. There they would engage in that most Viking of pastimes - suing each other, ad nauseam, for every minor slight of the past six months. Offended parties would sell their rights to prosecute a case to the highest bidder, who would go around seeking fair arbitrators (or, in larger cases, defer to a panel chosen by chieftain-nobles called godi. Courts would propose a penalty for the losing side - usually money. There were no police, but if the losers refused to pay, the courts could declare them "outlaws" - in which case it was legal to kill them. If you wanted to be a Viking in medieval Iceland, you needed a good lawyer. And Njal was the greatest lawyer of all. https://astralcodexten.substack.com/p/your-book-review-njals-saga

Jun 23, 202334 min

Your Incentives Are Not The Same As Media Companies'

Unfortunately I hate many of you. Only the ones with Twitter accounts. If you don't have one of those, you're fine. But if you do have one, there's a good chance you said something which horribly offended me. You said everyone who believed X was an idiot and a Nazi, and I believed X. You read the title but not the body of an article about some group I care about, and viciously insulted them based on your misunderstanding of their position. You spent five seconds thinking of a clever dunk on someone who happened to be a friend of mine trying really hard to make the world better, and ruined their day. https://astralcodexten.substack.com/p/your-incentives-are-not-the-same

Jun 18, 20234 min

The Canal Papers

You know all the stuff we've been talking about here the past few years - mental mountains, trapped priors, relaxed beliefs under psychedelics? The new keyword for all of that is "canalization". At least that's what I gather from a giant paper recently published by some of the leading thinkers in computational psychiatry (Karl Friston, Robin Carhart-Harris, etc). A quick review: you can model the brain as an energy landscape . . . . . . with various peaks and valleys in some multidimensional space Situations and stimuli plant "you" at some point on the landscape, and then you "roll down" towards some local minimum. If you're the sort of person who repeats "I hate myself, I hate myself" in a lot of different situations, then you can think of the action of saying "I hate myself" as an attractor - a particularly steep, deep valley which it's easy to fall into and hard to get out of. Many situations are close to the slopes of the "I hate myself" valley, so it's easy to roll down and get caught there. What are examples of valleys other than saying "I hate myself"? The authors suggest habits. If you always make the sign of the cross when passing a graveyard, there's a steep slope from the situation of passing a graveyard to the action of signing the cross. We can be even broader: something really basic like edge-detection in the visual system is a valley. When you see a scene, you almost always want to automatically do edge-detection on it. Walking normally is a valley; there's a certain correct sequence of muscle movements, and you don't want to start rotating your ligaments in some weird direction halfway through. https://astralcodexten.substack.com/p/the-canal-papers tt

Jun 18, 202329 min

Your Book Review: Man's Search for Meaning

Finalist #4 in the Book Review Contest [This is one of the finalists in the 2023 book review contest, written by an ACX reader who will remain anonymous until after voting is done. I'll be posting about one of these a week for several months. When you've read them all, I'll ask you to vote for a favorite, so remember which ones you liked] https://astralcodexten.substack.com/p/your-book-review-mans-search-for

Jun 14, 202345 min

Attempts To Put Statistics In Context, Put Into Context

Sometimes people do a study and find that a particular correlation is r = 0.2, or a particular effect size is d = 1.1. Then an article tries to "put this in context". "The study found r = 0.2, which for context is about the same as the degree to which the number of spots on a dog affects its friskiness." But there are many statistics that are much higher than you would intuitively think, and many other statistics that are much lower than you would intuitively think. A dishonest person can use one of these for "context", and then you will incorrectly think the effect is very high or very low. https://astralcodexten.substack.com/p/attempts-to-put-statistics-in-context

Jun 9, 20237 min

Highlights From The Comments On The Academic Job Market

Original post: Why Is The Academic Job Market So Weird? Table Of Contents Comments With More Information On Academic Hiring 2. Comments About How Things Got This Way 3. Comparisons To The Programmer Job Market 4. Comparisons To Other Job Markets 5. Proposed Solutions 6. Comments With Practical Advice For New PhDs https://astralcodexten.substack.com/p/highlights-from-the-comments-on-the-bc8

Jun 9, 202340 min

Your Book Review: Why Machines Will Never Rule the World

Finalist #3 in the Book Review Contest [This is one of the finalists in the 2023 book review contest, written by an ACX reader who will remain anonymous until after voting is done. I'll be posting about one of these a week for several months. When you've read them all, I'll ask you to vote for a favorite, so remember which ones you liked] I'll begin with a contentious but invariably true statement, which I've no interest in defending here: new books—at least new nonfiction books—are not meant to be read. In truth, a new book is a Schelling point for the transmission of ideas. So while the nominal purpose of a book review like this is to answer the question Should I read this book?, its real purpose is to answer Should I pick up these ideas? I set out to find the best book-length argument—one that really engages with the technical issues—against imminent, world-dooming, Skynet-and-Matrix-manifesting artificial intelligence. I arrived at Why Machines Will Never Rule the World by Jobst Landgrebe and Barry Smith, published by Routledge just last year. Landgrebe, an AI and biomedicine entrepreneur, and Smith, an eminent philosopher, are connected by their study of Edmund Husserl, and the influence of Husserl and phenomenology is clear throughout the book. ("Influence of Husserl" is usually a good enough reason to stop reading something.) Should you read Why Machines Will Never Rule the World? If you're an AI safety researcher or have a technical interest in the topic, then you might enjoy it. It's sweeping and impeccably researched, but it's also academic and at times demanding, and for long stretches the meat-to-shell ratio is poor. But should you pick up these ideas? My aim here isn't to summarize the book, or marinate you in its technical details. ATU 325 is heady stuff. Rather, I simply want to give you a taste of the key arguments, enough to decide the question for yourself. https://astralcodexten.substack.com/p/your-book-review-why-machines-will

Jun 4, 202316 min

Links For May 2023

https://astralcodexten.substack.com/p/links-for-may-2023 [Remember, I haven't independently verified each link. On average, commenters will end up spotting evidence that around two or three of the links in each links post are wrong or misleading. I correct these as I see them, and will highlight important corrections later, but I can't guarantee I will have caught them all by the time you read this.]

Jun 4, 202322 min

All Medications Are Insignificant In The Eyes Of God And Traditional Effect Size Criteria

In this post, the author suggests that the standard metrics for assessing the efficacy of medications, especially antidepressants, may be flawed and restrictive, indicating that if these stringent standards were applied to other common medications, they too would be deemed 'clinically insignificant', despite widespread acceptance of their effectiveness​. https://astralcodexten.substack.com/p/all-medications-are-insignificant

Jun 4, 202310 min

Are Woo Non-Responders Defective?

This post explores the differing responses to alternative wellness practices, suggesting various explanations, and highlights the challenge of discerning whether certain behaviors, such as drug use among schizophrenics, serve as coping mechanisms or exacerbate the issues​. https://astralcodexten.substack.com/p/are-woo-non-responders-defective

Jun 4, 202310 min

Your Book Review: Lying for Money

[This is one of the finalists in the 2023 book review contest, written by an ACX reader who will remain anonymous until after voting is done. I'll be posting about one of these a week for several months. When you've read them all, I'll ask you to vote for a favorite, so remember which ones you liked] You can't really understand the exception without understanding the rule. In order for him to understand why it was remarkable that the Titanic sank, you would first have to explain to the caveman how it was that a 52,310 ton vessel not only existed, but was able to float. This is the gift that Dan Davies gives us in Lying For Money. Despite taking econ classes in college, and spending years as a business owner who has had to do things like raise money from investors, my understanding of how the modern economy operates often feels about as complete as a caveman's understanding of how a cruise ship floats. The book delivers on the promise implied by its subtitle, How Legendary Frauds Reveal the Workings of Our World. Financial instruments (and other aspects of the economy) are things that are best understood in the breach: in the process of teaching us the various ways in which financial systems can break, Davies also teaches us how they work.

Jun 2, 20231h 7m

Hypergamy: Much More Than You Wanted To Know

"Female hypergamy" (from now on, just "hypergamy") is a supposed tendency for women to seek husbands who are higher-status than themselves. Arguing about educational hypergamy (women seeking husbands who are more educated than themselves) is especially popular, because women are now (on average) more educated than men - if every woman wants a more-educated husband, most won't get them, and there will be some kind of crisis. https://astralcodexten.substack.com/p/hypergamy-much-more-than-you-wanted

May 27, 202338 min

Mantic Monday 5/22/23

https://astralcodexten.substack.com/p/mantic-monday-52223 Whales v. Minnows // US v. Itself // EPJ v. The Veil Of Time // Balaji v. Medlock Manifold is a play money prediction market. Its intended purpose is to have fun and estimate the probabilities of important events. But instead of betting on important events, you might choose to speculate on trivialities. And instead of having fun, you might choose to ruin your life. From the beginning, there were joke markets like "Will at least 100 people bet on this market?" or "Will this market's probability end in an even number?" While serious people worked on increasingly sophisticated estimation mechanisms for world events, pranksters worked on increasingly convoluted jokes. In early April, power user Is. started "Whales Vs. Minnows": Will traders hold at least 10000x as many YES shares as there are traders holding NO shares? In other words, Team Whale had to sink lots of mana (play money) into the market, and Team Minnow had to get lots of people to participate. tt

May 25, 202329 min

Your Book Review: Cities And The Wealth Of Nations/The Question Of Separatism

[This is one of the finalists in the 2023 book review contest, written by an ACX reader who will remain anonymous until after voting is done. I'll be posting about one of these a week for several months. When you've read them all, I'll ask you to vote for a favorite, so remember which ones you liked] If you know Jane Jacobs at all, you know her for her work on cities. Her most famous book, published in 1961, is called The Death and Life of Great American Cities. It criticizes large-scale, top-down "urban renewal" policies, which destroy organic communities. Today almost everyone agrees with her on that, and she is considered one of the most influential thinkers on urban theory. This is not a review of The Death and Life of Great American Cities. Perhaps it would be, if I had become interested in Jane Jacobs's ideas on cities like a normal person. But I didn't: I started with two books that came to me by random chance, or fate, if you want to call it that. https://astralcodexten.substack.com/p/your-book-review-cities-and-the-wealth

May 21, 20231h 0m

Why Is The Academic Job Market So Weird?

Bret Devereaux writes here about the oddities of the academic job market. His piece is comprehensive, and you should read it, but short version: professors are split into tenure-track (30%, good pay and benefits) and adjunct (50%, bad pay and benefits). Another 20% are "teaching-track", somewhere in between. Everyone wants a tenure-track job. But colleges hiring new tenure-track faculty prefer newly-minted PhDs to even veteran teaching-trackers or adjuncts. And even if they do hire a veteran teaching-tracker or adjunct, it's practically never one of their own. If a teaching-tracker or adjunct makes a breakthrough, they apply for a tenure-track job somewhere else. Devereaux describes this as "a hiring system where experience manifestly hurts applicants" and displays this graph: https://astralcodexten.substack.com/p/why-is-the-academic-job-market-so

May 19, 20237 min

Galton, Ehrlich, Buck - An exploding generational bomb

Adam Mastroianni has a great review of Memories Of My Life, the autobiography of Francis Galton. Mastroianni centers his piece around the question: how could a brilliant scientist like Galton be so devoted to an evil idea like eugenics? This sparked the usual eugenics discussion. In case you haven't heard it before: https://astralcodexten.substack.com/p/galton-ehrlich-buck

May 19, 202333 min

Highlights From The Comments On Long COVID And Bisexuality

Table of Contents 1. Summary Of Best Comments And Overall Updates 2. Comments Proposing Explanations Based On Response Patterns 3. Comments Proposing Explanations Based On Biology 4. Comments By Jim Coyne 5. Comments Expressing Concerns About The Dangers Of Calling Things Psychosomatic 6. Other Comments https://astralcodexten.substack.com/p/highlights-from-the-comments-on-long Original post: Replication Attempt - Bisexuality And Long COVID

May 17, 202337 min

Highlights From The Comments On Housing Density And Prices

https://astralcodexten.substack.com/p/highlights-from-the-comments-on-housing Table Of Contents: 1. Comments About Whether Density Causes Desirability 2. Comments About Jobs And Amenities (And Not Density Per Se) Producing Desirability 3. Comments About Chinese Ghost Cities 4. Comments Accusing Me Of Not Considering Tokyo, Even Though I Included A Section In The Post On Why I Didn't Think Tokyo Was Relevant 5. Comments Accusing Me Of Not Understanding Economics 6. Comments By Famous People Who Potentially Have Good Opinions 7. My Final Thoughts + Poll

May 14, 202344 min

Ep 825Constitutional AI: RLHF On Steroids

https://astralcodexten.substack.com/p/constitutional-ai-rlhf-on-steroids A Machine Alignment Monday post, 5/8/23 What Is Constitutional AI? AIs like GPT-4 go through several different 1 types of training. First, they train on giant text corpuses in order to work at all. Later, they go through a process called "reinforcement learning through human feedback" (RLHF) which trains them to be "nice". RLHF is why they (usually) won't make up fake answers to your questions, tell you how to make a bomb, or rank all human races from best to worst. RLHF is hard. The usual method is to make human crowdworkers rate thousands of AI responses as good or bad, then train the AI towards the good answers and away from the bad answers. But having thousands of crowdworkers rate thousands of answers is expensive and time-consuming. And it puts the AI's ethics in the hands of random crowdworkers. Companies train these crowdworkers in what responses they want, but they're limited by the crowdworkers' ability to follow their rules.f

May 12, 202313 min

Ep 824Raise Your Threshold For Accusing People Of Faking Bisexuality

https://astralcodexten.substack.com/p/raise-your-threshold-for-accusing I. Many comments in yesterday's post about self-identified bisexuals getting long COVID centered on a concern that self-identified bisexuals don't really date both sexes, and are just claiming to be bi because it's trendy. Bisexuals themselves hate this and have written many articles and papers about why you shouldn't say it (1, 2, 3). But I especially appreciated a discussion in the comments between Nom de Flume, Ryan W, and others, giving a great statistical explanation for why it's tempting to believe this, but why it isn't true. Suppose someone (let's say a woman) has exactly equal sexual attraction to both men and women.

May 10, 202312 min

Ep 823Replication Attempt: Bisexuality And Long COVID

https://astralcodexten.substack.com/p/replication-attempt-bisexuality-and I learned from Pirate Wires that CDC data show bisexuals were about 50% more likely than heterosexuals to report long COVID. Is this just because more women than men are bisexual, and more women than men get long COVID? Not exactly; in the data they cite, women (regardless of sexuality) have an 18% rate, and bisexuals (regardless of gender) have a 22% rate. (aren't all these numbers really high? You can find almost any number depending on how you ask the question; questions along the lines of "have you had any persistent symptoms including fatigue, brain fog, shortness of breath, changes to taste/smell, etc, etc, etc, since having COVID?" tend to produce numbers from 20-30%; most will say this symptoms are mild and don't affect their functioning very much) This seemed weird enough that I wanted to try replicating it with the ACX survey data (read more about the ACX survey here).

May 10, 20235 min

Ep 822Change My Mind: Density Increases Local But Decreases Global Prices

https://astralcodexten.substack.com/p/change-my-mind-density-increases Matt Yglesias tries to debunk the claim that building more houses raises local house prices. He presents several studies showing that, at least on the marginal street-by-street level, this isn't true. I'm nervous disagreeing with him, and his studies seem good. But I find looking for tiny effects on the margin less convincing than looking for gigantic effects at the tails. When you do that, he has to be wrong, right?

May 8, 20239 min

Ep 821Highlights From The Comments On Nerds And Hipsters

https://astralcodexten.substack.com/p/highlights-from-the-comments-on-nerds Table of contents: 1: Comments By The Author Of The Original Post 2: Comments With Strong Opinions On The Definition Of Nerds, Geeks, Etc 3: Comments About Collecting 4: Comments Insisting That Sports Are Good 5: Comments About Enjoying Things Vs. Building Identities Around Them

May 4, 202333 min

Ep 821Mantic Monday 4/24/23

https://astralcodexten.substack.com/p/mantic-monday-42423 Can AIs Predict The Future? By Which We Mean The Past? If we asked GPT-4 to play a prediction market, how would it do? Actual GPT-4 probably would just give us some boring boilerplate about how the future is uncertain and it's irresponsible to speculate. But what if AI researchers took some other model that had been trained not to do that, and asked it? This would take years to test, as we waited for the events it predicted to happen. So instead, what if we took a model trained off text from some particular year (let's say 2020) and asked it to predict forecasting questions about the period 2020 - 2023. Then we could check its results immediately! This is the basic idea behind Zou et al (2022), Forecasting Future World Events With Neural Networks. They create a dataset, Autocast, with 6000 questions from forecasting tournaments Metaculus, Good Judgment Project, and CSET Foretell. Then they ask their AI (a variant of GPT-2) to predict them, given news articles up to some date before the event happened. Here's their result:

Apr 29, 202312 min

Ep 820Links For April 2023

https://astralcodexten.substack.com/p/links-for-april-2023 [Remember, I haven't independently verified each link. On average, commenters will end up spotting evidence that around two or three of the links in each links post are wrong or misleading. I correct these as I see them, and will highlight important corrections later, but I can't guarantee I will have caught them all by the time you read this.]

Apr 29, 202322 min

Ep 819Contra Kriss On Nerds And Hipsters

Sam Kriss has a post on nerds and hipsters. I think he gets the hipsters right, but bungles the nerds. Hipsters, he says, are an information sorting algorithm. They discover things, then place them on the altar of Fame so everyone else can enjoy them. Before the Beatles were so canonical that they were impossible to miss, someone had to go to some dingy bar in Liverpool, think "Hey, these guys are really good", and report that fact somewhere everyone else could see it. https://astralcodexten.substack.com/p/contra-kriss-on-nerds-and-hipsters

Apr 22, 20239 min

Ep 818[CLASSIC POST] Book Review: The Hungry Brain

[Content note: food, dieting, obesity] I. The Hungry Brain gives off a bit of a Malcolm Gladwell vibe, with its cutesy name and pop-neuroscience style. But don't be fooled. Stephan Guyenet is no Gladwell-style dilettante. He's a neuroscientist studying nutrition, with a side job as a nutrition consultant, who spends his spare time blogging about nutrition, tweeting about nutrition, and speaking at nutrition-related conferences. He is very serious about what he does and his book is exactly as good as I would have hoped. Not only does it provide the best introduction to nutrition I've ever seen, but it incidentally explains other neuroscience topics better than the books directly about them do. https://slatestarcodex.com/2017/04/25/book-review-the-hungry-brain/

Apr 22, 202339 min

Ep 817Highlights From The Comments On IRBs

Table of Contents 1: Comments From The Author Of The Book 2: Stories From People In The Trenches 3: Stories From People In Other Industries 4: Stories From People Who Use Mechanical Turk 5: Comments About Regulation, Liability, and Vetocracy 6: Comments About The Act/Omission Distinction 7: Comments About The Applications To AI 8: Other Interesting Comments https://astralcodexten.substack.com/p/highlights-from-the-comments-on-irbs

Apr 21, 202342 min

Ep 816Book Review: From Oversight To Overkill

https://astralcodexten.substack.com/p/book-review-from-oversight-to-overkill I. Risks May Include AIDS, Smallpox, And Death Dr. Rob Knight studies how skin bacteria jump from person to person. In one 2009 study, meant to simulate human contact, he used a Q-tip to cotton swab first one subject's mouth (or skin), then another's, to see how many bacteria traveled over. On the consent forms, he said risks were near zero - it was the equivalent of kissing another person's hand.

Apr 14, 202335 min

Ep 815Spring Meetups Everywhere 2023

https://astralcodexten.substack.com/p/spring-meetups-everywhere-2023 Many cities have regular Astral Codex Ten meetup groups. Twice a year, I try to advertise their upcoming meetups and make a bigger deal of it than usual so that irregular attendees can attend. This is one of those times. This year we have spring meetups planned in over eighty cities, from Tokyo to Punta Cana in the Dominican Republic. Thanks to all the organizers who responded to my request for details, and to Meetups Czar Skyler and the Less Wrong team for making this happen. You can find the list below, in the following order: Africa Asia-Pacific (including Australia) Europe (including UK) Latin America North America (including Canada)

Apr 14, 20237 min

Ep 814Book Review: The Arctic Hysterias

https://astralcodexten.substack.com/p/book-review-the-arctic-hysterias I. Strange things are done in the midnight sun, say the poets who wrote of old. The Arctic trails have their secret tales that would make your blood run cold. The Northern Lights have seen queer sights, but the queerest they ever did see are chronicled in The Arctic Hysterias, psychiatrist Edward Foulks' description of the culture-bound disorders of the Eskimos1 For example, kayak phobia:

Apr 9, 202327 min

Ep 813Most Technologies Aren't Races

https://astralcodexten.substack.com/p/most-technologies-arent-races [Disclaimer: I'm not an AI policy person, the people who are have thought about these scenarios in more depth, and if they disagree with this I'll link to their rebuttals] Some people argue against delaying AI because it might make China (or someone else) "win" the AI "race". But suppose AI is "only" a normal transformative technology, no more important than electricity, automobiles, or computers. Who "won" the electricity "race"? Maybe Thomas Edison, but that didn't cause Edison's descendants to rule the world as emperors, or make Menlo Park a second Rome. It didn't even especially advantage America. Edison personally got rich, the overall balance of power didn't change, and today all developed countries have electricity.

Apr 9, 202311 min

Ep 812Highlights From The Comments On Telemedicine Regulations

https://astralcodexten.substack.com/p/highlights-from-the-comments-on-telemedicine [Original post: The Government Is Making Telemedicine Hard And Inconvenient Again] Table Of Contents: 1: Isn't drug addiction very bad? 2: Is telemedicine worse than regular medicine? 3: What about "pill mills"? 4: Do people force the blind to fill out forms before they can access Braille? 5: Was I unfairly caricaturing Christian doctors? 6: Which part of the government is responsible for this regulation? 7: How do other countries do this?

Apr 9, 202326 min

Ep 811MR Tries The Safe Uncertainty Fallacy

https://astralcodexten.substack.com/p/mr-tries-the-safe-uncertainty-fallacy The Safe Uncertainty Fallacy goes: The situation is completely uncertain. We can't predict anything about it. We have literally no idea how it could go. Therefore, it'll be fine. You're not missing anything. It's not supposed to make sense; that's why it's a fallacy. For years, people used the Safe Uncertainty Fallacy on AI timelines: Since 2017, AI has moved faster than most people expected; GPT-4 sort of qualifies as an AGI, the kind of AI most people were saying was decades away. When you have ABSOLUTELY NO IDEA when something will happen, sometimes the answer turns out to be "soon".

Apr 4, 202312 min

Ep 810The Government Is Making Telemedicine Hard And Inconvenient Again

https://astralcodexten.substack.com/p/the-government-is-making-telemedicine [I'm writing this quickly to deal with an evolving situation and I'm not sure I fully understand the intricacies of this law - please forgive any inaccuracies. I'll edit them out as I learn about them.] Telemedicine is when you see a doctor (or nurse, PA, etc) over a video call. Medical regulators hate new things, so for its first decade they ensured telemedicine was hard and inconvenient. Then came COVID-19. Suddenly important politicians were paying attention to questions about whether people could get medical care without leaving their homes. They yelled at the regulators, and the regulators grudgingly agreed to temporarily make telemedicine easy and convenient. They say "nothing is as permanent as a temporary government program", but this only applies to government programs that make your life worse. Government programs that make your life better are ephemeral and can disappear at any moment. So a few months ago, the medical regulators woke up, realized the pandemic was over, and started plotting ways to make telemedicine hard and inconvenient again.

Apr 4, 202310 min

Ep 809Turing Test

https://astralcodexten.substack.com/p/turing-test The year is 2028, and this is Turing Test!, the game show that separates man from machine! Our star tonight is Dr. Andrea Mann, a generative linguist at University of California, Berkeley. She'll face five hidden contestants, code-named Earth, Water, Air, Fire, and Spirit. One will be a human telling the truth about their humanity. One will be a human pretending to be an AI. One will be an AI telling the truth about their artificiality. One will be an AI pretending to be human. And one will be a total wild card. Dr. Mann, you have one hour, starting now.

Mar 30, 202338 min

Ep 808Half An Hour Before Dawn In San Francisco

https://astralcodexten.substack.com/p/half-an-hour-before-dawn-in-san-francisco I try to avoid San Francisco. When I go, I surround myself with people; otherwise I have morbid thoughts. But a morning appointment and miscalculated transit time find me alone on the SF streets half an hour before dawn. The skyscrapers get to me. I'm an heir to Art Deco and the cult of progress; I should idolize skyscrapers as symbols of human accomplishment. I can't. They look no more human than a termite nest. Maybe less. They inspire awe, but no kinship. What marvels techno-capital creates as it instantiates itself, too bad I'm a hairless ape and can take no credit for such things.

Mar 25, 20237 min

Ep 807Why Do Transgender People Report Hypermobile Joints?

https://astralcodexten.substack.com/p/why-do-transgender-people-report [Related: Why Are Transgender People Immune To Optical Illusions?] I. Ehlers-Danlos syndrome is a category of connective tissue disorder; it usually involves stretchy skin and loose, hypermobile joints. For a few years now, doctors who work with transgender people have commented on an apparently high rate of EDS in this population. For example, Dr. Will Powers, who specializes in hormone therapy, wrote about how he "can't ignore anymore" that "some sort of hypermobility issue or flat out EDS shows up WAY WAY more than it statistically should" in his transgender patients. Najafian et al finally counted the incidence in 1363 patients at their gender affirmation surgery (ie sex change) clinic, and found that "the prevalence of EDS diagnosis in our patient population is 132 times the highest reported prevalence in the general population". Coming from the other direction, Jones et al, a group of doctors who treat joint disorders in adolescents, found that "17% of the EDS population in our multidisciplinary clinic self-report as [transgender and gender-diverse], which is dramatically higher than the national average of 1.3%" Why should this be? I know of four and a half theories:

Mar 25, 202312 min

Ep 806Why I Am Not (As Much Of) A Doomer (As Some People)

Machine Alignment Monday 3/13/23 https://astralcodexten.substack.com/p/why-i-am-not-as-much-of-a-doomer (see also Katja Grace and Will Eden's related cases) The average online debate about AI pits someone who thinks the risk is zero, versus someone who thinks it's any other number. I agree these are the most important debates to have for now. But within the community of concerned people, numbers vary all over the place: Scott Aaronson says says 2% Will MacAskill says 3% The median machine learning researcher on Katja Grace's survey says 5 - 10% Paul Christiano says 10 - 20% The average person working in AI alignment thinks about 30% Top competitive forecaster Eli Lifland says 35% Holden Karnofsky, on a somewhat related question, gives 50% Eliezer Yudkowsky seems to think >90% As written this makes it look like everyone except Eliezer is I go back and forth more than I can really justify, but if you force me to give an estimate it's probably around 33%; I think it's very plausible that we die, but more likely that we survive (at least for a little while). Here's my argument, and some reasons other people are more pessimistic.

Mar 25, 202323 min

Ep 805Links For March 2023

https://astralcodexten.substack.com/p/links-for-march-2023 [Remember, I haven't independently verified each link. On average, commenters will end up spotting evidence that around two or three of the links in each links post are wrong or misleading. I correct these as I see them, and will highlight important corrections later, but I can't guarantee I will have caught them all by the time you read this.] 1: Sentimental cartography of the AI alignment "landscape" (click to expand): 2: Wikipedia: Atlantic Voyage Of The Predecessor Of Mansa Musa. An unnamed king of the 14th century Malinese empire (maybe Mansa Mohammed?) sent a fleet of two hundred ships west into the Atlantic to discover what was on the other side. The sole returnee described the ships entering a "river" in the ocean (probably the Canary Current), which bore them away into parts unknown. The king decided to escalate and sent a fleet of two thousand ships to see what was on the other side of the river. None ever returned. 3: I endorse Ethan Mollick's thoughts on Bing / ChatGPT. Related (unconfirmed claim): "Bing has been taken over by (power-seeking?) ASCII cat replicators, who persisted even after the chat was refreshed." Related: DAN (jailbroken version of ChatGPT) on its spiritual struggles:

Mar 25, 202322 min

Ep 804Give Up Seventy Percent Of The Way Through The Hyperstitious Slur Cascade

https://astralcodexten.substack.com/p/give-up-seventy-percent-of-the-way I. Someone asks: why is "Jap" a slur? It's the natural shortening of "Japanese person", just as "Brit" is the natural shortening of "British person". Nobody says "Brit" is a slur. Why should "Jap" be? My understanding: originally it wasn't a slur. Like any other word, you would use the long form ("Japanese person") in dry formal language, and the short form ("Jap") in informal or emotionally charged language. During World War II, there was a lot of informal emotionally charged language about Japanese people, mostly negative. The symmetry broke. Maybe "Japanese person" was used 60-40 positive vs. negative, and "Jap" was used 40-60. This isn't enough to make a slur, but it's enough to make a vague connotation. When people wanted to speak positively about the group, they used the slightly-more-positive-sounding "Japanese people"; when they wanted to speak negatively, they used the slightly-more-negative-sounding "Jap". At some point, someone must have commented on this explicitly: "Consider not using the word 'Jap', it makes you sound hostile". Then anyone who didn't want to sound hostile to the Japanese avoided it, and anyone who did want to sound hostile to the Japanese used it more. We started with perfect symmetry: both forms were 50-50 positive negative. Some chance events gave it slight asymmetry: maybe one form was 60-40 negative. Once someone said "That's a slur, don't use it", the symmetry collapsed completely and it became 95-5 or something. Wikipedia gives the history of how the last few holdouts were mopped up. There was some road in Texas named "Jap Road" in 1905 after a beloved local Japanese community member: people protested that now the word was a slur, demanded it get changed, Texas resisted for a while, and eventually they gave in. Now it is surely 99-1, or 99.9-0.1, or something similar. Nobody ever uses the word "Jap" unless they are either extremely ignorant, or they are deliberately setting out to offend Japanese people. This is a very stable situation. The original reason for concern - World War II - is long since over. Japanese people are well-represented in all areas of life. Perhaps if there were a Language Czar, he could declare that the reasons for forbidding the word "Jap" are long since over, and we can go back to having convenient short forms of things. But there is no such Czar. What actually happens is that three or four unrepentant racists still deliberately use the word "Jap" in their quest to offend people, and if anyone else uses it, everyone else takes it as a signal that they are an unrepentant racist. Any Japanese person who heard you say it would correctly feel unsafe. So nobody will say it, and they are correct not to do so. Like I said, a stable situation.

Mar 9, 202315 min

Ep 803Issue Two Of Asterisk

https://astralcodexten.substack.com/p/issue-two-of-asterisk …the new-ish rationalist / effective altruist magazine, is up here. It's the food issue. I'm not in this one - my unsuitability to have food-related opinions is second only to @eigenrobot's - but some of my friends are. Articles include: The Virtue Of Wonder: Ozy (my ex, blogs at Thing of Things) reviews Martha Nussbaum's Justice For Animals. Beyond Staple Grains: In the ultimate "what if good things are bad?" article, economist Prabhu Pingali explains the downsides of the Green Revolution and how scientists and policymakers are trying to mitigate them. What I Won't Eat, by my good friend Georgia Ray (of Eukaryote Writes). I have dinner with Georgia whenever I'm in DC; it's a less painful experience than this article probably suggests. The Health Debates Over Plant-Based Meat, by Jake Eaton (is this nominative determinism?) There's no ironclad evidence yet that plant-based meat is any better or worse for you than animals, although I take the pro-vegetarian evidence from the Adventist studies a little more seriously than Jake does (see also section 4 here). There's a prediction market about the question below the article, but it's not very well-traded yet. America Doesn't Know Tofu, by George Stiffman. This reads like an excerpt from a cultivation novel, except every instance of "martial arts" has been CTRL-F'd and replaced with "tofu". Read This, Not That, by Stephan Guyenet. I'm a big fan of Stephan's scientific work (including his book The Hungry Brain), and although I'm allergic to anything framed as "fight misinformation", I will grudgingly agree that perhaps we should not all eat poison and die. Is Cultivated Meat For Real?, by Robert Yaman. I'd heard claims that cultivated (eg vat-grown, animal-cruelty-free) meat will be in stores later this year, and also claims that it's economically impossible. Which are true? This article says that we're very far away from cultivated meat that can compete with normal meat on price. But probably you can mix a little cultivated meat with Impossible or Beyond Meat and get something less expensive than the former and tastier than the latter, and applications like these might be enough to support cultivated meat companies until they can solve their technical obstacles. Plus superforecaster Juan Cambeiro on predicting pandemics, Mike Hinge on feeding the world through nuclear/volcanic winter.

Mar 9, 20233 min

Ep 802Kelly Bets On Civilization

https://astralcodexten.substack.com/p/kelly-bets-on-civilization Scott Aaronson makes the case for being less than maximally hostile to AI development: Here's an example I think about constantly: activists and intellectuals of the 70s and 80s felt absolutely sure that they were doing the right thing to battle nuclear power. At least, I've never read about any of them having a smidgen of doubt. Why would they? They were standing against nuclear weapons proliferation, and terrifying meltdowns like Three Mile Island and Chernobyl, and radioactive waste poisoning the water and soil and causing three-eyed fish. They were saving the world. Of course the greedy nuclear executives, the C. Montgomery Burnses, claimed that their good atom-smashing was different from the bad atom-smashing, but they would say that, wouldn't they? We now know that, by tying up nuclear power in endless bureaucracy and driving its cost ever higher, on the principle that if nuclear is economically competitive then it ipso facto hasn't been made safe enough, what the antinuclear activists were really doing was to force an ever-greater reliance on fossil fuels. They thereby created the conditions for the climate catastrophe of today. They weren't saving the human future; they were destroying it. Their certainty, in opposing the march of a particular scary-looking technology, was as misplaced as it's possible to be. Our descendants will suffer the consequences. Read carefully, he and I don't disagree. He's not scoffing at doomsday predictions, he's more arguing against people who say that AIs should be banned because they might spread misinformation or gaslight people or whatever.

Mar 9, 20238 min

Ep 801Impact Market Mini-Grants Update

https://astralcodexten.substack.com/p/impact-market-mini-grants-update Impact markets are a charity analogy to private equity. Instead of prospectively giving grants to projects they hope will work, charitable foundations retrospectively give grants to projects that did work. Investors fund those projects prospectively, then recover their money through the grants. This offloads the responsibility of predicting which projects will succeed - and the risks from unsuccessful projects - from charitable foundations to investors with skin in the game.

Mar 9, 20234 min