My Favorite Podcasts (And Why I Stopped Listening to Most

I used to listen to 15+ podcasts. I was that person in the car, at the gym, during walks — always playing something. I thought I was learning, staying informed, making every minute count.

Then I actually paid attention to what stuck.

Almost nothing. I’d finish an episode and remember maybe one idea, if I was lucky. The rest evaporated the moment I switched to a different podcast. I was consuming constantly but retaining almost nothing.

The shift happened when I stopped treating podcasts like background fill and started treating them like actual learning. That meant unsubscribing from 11 podcasts, accepting that I wasn’t going to “stay on top of everything,” and doubling down on the ones where I actually came away changed.

Here’s what I learned about podcasts, why I stopped listening to most of them, and which ones actually earn their time.

Why Podcasts Are Deceptively Addictive (And Worthless)

Podcasts feel productive. You’re learning while doing other things. No time wasted, right?

Wrong.

Here’s the problem: your brain can’t actually concentrate on something complex while doing something physical. When you’re driving or walking, you’re on autopilot. The podcast plays, but you’re not there. You’re following the thread loosely, catching maybe 30% of what matters.

Then there’s volume. A 90-minute podcast every week adds up to 390 hours a year. Most people listen to 3-5 regularly. That’s 1,200-2,000 hours annually. For perspective, that’s the equivalent of a full-time job. You wouldn’t hire someone to work full-time if they only retained 30% of what they were supposed to do.

The worst part? Podcasts are designed to feel essential. New episodes drop on a schedule. The hosts build parasocial relationships with you. You feel obligated to keep up. It’s FOMO in audio form.

Most podcasts don’t justify that time. They’re entertainment dressed up as education.

The Ruthless Filter I Actually Use

I stopped listening to most podcasts because they failed one test: Did I take action on this, think about it later, or change my mind because of it?

Not “Was it interesting?” Interesting is worthless.

Not “Did I learn a fact?” Facts without context or application are noise.

Just: Did this actually change how I think or what I do?

By that standard, most podcasts fail immediately. You listen, feel momentarily stimulated, and forget. The time is gone. The learning isn’t.

Here’s my brutal filter:

Keep only if: The ideas are surprising enough to mention to someone else. The actionable advice is specific enough to apply this week. The host’s perspective genuinely shifts how you see something.

Unsubscribe if: You listen out of habit, not interest. Episodes feel like background noise. You couldn’t explain the main idea to someone 24 hours later.

The Podcasts That Actually Stay

I listen to four regularly. That’s it. Everything else got cut.

The Tim Ferriss Show

Specific, explorable interviews with people who’ve done unusual things. The depth varies wildly — some episodes are throwaway, others are essential. But when it hits, it hits hard. Ferriss asks better questions than most interviewers. He follows threads. He doesn’t settle for surface answers.

Why it stays: The best episodes (usually with people I’ve heard of) are worth 2-3 hours of my time. The mediocre ones I skip guilt-free.

Real use: I’ve borrowed frameworks and perspectives directly. This is one of the few shows where I take actual notes.

99% Invisible

Design, architecture, systems thinking. Short, tightly produced, focuses on one thing deeply. Each episode is complete in 20-35 minutes.

Why it stays: No filler. No padding. The editing is so clean that every minute matters. The topics are usually outside my normal thinking, which means actual expansion of perspective rather than confirmation of what I already know.

Real use: I reference specific episodes when explaining why design matters. It’s changed how I notice the invisible infrastructure around me.

The Knowledge Project

Interviews about decision-making, mental models, thinking systems. Similar format to Tim Ferriss but more focused on the epistemic side — how people know things, how they decide.

Why it stays: Directly applicable to work and life. The mental models stick because they’re repeatedly applied across different contexts (different guests, different fields, same underlying frameworks).

Real use: I’ve adopted specific decision-making processes and frameworks. This show is the most directly educational of the four.

Stuff You Should Know

Two hosts deep-diving into a single topic each week. Could be anything — spas, coffee, how diamonds are graded, why we have eyebrows. Thoroughly researched, genuinely curious hosts, actually fun to listen to.

Why it stays: It’s the only one I listen to purely for engagement. The learning is real but secondary. I actually enjoy it, which means I’m more likely to retain things and less likely to resent the time spent.

Real use: Mostly enjoyment and “interesting dinner conversation” material. But that matters. Not every hour needs to be purely productive.

Why Everything Else Got Cut

I used to listen to:

News-focused podcasts. They feel urgent. They’re not. By the time you hear the news, it’s already priced into the world. You’re getting analysis of things you can’t control. Unsubscribed.
General interest podcast networks. The hosts were charming. The episodes were fine. But “fine” isn’t enough. Nothing stuck. Unsubscribed.
Productivity and self-help podcasts. This is where I was wasting the most time. Same advice recycled, self-contradicting frameworks, hosts selling something. I could get the actual information faster from a book. Unsubscribed.
Industry-specific shows. The people interviewing were smart. But I wasn’t learning anything actionable for my specific context. Unsubscribed.

The pattern: I kept the podcasts with either exceptional depth (Ferriss, Knowledge Project) or exceptional quality of editing/execution (99% Invisible, SYSK). Everything that relied on volume or novelty got cut.

The Uncomfortable Truth

You probably listen to podcasts you don’t actually want to listen to.

You’re keeping them because:

You feel like you should stay informed
You’ve listened for years and feel obligated
They’re habits you never questioned
You’re afraid of missing something

You’re not going to miss anything. Important ideas don’t disappear. They propagate. If something truly matters, you’ll hear about it through multiple sources. The cost of missing a podcast episode is zero.

The cost of listening to 10 mediocre podcasts instead of reading one excellent book? That’s real. That’s time you don’t get back.

How This Connects to Everything Else

If you’re serious about learning, podcasts are your least efficient option. If you care about deep work and focus, podcasts are distraction laundered as productivity. They seem like they’re using your time wisely when really you’re just filling space.

That said, if you’re going to listen to podcasts, listen with intention. Digital minimalism isn’t about eliminating everything — it’s about being ruthless about what you keep. Same principle applies here.

And if you’re trying to learn anything efficiently, remember: deliberate practice beats passive consumption every single time. A podcast is passive. A book is more passive. Actually doing the thing is what builds competence. Podcasts are good for perspective, not for skill.

Your Action

Audit your podcast subscriptions today. Look at your subscribed list. Be honest: which ones do you listen to because you have to, not because you want to?

Unsubscribe from those.

The remaining ones — the ones you actually look forward to — keep those. Add nothing new unless it clears the “did this change how I think” bar.

You’ll have fewer podcasts. You’ll retain more. You’ll actually remember what you heard.

That’s not sacrifice. That’s upgrading your brain.