The Truth About Paywall Evasion, AI, Google, and Passwords

Download MP3

Pete (00:00)
today we're gonna talk about the classic question that we get all the time, which is how easy is it to defeat your paywall? This is a question that actually came in last week or a couple of weeks ago from a publisher. every, you know, I'd say every month someone's asking the question, how easy is it to defeat your paywall or a paywall? Should I worry about it? And...

⁓ they want to know what they can do to stop Google, from indexing everything from subscribers, from sharing passwords. And now of course AI from basically scraping all their content. so the title for this is the truth about paywall evasion, AI, Google, and passwords.

Hey Tyler, how are you? yes, happy Monday. And so I thought we would do, I went back and looked at the, ⁓

Tyler (01:12)
Good, good, good to see you.

Pete (01:20)
recordings we've had before. We haven't really nailed this one. ⁓ So I thought it would be good. And we did one on ⁓ all the little friction points not too long ago. One of those was disabling right click and worrying about ad blockers and all that. And the answer is don't do any of that, of course, but go back and listen to that episode if you need to. ⁓ This one is going to be really focused on ⁓ content, ⁓ you know, protection.

and sharing passwords. And so do you need to do it? That's the question we're going to answer in this podcast. All right. Let's talk a little bit about what Google does to your site, what AI is now doing to your site. And it is true, right? Like Google, you know, especially with Gemini AI, it's now ingesting all your content. If you have a metered paywall, a soft paywall, or no paywall, then yeah, all your content is being pulled into AI.

Google searches indexing everything. ⁓ but as a benefit, your everything is being shared socially. And that's, that's the advantage of, not having a paywall or having a, a soft paywall. So, generally speaking, you have, you have two options when it comes to setting up your paywall. One is metered or soft or leaky, whatever you want to call it. And the other is hard paywall where like, like the wall street journal where you just.

Lock down everything. And I want to talk about the pros and cons of both setups. And then there are a couple of options in there that we can, that you can also do. Okay. So just to continue on the metered side, the meter paywall is essentially you're allowing one or more free articles before you're asking the reader to subscribe. That that's, that's how it works. and that lets

You know, the big benefit is you get, you get social sharing. So as long as you're linking one free article, then everyone that comes to your site can grab whatever article they want, put it in Facebook, put it in LinkedIn, put it wherever they want. Right. That's a huge plus. if you lock down your content, that stops the hard paywall.

The meter paywall also, I don't know, I don't know you think about this, but I think the meter paywall just gives the reader, generally speaking, a better experience on your site. You're, ⁓ you have the opportunity for a free registration on the site, which would let the reader drop off their email and get more content. And, ⁓ you're not, you're not annoying right away. And it's great for publishers that are kind of early in their subscription, their paywall journey.

If you need to build your list, ⁓ if you need to build your brand, then ⁓ the metered setup is really the winner for you. Okay. ⁓ I want to compare that and so I want to compare that to the hard paywall setup, which is the draconian way to ⁓ manage your content where you're basically saying, nope, you don't get access unless you pay, right?

And then there's a little bit of a hybrid system with the free registration, which I want to talk about. Now, ⁓ the hard paywall. Let's just take a, I want to share my screen here and let's take a view at, let's see if I can do this here.

Let's take a view at a little bit of data here. ⁓ what I did was, is this, I remember what, podcast this was in, but the spreadsheet you're looking at, if you're, we're looking at here is all about, some local news publishers across the country, the U S and how many, paid subscribers they have percentage of population. So this is something I extrapolated from some data from Statista. It's.

really cool data and it shows you what the possibilities are. So, ⁓ if I look at, and, and really the meter paywall, the hard paywall, the hybrid paywall, they all work depending on where you are in your, in your journey. and I want to look at like the meter paywall first. So this is, ⁓ one of the subscribers on our publishers on this list is Nola.com. They serve the Baton Rouge area, right?

And they have, ⁓ their, their market penetration is over 9%. And this is as of a year or two ago, 9 % of their population says, Hey, here's my money, whether it's print or digital, they're absolutely turning into subscribers. So I pulled up their site and I said, well, what kind of, what kind of site do we have here? So I'm on NOLA.com and this is an article, ⁓ that I clicked into and lo and behold, we have ourselves a metered paywall.

We have one article here that I'm getting without having to do anything. Now, if I go past this article, yeah, I got to pay basically. I got to subscribe, but I just want to show that, the, the metered paywall does the soft paywall does work. Yes. AI is ingesting and Google is ingesting and, you might be freaking out about that, but, ⁓ on the balance, the benefit

Of getting the content into search, the benefit of getting your content into sort of the social sharing groove, which is social sharing, but it's also email sharing. Don't forget about email. is actually viral. It's a very good viral ⁓ part of it. It doesn't matter to them. It's working. So, so that's the, that's the metered approach. So if you're the publisher who's, who's still building your audience, you're building your brand.

I'd say just based on this data, would say, don't worry about the sharing. What do you think, Tyler?

Tyler (07:18)
Yeah, for sure. And I see publishers almost weekly that ask about how do I block AI? How do I lock this down? you know, ultimately you sort of are playing a game of whack-a-mole that ends up hurting, that can end up hurting your paid subscriber totals. So is it a problem? Is it, you know, great that AI is scraping our data? No, not really. It's not exactly exciting for a publisher to know that.

⁓ But if you don't allow people to test your content, get a taste of what you offer, it can be extremely hard for you to convert them to a paid subscriber.

Pete (08:05)
Yeah. It's the freemium model, right? It's the, yeah, give, give someone something and they'll like it. ⁓ and then they want more and they, and as far as metering goes, ⁓ let's just kind of talk a little bit about the free registration because yes, I mean, AI is a threat. Don't, I'm not saying it's not. It certainly is. And something you got to be considering at this point in time. The priority really is growing your email list.

Tyler (08:08)
Yeah.

Pete (08:35)
So if you're gonna, if you're still at that, in that mode where you're, you're growing your audience, growing your brand, ⁓ you're not the wall street journal, ⁓ then absolutely you have to put in a registration wall. So the meter set to one free article that's don't give away any more content on that second article, pop the free registration, let people drop in their email, choose a password and then.

give them one or two more free articles, depending on your volume. And that will build your list faster than anything you're doing right now. And your email list is your, is the way you control your future. Cause if your email list is growing, this is your data. This is first party data. You're not. You can, and this is again, previous podcasts, you, you absolutely can stop worrying about social and search and AI at this point in time.

because you're in charge with your list. You'll find that it will grow your traffic, grow your ad revenue, convert more paying subscribers. It'll do everything you want to do as a publisher. Okay. We did our free registration soapbox thing. ⁓ Anything to add on that? think that's, I'd say if there's one takeaway here is the free registration component for the metered setup.

Tyler (09:47)
You

Yeah.

for sure, for sure, and this might be skipping ahead, but if you are completely panicked about AI and the scraping of that, one alternative to that would be to just blanket the site with a free registration sign up. you know, regardless of any piece of content that you land on, you're gonna require people to sign up for free. So that's, yes, it's still a gate, and yes, it would stop AI from scraping.

Pete (10:08)
Mm-hmm.

Tyler (10:31)
and it does add some friction, at least you're collecting an email address and you can target these readers into nudging them into that paid funnel journey.

Pete (10:32)
Right.

Tyler, that was the perfect segue. Thank you. Right. So now we're really stepping into hard paywall. So you're at the point where you just need to lock down your content and the metered approach and the hard approach are both valid approaches depending on your situation. But if you look at ⁓ what the New York times is doing, they're doing exactly what Tyler just said. So it's, it's a hard wall. In other words, they're essentially locking out AI and social sharing.

But they're letting you register here, ⁓ for free and you'll get a limited number of free articles. So you'll get more content that is, that is a really good approach when you're sort of ending your, know, you're feeling confident and you're kind of, you're building your list, but you know, you need to lock down your content. So it depends on the type of publishing you're doing too. Like we have financial publishers, a number of them, and they're, they've been locking their content early in the game.

Like they know that their content is super valuable. And when they publish an article, it's like seconds to make a decision on a stock ⁓ purchase. so boom, you know, they need to lock, lock this stuff, stuff down for paid subscribers. Local news kind of depends on where you are. You're starting up. Yeah. For your registration metered. Perfect way to do it. ⁓ You've built a lot of confidence, built a big audience, like a brief site, just lock it down. Right. Just.

Just if you have a big list, you get the newsletter going, you can still ask for, you can still do the newsletter pop-up on the hard wall and continue to trickle in that list, great. ⁓ But you know your content's valuable and you're striking the right chord and it's time to lock it down. So that's valid. Okay. So ⁓ one thing I will note is there is a service called removepaywall.com and there are other.

services that do this and the idea is that you can drop a URL into ⁓ Remove paywall and get around the paywall and it works some of the time. Maybe most of the time not all the time ⁓ Should you worry about remove paywall that is that is the question Tyler you want to take a stab at that?

Tyler (13:05)
My answer would be very similar to AI and that the readers who are going to those kinds of sites to try to bypass your paywall, that slim percentage will never ever ever ever pay for a subscription on your website. So no matter what you do, they're just not going to sign up for a paid subscription.

I wouldn't worry too much about it. And I would also say that if you're running leaky paywall, there is a function called IP blocker, which will effectively stop these removed paywall ⁓ systems from dropping ⁓ your wall on your content. So there are ways around it, but again, it's not something that I would worry about too much.

Pete (13:57)
Yeah, totally agree. That's not your customer. And I'll also say that if, if people are spending time to get around technology, ⁓ they, they haven't sort of hit that point in their, maybe in their life or career where their time is, you know, more valuable than money, right? You know, we're, most of us are really, ⁓ valuing time. And so the hassle,

and frustration and time you have to take to get around something. I mean, I remember back in, you know, when I was really young, like, you know, you, and Napster was around and now I'm dating myself and you'd spend time downloading music and, it took a lot of time, but you know, as you start like working and making money and all of a you don't have the time to do these things. And so you're, you're prioritizing convenience. So all you have to do is make it convenient to pay for content and most of your audience will do it.

Tyler (14:56)
Yeah, that's...

Pete (14:57)
These, these people, these,

let me just finish one thing before I forget. And then the, even the folks that have the time to get around your content, they might actually also be sharing your content. They're spending a lot of time in your content. They might very well like, Hey, here's a great article, right. And send it to a friend or, or, or post the full article on social or whatever they do that you might think is nonsense. It doesn't matter. You're getting exposure from them to their audience.

Tyler (15:00)
Yeah.

Yeah, you reminded me of ⁓ something years ago I read that publishers tend to panic about younger readers not signing up to their sites and paying for news or whatever. Like, Gen Z's not paying or Millennials aren't paying or whatever. And I'm like, well, of course, because they're not quite—

Pete (15:43)
Mm-hmm. Mm-hmm.

Tyler (15:48)
to a point in their journey of life where they've got a stake in the community and they're paying taxes and things like that. So typically as people age they tend to get ⁓ more likely to subscribe to your publications. Just something I wanted to point out.

Pete (16:03)
Yeah,

for sure. Yeah, absolutely. Yeah. Don't worry about it. ⁓ one last thing is if you are, ⁓ and just a note of how things work, this is kind of a leaky paywall thing, but with remove paywall, you need to put in order to actually block these services from, ⁓ ingesting your content, including AI is you need, when you publish your article, you need to lock that article down right away.

So you can't keep it open for a day and then lock it down and expect it to be locked out of AI and remove paywall and others. because they're just too quick to pull your feed in and ingest that. if you have a category of content that you're locking down, just make sure it's always locked down when you publish it. ⁓ If you're thinking about locking, if you're sort of metering now and you're thinking, geez, I might have to lock things down and you're ready to pull a trigger.

That's great. Do the free registration, you know, zero articles you have to register in order to get more that will keep all these services and AI out. Kind of like what the New York Times is doing. And then the last sort of ⁓ part of the subscription life cycle is kind of what the Wall Street Journal is doing is essentially there is no access unless you pay, you know, they have a strong brand, the financial following, their readers.

tend to be wealthier ⁓ and they can afford to pay what they charge and they essentially made the decision, our content has high value and you just have to pay for it and it works. ⁓ are the two and a half ways to meter your content.

Tyler (17:53)
Yeah, financial publishers have it a little easier, I would say, than most of the other publishers in terms of getting people to pay for access, a lot of their content is directly related to the wallet, and people are willing to pay a little money to figure out how to grow that. ⁓

Pete (17:58)
for sure.

Right. Yeah,

exactly. last thing I want to, I want to wrap up on is password sharing. That's another, that's another big one. ⁓ I don't want people to, you know, just share, share, ⁓ one password to, ⁓ a thousand people or 10 people or whatnot. And, ⁓ once you get into, especially if you're, know, if you're selling content, essentially that targets like B2B where organizations start getting interested.

in your content, you know, you'll get, and I heard, actually heard this on threads the other day, somebody I sort of been tracking and chatting with a little bit. And, ⁓ he was saying that B2B customers are starting to pick up his product that he's essentially metering and, you know, he's thinking, Jesus, I got one organization that just subscribed. know, you know, it's a big, you know, it's like a fortune 1000 organization. It's like,

Okay. There are a thousand people now that are logged into my site. So what do you do now in that kind of an extreme situation, you might want to consider. Locking down concurrent logins, which is what it's called. So how many people are logged into your site simultaneously? If you're doing local news, if you're a magazine publisher, ⁓ you probably should not worry about that too much again. ⁓ now the solution is there. You can go to.

forget what the name of, there several WordPress plugins. I think it's Limit Active Logins is the name of the one we recommend. You can install that. You can decide how many, you you get like five concurrent logins running on your site. ⁓ But what's going to happen is, is you're going to, you're going to get some administrative ⁓ friction back at you with people who are like, Hey, I can't log in or, you know, the experience isn't as smooth as just logging in every single time and not being bothered.

Right. So you have sort of this, this little bit of downside, but yeah, Netflix is doing it. You know, there, lot of streaming services are now like getting us used to, Hey, you know, you got to log out a device to log in the next device. they're creating a little bit of friction. ⁓ we're getting used to it. If you're looking to do it, it's not a terrible idea, but you, may get some, some pushback on, or, or just some emails. have to deal with people having trouble logging in.

Um, one thing I might suggest if you're in the, uh, family plan potential arena is do that, sell a family plan, right? Like if you're, if you're doing local news or magazine or something, and you have a, let's say your subscription, your subscription is nine bucks a month just to pick a number, do a 13 a month and you get five seats, right? For family members or enthusiasts or whatever content arena you're in. You don't even need to.

set up any kind of ⁓ a limit on logins. Just sell it upfront and you'll find that people will opt in for their family. You're giving essentially people a chance to support you in a bigger way. Okay Tyler, I think we covered anything else. Any final thoughts?

Tyler (21:27)
Yeah, the takeaway is not to panic too much and to focus on growing the email list per usual, right?

Pete (21:34)
Bingo. That's

right. Yep. If you're metering, go with the, and you're thinking about it. Yeah. If you go hard wall, put in the registration wall. So at least you can get people past the wall with an article or two. Make sure you use IP blockers. So it's just not super easy to right click and go incognito that blocks that. And, yep. And that'll, that'll lock out AI and search and, it'll do a number on, on sharing, but if that's where you are, that's the way to do it. So, all right.

Till next time, see ya.

The Truth About Paywall Evasion, AI, Google, and Passwords
Broadcast by