People with direct knowledge of YouTube Algorithm-why the repeats?

I don’t know anything about the algorithm, but my dumb lizard brain take is that I often find comfort in watching the same stuff again. Whenever a 3blue1brown video pops up in my feed again, it’s like seeing an old friend and I’ll watch to the end again.

I can think of many videos like this, that pop up in a feed after many years and you’ll see the comments like “see y’all again in a year when the algorithm brings this back” or “I always click when this video is recommended”.

I have several friends who’ll rewatch whole shows again and again for a similar reason. There’s the comfort of something familiar.

So I guess I don’t mind when youtube does this

Many people use Youtube for music, and that lends itself pretty strongly to repeated watches. It could be the algorithm doesn't perfectly differentiate between music watching habits and non-music watching habits, and applies lessons from one to the other.

I don't have direct knowledge but I know that many people re-watch Youtube videos. I know I've watched the Rickroll video many times (don't hate me; I actually like it).

Here is an old, deleted, reddit thread about people who re-watch the same Youtube video over and over: https://www.reddit.com/r/TooAfraidToAsk/comments/h7fqv9/is_i...

Hypothesis: There are two significant use cases you may not be considering, which make up a significant portion of YouTubes use cases:

1. Music, which often lends towards repeat content

2. Children as a demographic, which any parent will tell you will watch the exact same movie/show/video on repeat ad nauseam.

Because of these, it's likely that YouTube has found that repeats (in general) drive more engagement.

When i say ‘see something once why see it again?’ people look at me like i’m a psycho killer. The paradigm of doom scrolling and reload-scan-reload-scan-reload-scan are entrenched in western social media to the extent that foreign social media that ‘thinks different’ is considered dangerous, subversive, and both political parties are falling over each other to ban it.

i think people do like watching the same video more than once sometimes though.

I feel you, and where the algorithm is completely insane for me is in the YouTube Shorts section. I literally get the same videos in the same order multiple times during the week. It makes it feel like there's about 100-200 videos in total on Shorts, and I've seen them all. As a rip-off version of TikTok, where there's an endless stream of new content, you would imagine discovery would be the thing they would focus on in the algorithm the most.

You are not alone, if you watch three videos by Kyle Kulinski, you realize how rarely he has an original take.

But coming back to your question.

This question reminds me of a complaint that I heard from multiple people about Amazon: why is Amazon recommending me a product I just bought? Or a less generous manifestation of this sentiment "duh, Amazon is so stupid, it recommend something I bought give minutes ago".

In reality, people don't realize how often they buy the same and similar stuff again and again. You bought a usb hub for home, you like it, so you but it for the office. If you didn't like it, you may buy three different usb hubs to make sure you find a good one. You like a book, so you but the same for your sister as a gift. Bought some socks, you enjoy using them, so you buy another 10 so that you don't need to worry about socks for the next two years. You realize you love funny socks, so you keep buying more socks.

The same happens with videos. I don't mind watching a video about streams by Venkat Subramaniam every now and then. A conference talk about regex is recommended to me again?? Hmm, actually, I might watch it again because I don't remember half of it and I remember she prepared a great talk.

Boggles my mind how hundreds of hours of content id enjoy must be uploaded to YouTube a day yet to seems very intent on showing me things I’ve already watched or just the same videos for days on end that I didn’t click on the first 5 times they showed it me and I don’t intend to click on it on the 6th.

Then you check new for you and it’s weirdly just like normal fresh browser yt recs, not my algorithm.

It actually works really well for some viewing patterns. For myself, it's the best recommendation algorithm.

When I'm listening to 80s rock, it gives me a bunch of other 80s rock, notably including things I've enjoyed listening to before so I can just yoink that right into my playlist. Also throws in some 2000s dubstep and some 60's country that I like and a couple of things that I've never heard before in case I've started out on 80s rock but just am not feeling it tonight.

When I'm watching thought-provoking mini-documentaries, it gives me more by the same creator along with some random related stuff. Some of that is stuff I've watched before but might want to re-watch or share with someone. Or to compare the thoughts of this guy vs that guy.

Your usage pattern might be different. But for many of us, it works quite well. I would assume they're optimizing for the most common use cases. And yes, I liked that video, I do want to see it again.

I always use the "Not interested" and "Don't recommend channel" options when I visit YouTube. You really have to babysit the algorithm to get value from the recommendations beyond time wasting.

Watch this scene: https://youtu.be/LXaHbJhKWLc

I think that what he says pretty much applies to almost everything that seems sophisticated to us such as health tech, privacy tech, fin tech, anti-terrorism tech and of course user behavior prediction tech. A lot of people are convinced that what these companies do is highly sophisticated and very difficult to achieve in terms of algorithmics. Most of the things that look sophisticated are just mediocre at most, with a handful of companies just having successfully delivered on a handful of problems and pretending to have solved many others.

One of the reasons I suspect i they're failing at so many things is that these companies have focused extensively on hiring the brightest minds to solve the most difficult problems they had to solve 10-15 years ago.

During all this time they failed at solving simple problems that do not require the brightest minds in the world but just people who actually can discuss with other people and solve simple problems with their technologies.

You're perfectly legitimate in hoping that YouTube would have solved these problems but no, they haven't, they're actually quite weak at solving many simple things and it is crucial that the large audience doesn't realize that.

I have no knowledge of the algorithm

I do however watch “Picard make it so (let it snow)” every year. Some videos I’ll watch more than once throughout the year.

On the other hand it’s rare I’ll watch a Numberphile or Tom Scott video more than once, and when I do I deliberately seek it out

If recommendations had any intelligence they'd maybe list the next video in the same playlist, by the video author, as the top choice. It's infuriating. Getting to the playlist interface from a video is not even easy.

Youtube would benefit from going MVNO with a subscription model. Let others develop the algorithm as a subscription basis, be the content hub.

Charge for ads, get longer engagement, drop the nasty rabbit holes as other subscription models are more informative, etc. Encourage better content to boot.

There are a LOT of ways to organize their content model, their current model pains me as a consumer, an economist, and with due respect would be indistinguishable from a catastrophe of ego tripping product owners.

YouTube's recommendation engineers just aren't as good as you expect them to be.

For a long time, I have been curious why overfitting their recommendation model generates more revenue. My guess is that this is stark for kid-friendly content. If parents have noticed that a certain set of videos is safe for their children, they are likely to not deviate from that set.

Today, when I found this thread, I started looking for past HN threads discussing this topic. I came across a 2019 thread (https://news.ycombinator.com/item?id=18999326) where a similar discussion was held. In that post, a user mentioned the following:

> "Read the YouTube recommendation paper (https://ai.google/research/pubs/pub45530) and it will become clear why it recommends a ton of high-engagement, clickbait-y content based on a minimal set of recent watches."

I skimmed through the paper, and they have some interesting stuff in there! Maybe I should read it more carefully later. Here's some I found:

> We consistently observe that users prefer fresh content, though not at the expense of relevance. In addition to the first-order effect of simply recommending new videos that users want to watch, there is a critical secondary phenomenon of bootstrapping and propagating viral content.

> Consider as an example a case in which the user has just issued a search query for “taylor swift”. Since our problem is posed as predicting the next watched video, a classifier given this information will predict that the most likely videos to be watched are those which appear on the corresponding search results page for “taylor swift”. Unsurpisingly, reproducing the user’s last search page as homepage recommendations performs very poorly.

This is probably the most interesting one!

> We observe that the most important signals are those that describe a user’s previous interaction with the item itself and other similar items ... As an example, consider the user’s past history with the channel that uploaded the video being scored - how many videos has the user watched from this channel? When was the last time the user watched a video on this topic? These continuous features describing past user actions on related items are particularly powerful because they generalize well across disparate items...

I am finding that I use YouTube a lot less these days. Back in the late 2000s I remember when I watched a music video, the recommended videos would be other videos by the same artist. Now it's just videos I've watched before and unrelated videos. The front page is mostly videos I've watched before and ones that it has shown before that I didn't click on. So there is not much difference between the front page and the recommended videos section. It doesn't even really show new videos from channels I've subscribed to, I have to go to the subscriptions page and look for them there. So I just get bored easily and do something else. I tried the shorts page, but I have no interest in the toxic political and far right garbage from the US, since I'm from Australia, so that was useless. I even tried looking for a page that showed what live videos are currently playing, like a twitch page, but the only live page only had a few videos listed.

Similarly, if I only watch the first 10 minutes of a Netflix video and then turn it off, why does it then recommend similar content forever after that? I accidentally watched 5 minutes of a Polish show six months ago (I don't speak Polish and I don't like subtitles) and now I constantly get recommendations for Polish language shows.

In my experience the only thing that really works is "don't recommend this channel" option in the ellipsis menu, however recently I must have reached some limit because it is now showing me channels I've already blocked. My guess would be somewhere between 50~100 is the limit for blocked channels.

In recommendation systems in general, it's well known that recommending things based on recent activity far outperforms other methods (e.g. product category, past liked items, subscribed items, searched items).

For example, Hulu showed that recommending shows similar to "recently watched" rather than "watched in the past" increases CTR by 188%. In particular see the graph at the end which compares "recently watched" recommendations to other types: https://web.archive.org/web/20120130230618/http://tech.hulu....

I find myself often doing the, "don't recommend this video -> I've already seen it" option many many times.

I wish they would improve the algorithm to distinguish between things I want to replay like music versus things I want to see once like a documentary.

This is a great question and I have no idea why. But if I liked the video, I'm afraid to click "not interested" because I don't want Youtube to not recommend similar content in the future.

My YouTube recommendations list is constantly polluted with Joe Rogan, even though I've never watched a single video of his. One theory is it's because my friends/family watch a bunch of his videos, and the algorithm basically concludes "Fuck your personal tastes! You like what your friends like!"

Nothing against Joe Rogan. It's just weird how I get so many video recommendations for him, even though I've never watched one.

I have several untested theories regarding YouTube recommendation system. One of them is: is better to promote a video of a channel who's already monetized than it is to promote a video from a small channel (creating a new monetized channel). I don't know the bureaucracy behind paying channel owners, but it seems the algorithm favor those videos, even if you've already watched them.

Tbh, I'm often mindlessly watching stuff on youtube, it's mostly time I consider wasted anyway, there's rarely something really productive to do there. And, in that mode, I've watched many videos many times over. Comedians are a prime example of this. I think e.g. Rick Gervais gets rotate in my recommends once every couple of months, and I watch quite many of them.

I wonder if the censorship algorithms are getting too aggressive and that's messing up the suggestion algorithms.

I get the same short suggestions repeatedly but sometimes they're mixed in with very new, low quality stuff with no comments or likes.

My youtube time has gone down precipitously, which is a good thing for me, but not for youtube.

My gripe is that YouTube constantly shows me the same videos I didn't click on. A clue: if you've shown me this thing 3x and I never clicked on it I am not interested!

I agree: it makes it seem like there are a couple hundred videos on YouTube, and they keep trying to shove the same ones down my throat.

People often watch a video, and then show it to a friend. Hence, as far as the algorithm is concerned, thats a re-watch.

Obviously the algorithm has no way to know your friend isn't standing right there right now and demanding to be shown something you've already seen but think is cool...

I would also like to know the answer to my problem too:

Not interested ->Tell us why ->I've already watched the video

Not interested ->Tell us why ->I've already watched the video

Not interested ->Tell us why ->I've already watched the video

. . . . . . .

I would just like a way to block certain topics entirely.

I would assume that all the minecraft, sports, and vlogger stuff is what I get because it’s trending, but i also have zero interest in any of that stuff at all.

I have my watch history set to autodelete, and sometimes videos I’ve watched come back after they age out of the history, which makes sense.

>then have it recommended for days, weeks, or months after

Because it works. I'm ashamed to admit I rewatch a lot of videos on YouTube.

I just came here to say that now since there’s precedent, YouTube should os it’s underlying algorithm code.

Funny videos and music video are good candidates for repeats. I see these all the time in my feed.

eventual consistency?

Could it be something to do with Kyle Kulinksy or Jordan Peterson specifically? I.e. maybe other viewers who watch those videos have tendency to rewatch at some point in the future?

Scrolling through some of the comments on Jordan Peterson videos I have found that his fanbase does seem to be a little on the fanatical side. (Just to be clear this is not a knock against Jordan Peterson - I actually find him pretty interesting. Nor do I think his fans are uniquely fanatical - lots of YouTubers have fanatical fans. But because he is in the realm of self-help and politics, and he tends to be very opinionated, he does tend to attract some really hardcore fans who I could imagine rewatching his videos from time to time).

you liked a jordan peterson video, i think youtube assuming you want shit forced down your throat is not entirely crazy