Smarter feed finding (YouTube and Steam and Substack)

[ReedyBear]

It would be really cool if this site had the ability to find feeds that are not properly marked up for Steam and YouTube and Substack (and possibly other large platforms)

Steam:

Game page: https://store.steampowered.com/app/1972440/Shotgun_King_The_Final_Checkmate/
News Page: https://store.steampowered.com/news/app/1972440
News Feed: https://store.steampowered.com/feeds/news/app/1972440/

Proposal: When a steam game url is detected or the news page url, the news FEED url could be auto-determined and returned. It just requires copying the game's app id from the URL and constructing the news feed url with it.

YouTube:

Channel Page: https://www.youtube.com/NPR
Channel Feed: https://www.youtube.com/feeds/videos.xml?channel_id=UCJnS2EsPfv46u1JR8cnD0NA

Proposal: YouTube has hidden playlists, like a 'videos only' playlist. To get this, you take the feed url and modify it. First, channel_id becomes playlist_id, and then UC at the beginning of the channel id becomes UULF (for just 'Videos' tab) or another prefix.

So, channel feed url
https://www.youtube.com/feeds/videos.xml?channel_id=UCJnS2EsPfv46u1JR8cnD0NA
becomes
https://www.youtube.com/feeds/videos.xml?playlist_id=UULFJnS2EsPfv46u1JR8cnD0NA

Reference: https://stackoverflow.com/questions/71192605/how-do-i-get-youtube-shorts-from-youtube-api-data-v3/76602819#76602819

Substack:
Substack supports RSS, but doesn't have them marked up for the social pages. Solving this is much more complex than the steam and youtube solutions. If you want to implement this, I'd be happy to provide javascript code to collect a feed url from a page like https://substack.com/@govtrackus or https://substack.com/@theconsciouslee

[mratmeyer]

hi, thanks for the feedback. i actually started setting up something similar for Reddit, YouTube, GitHub, etc but it's not very organized or built out.

feel free to add rule logic for other sites you use. if we can start breaking new rules into their own files to be more organized that'd be ideal, but otherwise i'll organize it later when i get time.

[ReedyBear]

Oh sweet! Not making any commitments rn, but I might contribute sometime. And thanks for the link to the appropriate file.

[ReedyBear]

I sent PRs for youtube and steam.

It looks like if I want to do substack social pages, the code would need to go in https://github.com/mratmeyer/rsslookup/blob/main/worker/utils/parserUtils.js

I'm not personally equipped for setting that up, though. I can document.querySelector() my way through a document well enough, and could scrape the appropriate URLs from substack social pages that way. But I don't think I care to learn the html parser, and I wouldn't know how to set up the infrastructure in the project. So if you want to add substack, I can provide querySelector() type of scraping for it, but you'd have to do the rest. No biggie if not.

[ReedyBear]

I've done Steam & YouTube now and I will probably do substack at some point, too.