feat(route): add route for BBC Twitter accounts #15275

danilo-delbusso · 2024-04-17T18:43:45Z

Involved Issue / 该 PR 相关 Issue

N/A

Example for the Proposed Route(s) / 路由地址示例

/twitter/bbc-user/BBCBreaking
/twitter/bbc-user/BBCWorld
/twitter/bbc-user/BBCNews
/twitter/bbc-user/BBCNewsAsia
/twitter/bbc-user/BBCAfrica
/twitter/bbc-user/BBCBusiness
/twitter/bbc-user/BBCLondonNews
/twitter/bbc-user/BBCNorthAmerica
/twitter/bbc-user/BBCSport

New RSS Route Checklist / 新 RSS 路由检查表

New Route / 新的路由
- Follows Script Standard / 跟随路由规范
Anti-bot or rate limit / 反爬/频率限制
- If yes, do your code reflect this sign? / 如果有, 是否有对应的措施?
Date and time / 日期和时间
- Parsed / 可以解析
- Correct time zone / 时区正确
New package added / 添加了新的包
Puppeteer

Note / 说明

Reason for adding route

BBC Twitter accounts may contain feeds different from those available on bbc.co.uk or similar.

For instance, the Breaking News feed on Twitter contains fewer posts and is more relevant for just major news.

Based on existing routes

This route uses Twitter Feed fetched from matching BBC accounts, and then uses the existing BBC route to fetch the articles and add their content on the description, which avoids having to open the URLs. It also makes use of the twitter/user route as a base route to fetch the tweets in the first place.

Note this only works on BBC Twitter accounts that posts BBC Articles, such as twitter.com/BBCBreaking, twitter.com/BBCNews, twitter.com/BBCWorld, etc. More can be seen here: https://twitter.com/search?q=BBC&f=user

BBC Twitter accounts may contain feeds different from those available on bbc.co.uk or similar. For instance, the Breaking News feed on Twitter contains fewer posts and is more relevant for just major news. This route uses Twitter Feed fetched from BBC articles, and then uses the existing BBC route to fetch the articles and add their content on the `description`, which avoids having to open the URLs. It also makes use of the `twitter/user` route as a base route to fetch the tweets in the first place.

github-actions · 2024-04-17T18:48:18Z

Successfully generated as following:

http://localhost:1200/twitter/bbc-user/BBCBreaking - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCBreaking</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCWorld - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCWorld</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCNews - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCNews</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

github-actions · 2024-04-17T18:51:47Z

Successfully generated as following:

http://localhost:1200/twitter/bbc-user/BBCBreaking - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCBreaking</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCWorld - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCWorld</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCNews - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCNews</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

github-actions · 2024-04-17T18:55:59Z

Successfully generated as following:

http://localhost:1200/twitter/bbc-user/BBCBreaking - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCBreaking</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCWorld - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCWorld</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCNews - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCNews</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCNewsAsia - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCNewsAsia</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCAfrica - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCAfrica</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCBusiness - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCBusiness</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCLondonNews - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCLondonNews</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCNorthAmerica - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCNorthAmerica</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

http://localhost:1200/twitter/bbc-user/BBCSport - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/><code class="mt-2 block max-h-28 overflow-auto bg-zinc-100 align-bottom w-fit details">ConfigNotFoundError: Twitter API is not configured</code>
Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/:id/:routeParams?</code>
Full Route: <code class="ml-2 bg-zinc-100">/twitter/bbc-user/BBCSport</code>
Node Version: <code class="ml-2 bg-zinc-100">v21.7.3</code>
Git Hash: <code class="ml-2 bg-zinc-100">eb2a6028</code>

danilo-delbusso · 2024-04-19T13:32:09Z

Locally seems to work just fine - I assume all the 503 errors here are related to Twitter API / request limitations? Someone more knowledgeable might know

github-actions · 2024-05-12T23:31:57Z

This PR is stale because it has been opened for more than 3 weeks with no activity. Comment or this will be closed in 7 days.

danilo-delbusso · 2024-05-13T07:57:47Z

keep alive please

github-actions · 2024-06-06T23:32:06Z

This PR is stale because it has been opened for more than 3 weeks with no activity. Comment or this will be closed in 7 days.

danilo-delbusso · 2024-06-11T09:36:43Z

alive

github-actions · 2024-06-11T09:41:55Z

Successfully generated as following:

http://localhost:1200/twitter/bbc-user/BBCBreaking - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCBreaking
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCWorld - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCWorld
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCNews - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCNews
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCNewsAsia - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCNewsAsia
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCAfrica - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCAfrica
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCBusiness - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCBusiness
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCLondonNews - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCLondonNews
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCNorthAmerica - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCNorthAmerica
Node Version: v22.2.0
Git Hash: e943fd30

http://localhost:1200/twitter/bbc-user/BBCSport - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Twitter API is not configured
Route: /twitter/bbc-user/:id/:routeParams?
Full Route: /twitter/bbc-user/BBCSport
Node Version: v22.2.0
Git Hash: e943fd30

danilo-delbusso · 2024-06-11T10:38:54Z

not stale

github-actions · 2024-07-05T23:32:07Z

This PR is stale because it has been opened for more than 3 weeks with no activity. Comment or this will be closed in 7 days.

danilo-delbusso · 2024-07-07T18:11:53Z

Not stale

github-actions · 2024-07-31T23:32:11Z

This PR is stale because it has been opened for more than 3 weeks with no activity. Comment or this will be closed in 7 days.

danilo-delbusso · 2024-08-07T09:49:31Z

not stale

github-actions · 2024-08-31T23:32:02Z

This PR is stale because it has been opened for more than 3 weeks with no activity. Comment or this will be closed in 7 days.

danilo-delbusso · 2024-09-08T18:04:56Z

not stale

github-actions · 2024-10-02T23:32:16Z

This PR is stale because it has been opened for more than 3 weeks with no activity. Comment or this will be closed in 7 days.

danilo-delbusso · 2024-10-08T09:31:08Z

not stale

pseudoyu · 2024-10-19T09:30:39Z

We have /bbc route and /twitter routes, does the /twitter/bbc-user have more advantages? seems confusing.

pseudoyu · 2024-10-19T09:31:20Z

Locally seems to work just fine - I assume all the 503 errors here are related to Twitter API / request limitations? Someone more knowledgeable might know

yes it's due to the Twitter API limit.

danilo-delbusso · 2024-10-26T16:51:47Z

We have /bbc route and /twitter routes, does the /twitter/bbc-user have more advantages? seems confusing.

good question!

I have been avoiding using /bbc because the official BBC RSS feeds include a wide range of news, not just breaking stories, which can add a lot of noise. The Twitter account BBCBreaking is much more focused on major updates, which makes it ideal for a cleaner feed.

By creating a new feed instead of only using the Twitter one, we get the best of both worlds: we pull in verified BBC articles for reliability, while keeping the feed streamlined and to the point, much like a curated BBC RSS feed with the immediacy of Twitter.

pseudoyu · 2024-11-07T05:09:12Z

We have /bbc route and /twitter routes, does the /twitter/bbc-user have more advantages? seems confusing.

good question!

I have been avoiding using /bbc because the official BBC RSS feeds include a wide range of news, not just breaking stories, which can add a lot of noise. The Twitter account BBCBreaking is much more focused on major updates, which makes it ideal for a cleaner feed.

By creating a new feed instead of only using the Twitter one, we get the best of both worlds: we pull in verified BBC articles for reliability, while keeping the feed streamlined and to the point, much like a curated BBC RSS feed with the immediacy of Twitter.

got it. But I still think it should belong to /bbc namespace instead of /twitter. Or it will make users confusing.

danilo-delbusso · 2024-11-07T09:13:57Z

We have /bbc route and /twitter routes, does the /twitter/bbc-user have more advantages? seems confusing.

good question!
I have been avoiding using /bbc because the official BBC RSS feeds include a wide range of news, not just breaking stories, which can add a lot of noise. The Twitter account BBCBreaking is much more focused on major updates, which makes it ideal for a cleaner feed.
By creating a new feed instead of only using the Twitter one, we get the best of both worlds: we pull in verified BBC articles for reliability, while keeping the feed streamlined and to the point, much like a curated BBC RSS feed with the immediacy of Twitter.

got it. But I still think it should belong to /bbc namespace instead of /twitter. Or it will make users confusing.

ah! I had misunderstood your original point. Will make the changes, bear with :)

github-actions bot added core enhancement Route labels Apr 17, 2024

github-actions bot added the Auto: Route Test Complete Auto route test has finished on given PR label Apr 17, 2024

github-actions bot added the Stale No feedback from OP label May 12, 2024

github-actions bot removed the Stale No feedback from OP label May 13, 2024

github-actions bot added the Stale No feedback from OP label Jun 6, 2024

Merge branch 'master' into route/bbc-user

a4cb3da

github-actions bot removed the Stale No feedback from OP label Jun 11, 2024

github-actions bot added the Stale No feedback from OP label Jul 5, 2024

github-actions bot removed the Stale No feedback from OP label Jul 7, 2024

github-actions bot added the Stale No feedback from OP label Jul 31, 2024

github-actions bot removed the Stale No feedback from OP label Aug 7, 2024

github-actions bot added the Stale No feedback from OP label Aug 31, 2024

github-actions bot removed the Stale No feedback from OP label Sep 8, 2024

github-actions bot added the Stale No feedback from OP label Oct 2, 2024

github-actions bot removed the Stale No feedback from OP label Oct 8, 2024

pseudoyu force-pushed the master branch 5 times, most recently from 8ef9ae7 to d224d67 Compare October 31, 2024 11:39

TonyRL force-pushed the master branch from 4c64301 to 0ccfd86 Compare November 6, 2024 21:07

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(route): add route for BBC Twitter accounts #15275

feat(route): add route for BBC Twitter accounts #15275

danilo-delbusso commented Apr 17, 2024 •

edited

Loading

github-actions bot commented Apr 17, 2024

github-actions bot commented Apr 17, 2024

github-actions bot commented Apr 17, 2024

danilo-delbusso commented Apr 19, 2024

github-actions bot commented May 12, 2024

danilo-delbusso commented May 13, 2024

github-actions bot commented Jun 6, 2024

danilo-delbusso commented Jun 11, 2024

github-actions bot commented Jun 11, 2024

danilo-delbusso commented Jun 11, 2024

github-actions bot commented Jul 5, 2024

danilo-delbusso commented Jul 7, 2024

github-actions bot commented Jul 31, 2024

danilo-delbusso commented Aug 7, 2024

github-actions bot commented Aug 31, 2024

danilo-delbusso commented Sep 8, 2024

github-actions bot commented Oct 2, 2024

danilo-delbusso commented Oct 8, 2024

pseudoyu commented Oct 19, 2024

pseudoyu commented Oct 19, 2024

danilo-delbusso commented Oct 26, 2024

pseudoyu commented Nov 7, 2024 •

edited

Loading

danilo-delbusso commented Nov 7, 2024

feat(route): add route for BBC Twitter accounts #15275

Are you sure you want to change the base?

feat(route): add route for BBC Twitter accounts #15275

Conversation

danilo-delbusso commented Apr 17, 2024 • edited Loading

Involved Issue / 该 PR 相关 Issue

Example for the Proposed Route(s) / 路由地址示例

New RSS Route Checklist / 新 RSS 路由检查表

Note / 说明

Reason for adding route

Based on existing routes

github-actions bot commented Apr 17, 2024

github-actions bot commented Apr 17, 2024

github-actions bot commented Apr 17, 2024

danilo-delbusso commented Apr 19, 2024

github-actions bot commented May 12, 2024

danilo-delbusso commented May 13, 2024

github-actions bot commented Jun 6, 2024

danilo-delbusso commented Jun 11, 2024

github-actions bot commented Jun 11, 2024

danilo-delbusso commented Jun 11, 2024

github-actions bot commented Jul 5, 2024

danilo-delbusso commented Jul 7, 2024

github-actions bot commented Jul 31, 2024

danilo-delbusso commented Aug 7, 2024

github-actions bot commented Aug 31, 2024

danilo-delbusso commented Sep 8, 2024

github-actions bot commented Oct 2, 2024

danilo-delbusso commented Oct 8, 2024

pseudoyu commented Oct 19, 2024

pseudoyu commented Oct 19, 2024

danilo-delbusso commented Oct 26, 2024

pseudoyu commented Nov 7, 2024 • edited Loading

danilo-delbusso commented Nov 7, 2024

danilo-delbusso commented Apr 17, 2024 •

edited

Loading

pseudoyu commented Nov 7, 2024 •

edited

Loading