feat: add Firecrawl web search provider#13262
Conversation
|
firecrawl is already supported |
You are right that Firecrawl is already supported today as a scraper. I think this PR is a different integration point: it adds Firecrawl as a search provider option. I checked the current
So today a deployment can use If the preferred direction is not to expose Firecrawl as a search provider, that is totally fair; I just wanted to clarify that the existing Firecrawl support is scraper support, not search-provider support. |
|
My mistake, I could've sworn we had firecrawl as a search provider since the firecrawl team itself has contributed code here. Will review as soon as I can |
Target:
danny-avila/LibreChat:devBranch:
feat/firecrawl-web-searchCommit:
251a9be176eb276f6d3d6401541011f0038f35feDependency PR:
danny-avila/agents#192feature/firecrawl-searchmainf6ae68013d93310729444a2b2d99d1040f896366@librechat/agentshere before final merge if required by maintainers.Why This Matters
Firecrawl gives LibreChat an AI-oriented web search option that can combine search discovery and content extraction through one provider. That is useful for teams that do not want to run a separate metasearch provider plus a separate scraper just to produce model-ready web context.
This does not replace SearXNG's privacy/metasearch niche. SearXNG remains valuable when users want a self-hosted metasearch engine aggregating many upstream search services. Firecrawl is valuable when the deployment wants one API focused on finding sources and returning clean, scrape-ready page content for agents.
References:
Summary
Adds Firecrawl as a selectable web search provider in LibreChat config/schema/auth/UI, including:
Tests
feat/firecrawl-web-search...origin/dev [ahead 1]Locale/docs Notes
LibreChat policy says feature PRs update only
client/src/locales/en/translation.json; non-English app locale files are automated externally and fall back to English..env.exampleandlibrechat.example.yamldocument the Firecrawl config; external feature docs belong inLibreChat-AI/librechat.aiif maintainers want a docs PR.Residual Risks
Runtime end-to-end Firecrawl search should be verified after the agents package publish/bump and with
FIRECRAWL_API_KEYconfigured.