✨feat(source-microsoft-sharepoint): Provide ability to sync other sites than Main sharepoint site

[aldogonzalez8]

What

Sharepoint portals are structured in a way so they can host multiple site. Currently connector only recognises files hosted in the main site and everything else is ignored.

We want to introduce the ability to sync other sites in sharepoint tenant.

How

This PR introduces a new optional site_url field to provide the URL to the sharepoint site for files to sync. If no value is provided it falls back to main site.

Review guide

1. airbyte-integrations/connectors/source-microsoft-sharepoint/source_microsoft_sharepoint/stream_reader.py: new get_site_drive method to get drives from either specific site_url or main site if no URL provided.

User Impact

User will now be able to provide a sharepoint site alternative to main site.

Can this PR be safely reverted and rolled back?

• YES 💚
• NO ❌

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 28, 2025 9:55pm

[kkr2320]

@aldogonzalez8 - Thanks for working on it and it’s important feature. Is there a time line for this release ?

[aldogonzalez8]

/appprove-regression-tests

[aldogonzalez8]

/approve-regression-tests

Check job output.

✅ Approving regression tests

[kkr2320]

@aldogonzalez8 - Is it possible to update the dependencies Pyarraw and requests to match the PyAirbyte version 0.23.0 ?

[aldogonzalez8]

@aldogonzalez8 - Is it possible to update the dependencies Pyarraw and requests to match the PyAirbyte version 0.23.0 ?

@kkr2320 I need to document better this pr and connector official doc, after that will take a look in your request.

[aldogonzalez8]

/approve-regression-tests

Check job output.

✅ Approving regression tests

[kkr2320]

@aldogonzalez8 Thanks again..
This is probably covered in your fix. But to make sure , does the fix work when Azure App privileges set to “Sites Selected” instead requiring “Read.All” . Large organizations like us , multi tenancy is a must requirement , thus site owners deploy their own application.

[aldogonzalez8]

@aldogonzalez8 Thanks again..
This is probably covered in your fix. But to make sure , does the fix work when Azure App privileges set to “Sites Selected” instead requiring “Read.All” . Large organizations like us , multi tenancy is a must requirement , thus site owners deploy their own application.

I believe it should work, I do something like:

site = client.sites.get_by_url("https://contoso.sharepoint.com/sites/MySite")

That I understand translates to some GET like:

GET https://graph.microsoft.com/v1.0/sites/{hostname}:/{site-path}

That I would expect that works 🤞 for "sites.read.all" or "sites.selected" scopes in the app. Maybe I need to adjust the scope to request both and let the app grant the available.