Syncing one file only from an excluded forlder

[jlgarnier]

Hi Community,

I can't find the proper syntax to sync only one file from a globally excluded folder. Let's say:

• I want to exclude "!/MyPersonalData/*"
• But, I want to sync only "/MyPersonalData/Banking/AccountsCredentials.txt".

How/where should I put this in the sync_list file?

Thanks in advance for any help!

[abraunegg]

@jlgarnier
Please read the updated RC2 documentation on using 'sync_list' - https://github.com/abraunegg/onedrive/blob/onedrive-v2.5.0-release-candidate-2/docs/usage.md#performing-a-selective-synchronisation-via-sync_list-file

The first point is that when using 'sync_list' everything is excluded by default

My second point here is - if your use case there is to truly store your banking account credentials, in a text file, on Microsoft OneDrive ... please 100% rethink your strategy here ... doing that, in that manner is 100% the wrong way to go about this.

I would store the credentials locally in something like KeePass (https://keepass.info/) then potentially have the KeePass data uploaded to Microsoft OneDrive.

This being said - Microsoft OneDrive is not meant for use as a backup of your data - there are plenty of viable alternatives to this ranging from:

• restic - https://restic.net/
• borg - https://www.borgbackup.org/
• Backblaze - https://www.backblaze.com/cloud-storage/solutions/data-backup-archive
• Amazon S3 Bucket - https://aws.amazon.com/free/storage/s3/

[jlgarnier]

Thanks for the quick answer! However, I still don't understand if I should exclude the whole Parent folder first:

!/MyPersonalData/* <-- is this optional?
/MyPersonalData/Banking/*

Note: don't worry about the credentials, it's just an example! I'm working in cybersecurity... 😉

[abraunegg]

Have a re-read of the link provided. Think of 'sync_list' as a zero trust firewall for your data .. each item (file or directory) must be manually added to be included.

Exclusion lines, are redundant but ensures a direct match to ensure that data is 100% excluded before the default exclude rule is hit

[jlgarnier]

Hi,

I'm coming back on this issue, as I still couldn't find a way to include only 1 file from a globally excluded folder. I've read the updated documentation again and could not where my sync_files may be wrong.

Here it is:

# sync_list supports comments
#
# The ordering of entries is highly recommended - exclusions before inclusions
#
# Exclude temp folder(s) or file(s) under Documents folder(s), anywhere in Onedrive
!Documents/temp*

#
# Exclude folders in root directory only
# !/Secret_data/*
!/00. Archives/*
!/01. Administration/*  <-- there are spaces in the name: seems to be OK for the sync engine
!/20. Projets/*
!/32. Formation/*
!/50. Professionnel/*
!/80. Associations/*
!/90. Personnel/*  <-- I want to exclude the whole folder but... (see below)
!/Bureau/*
!/Documents/*
!/Espace personnel/*
!/Espace professionnel/*
!/Images/*

#
# Include everything else in root directory
/*
/90. Personnel/Identifiants/*  <-- ... I want to sync the whole "Identifiants" folder

Where's the trick?

Thanks in advance for any help!

[abraunegg]

@jlgarnier
Given I do not know what client version you are using, and with v2.5.0 being released on Monday 16th AEST , I am going to comment on what I have validated & tested with v2.5.0.

Applicable Configuration

..........
Config option 'connect_timeout'              = 10
Config option 'data_timeout'                 = 60
Config option 'ip_protocol_version'          = 0
Config option 'threads'                      = 8
Compile time option --enable-notifications   = false

Selective sync 'sync_list' configured        = true
sync_list config option 'sync_root_files'    = false
sync_list contents:
# sync_list supports comments
#
# The ordering of entries is highly recommended - exclusions before inclusions
#
# Exclude temp folder(s) or file(s) under Documents folder(s), anywhere in Onedrive
!Documents/temp*

#
# Exclude folders in root directory only
# !/Secret_data/*
!/00. Archives/*
!/01. Administration/*
!/20. Projets/*
!/32. Formation/*
!/50. Professionnel/*
!/80. Associations/*
!/90. Personnel/*
!/Bureau/*
!/Documents/*
!/Espace personnel/*
!/Espace professionnel/*
!/Images/*

# Include everything else in root directory
# /*   <---- Do not use this .. Use 'sync_root_files' or --sync-root-files option
# Include this folder
/90. Personnel/Identifiants/*

Config option 'sync_business_shared_items'   = false

Config option 'webhook_enabled'              = false

Application Output

........
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 205
Skipping path - excluded by sync_list config: ./random data dump
Skipping path - excluded by sync_list config: ./Issue_2783
Including path - included by sync_list config: ./90. Personnel
Skipping path - excluded by sync_list config: random data dump/3
Skipping path - excluded by sync_list config: Issue_2783/General
Including path - included by sync_list config: 90. Personnel/Identifiants
Skipping path - excluded by sync_list config: 90. Personnel/blah blah blah
Skipping path - excluded by sync_list config: random data dump/3/random_500_files
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data
Including path - included by sync_list config: 90. Personnel/Identifiants/awerqwerqwer
Skipping path - excluded by sync_list config: 90. Personnel/blah blah blah/AsizFBdJyxhu1WzEu2Q0d1vkGXRX73NZ
Skipping path - excluded by sync_list config: random data dump/3/random_500_files/LWxplg9XSOfXgKFwvIxGF10wY3fcfkX2
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events
Including file - included by sync_list config: 90. Personnel/Identifiants/awerqwerqwer/file1.data
Parental Path structure needs to be created to support included file: 90. Personnel/Identifiants/awerqwerqwer
Including file - included by sync_list config: 90. Personnel/Identifiants/awerqwerqwer/file0.data
Including file - included by sync_list config: 90. Personnel/Identifiants/awerqwerqwer/file2.data
Including file - included by sync_list config: 90. Personnel/Identifiants/awerqwerqwer/file4.data
Including file - included by sync_list config: 90. Personnel/Identifiants/awerqwerqwer/file3.data
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2019 Logs
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2020 Logs
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2021 Logs
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2022 Logs
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2023 Logs
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2024 Logs
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2019 Logs/SyncTest
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2020 Logs/SyncTest
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2021 Logs/SyncTest
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2022 Logs/SyncTest
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2023 Logs/SyncTest
Skipping path - excluded by sync_list config: Issue_2783/General/P1.0 Test Data/P1.0 Testing Events/2024 Logs/SyncTest
Processing API Response Bundle: 2 - Quantity of 'changes|items' in this bundle to process: 205
Processing API Response Bundle: 3 - Quantity of 'changes|items' in this bundle to process: 208
Skipping path - excluded by sync_list config: random data dump/2
Skipping path - excluded by sync_list config: random data dump/2/random_500_files
Skipping path - excluded by sync_list config: random data dump/2/random_500_files/LWxplg9XSOfXgKFwvIxGF10wY3fcfkX2
Processing API Response Bundle: 4 - Quantity of 'changes|items' in this bundle to process: 205
Processing API Response Bundle: 5 - Quantity of 'changes|items' in this bundle to process: 205
Processing API Response Bundle: 6 - Quantity of 'changes|items' in this bundle to process: 208
........
Finished processing /delta JSON response from the OneDrive API
Processing 2672 applicable changes and items received from Microsoft OneDrive
Processing OneDrive JSON item batch [1/6] to ensure consistent local state
Processing OneDrive JSON item batch [2/6] to ensure consistent local state
Processing OneDrive JSON item batch [3/6] to ensure consistent local state
Processing OneDrive JSON item batch [4/6] to ensure consistent local state
Processing OneDrive JSON item batch [5/6] to ensure consistent local state
Processing OneDrive JSON item batch [6/6] to ensure consistent local state
Number of items to download from Microsoft OneDrive: 12
Downloading file: ./new_online_file.txt ... done
Downloading file: 90. Personnel/Identifiants/awerqwerqwer/file4.data ... done
Downloading file: ./read_write1.txt ... done
Downloading file: ./wwwwwwwww.txt ... done
Downloading file: 90. Personnel/Identifiants/awerqwerqwer/file0.data ... done
Downloading file: 90. Personnel/Identifiants/awerqwerqwer/file1.data ... done
Downloading file: 90. Personnel/Identifiants/awerqwerqwer/file2.data ... done
Downloading file: 90. Personnel/Identifiants/awerqwerqwer/file3.data ... done
Downloading file: ./read_write.txt ... done
Downloading file: ./rv215w_admin_en.pdf ... done
Downloading file: ./New Text Document.txt ... done
Downloading file: ./another_file.txt ... done
Performing a database consistency and integrity check on locally stored data
Processing DB entries for this Drive ID: 66d53be8a5056eca
Processing: ~/OneDrive
........

Online Folder Structure