Incremental getdataset#24

Draft

madisonmay wants to merge 3 commits intomainfrom

incremental_getdataset

Commits on Sep 24, 2024

- added get_dataset_from_remaining function to handle remaining files to load when there is a crash ( internet connexion, problematic file...)
benjaminbotbol
committed
- enabled the execution of the code from command line
benjaminbotbol
committed

Commits on Sep 26, 2024

added code to:
benjaminbotbol
committed