[Bug]: Val d'Arpette METACLOUD

[guilbep]

What went wrong?

the job failed with the following logs:

potree-converter -rwxrwxrwx 1 root root   587 May  7 09:10 point_cloud.metacloud                                                                                                                   │
│ potree-converter DEBUG: Processing line: # This is a comment about the metacloud descriptor file                                                                                                   │
│ potree-converter DEBUG: Processing line:                                                                                                                                                           │
│ potree-converter DEBUG: Processing line: POINTS_FILES                                                                                                                                              │
│ potree-converter DEBUG: Processing line: /data/pointcloud1.las                                                                                                                                     │
│ potree-converter DEBUG: Cleaned path: /data/pointcloud1.las                                                                                                                                        │
│ potree-converter DEBUG: Full path to point cloud file: /lidar/0002_Val_dArpette//data/pointcloud1.las                                                                                              │
│ potree-converter WARNING: File not found: /lidar/0002_Val_dArpette//data/pointcloud1.las                                                                                                           │
│ potree-converter DEBUG: Processing line: "/data/ My point cloud 2.las"                                                                                                                             │
│ potree-converter DEBUG: Cleaned path: "/data/ My point cloud 2.las"                                                                                                                                │
│ potree-converter DEBUG: Full path to point cloud file: /lidar/0002_Val_dArpette/"/data/ My point cloud 2.las"                                                                                      │
│ potree-converter WARNING: File not found: /lidar/0002_Val_dArpette/"/data/ My point cloud 2.las"                                                                                                   │
│ potree-converter DEBUG: Processing line: "/data/pointcloud#3.pcd"                                                                                                                                  │
│ potree-converter DEBUG: Cleaned path: "/data/pointcloud#3.pcd"                                                                                                                                     │
│ potree-converter DEBUG: Full path to point cloud file: /lidar/0002_Val_dArpette/"/data/pointcloud#3.pcd"                                                                                           │
│ potree-converter WARNING: File not found: /lidar/0002_Val_dArpette/"/data/pointcloud#3.pcd"                                                                                                        │
│ potree-converter DEBUG: Processing line:                                                                                                                                                           │
│ potree-converter DEBUG: Processing line: EXTRA_ATTRIBUTES                                                                                                                                          │
│ potree-converter DEBUG: Processing line: /data/extra_attributes1.bin float32 height int64 color uint8 intensity                                                                                    │
│ potree-converter DEBUG: Processing line: "/data/extra_attributes2.bin" float32 temperature float64 pressure int32 humidity                                                                         │
│ potree-converter DEBUG: Processing line:                                                                                                                                                           │
│ potree-converter DEBUG: Processing line: INDEX_FILES                                                                                                                                               │
│ potree-converter DEBUG: Processing line: /data/spatial_index1.bin grid IndexGrid1                                                                                                                  │
│ potree-converter DEBUG: Processing line: /data/spatial_index2.bin grid IndexGrid2                                                                                                                  │
│ potree-converter DEBUG: Processing line: /data/spatial_index3.bin octree IndexOctree1                                                                                                              │
│ potree-converter DEBUG: Processing line:                                                                                                                                                           │
│ potree-converter DEBUG: Processing line: METACLOUD_ATTRIBUTES                                                                                                                                      │
│ potree-converter DEBUG: Processing line: creator "J. Lahaye"                                                                                                                                       │
│ potree-converter DEBUG: Processing line: version 1.5                                                                                                                                               │
│ potree-converter DEBUG: Processing line: description "This is a metacloud describing the Val d'Arpette."                                                                                           │
│ potree-converter DEBUG: Processing line: height 100                                                                                                                                                │
│ potree-converter DEBUG: Found files:                                                                                                                                                               │
│ potree-converter ERROR: No point cloud files found in the metacloud file.                                                                                                                          │
│ potree-converter Potree conversion failed for 0002_Val_dArpette with exit code 1                                                                                                                   │
│ potree-converter Updating database for 0002_Val_dArpette with failed status                                                                                                                        │
│ potree-converter Database updated with failed status for 0002_Val_dArpette                                                                                                                         │
│ stream closed EOF for epfl-eso-addlidar-prod/batch-potree-converter-20250612110447-0-98zw6 (prepare-metacloud)                                                                                     │
│ stream closed EOF for epfl-eso-addlidar-prod/batch-potree-converter-20250612110447-0-98zw6 (potree-converter)

How can we reproduce this?

1. Go to https://enac-it-cd.epfl.ch/applications/addlidar-prod?resource=
2. Run the Scanner cronjob
3. open k9s on the epfl-eso-addlidar-prod namespace
4. open the logs of the pods with the error

Screenshot

Which browser are you using?

Chrome

What device are you using?

Desktop/Laptop

Additional information

No response

Before submitting

• I've checked that this issue hasn't already been reported

[pierreleripoll]

The metacloud file has not been updated apparently

POINTS_FILES
/data/pointcloud1.las
"/data/ My point cloud 2.las"
"/data/pointcloud#3.pcd"

The files doesn't exist on fts-addlidar

[j-la-haye]

The metacloud has been updated. How long does it take to re-run the val d'arpette mission?

[j-la-haye]

Hello, I have just updated the metacloud again with valid files. Is it possible to run the crawler and check? Thanks

[j-la-haye]

Hello, I have again fixed the metacloud file.

[pierreleripoll]

@j-la-haye the conversion was successfull !
https://addlidar.epfl.ch/mission/0002_Val_dArpette

[j-la-haye]

@pierreleripoll I have updated the las tiles and relevent metacloud. Can you try to process them now? I would like to see whether they can can be properly filtered by point_source_id and classification

[j-la-haye]

@pierreleripoll I notice that the pointsourceID is still not being read in Potree. When I check the las files, the pointsourceID is updated. Any idea why?

[pierreleripoll]

hello @j-la-haye apparently the point source ID values have all the same values according to Potree Converter metadata.json :

{
  "name": "point source id",
  "description": "",
  "size": 2,
  "numElements": 1,
  "elementSize": 2,
  "type": "uint16",
  "min": [
    0
  ],
  "max": [
    0
  ],
  "scale": [
    1
  ],
  "offset": [
    0
  ]
}

[pierreleripoll]

@j-la-haye here's the one for the EPFL mission as exemple :

{
  "name": "point source id",
  "description": "",
  "size": 2,
  "numElements": 1,
  "elementSize": 2,
  "type": "uint16",
  "min": [
    1
  ],
  "max": [
    10
  ],
  "scale": [
    1
  ],
  "offset": [
    0
  ]
}

Also you can use https://github.com/potree/PotreeDesktop to visualize converted pointclouds to verify all works

[j-la-haye]

@pierreleripoll is this a hard coded tag? Perhaps told you wrong. The LAS standard field is 'point_source_ID' is this something you need to change to see the value?

[pierreleripoll]

@j-la-haye no this is automatically generated by potree converter. Are you sure the point source ID variable has real integers as value ?

[j-la-haye]

@pierreleripoll I have regenerated the las files and confirmed that all point source IDs can be read exactly as epfl dataset. Can you please rerun the crawler if you have a chance. If I have time I will try to process the new files with Potreeconverter to verify but running them on your side first would be faster.
Thanks