stuck at step: 4/9 reading json files in zip

[Zaokret]

Uncaught (in promise) PythonError: Traceback (most recent call last):
File "/lib/python311.zip/_pyodide/_base.py", line 571, in eval_code_async
await CodeRunner(
File "/lib/python311.zip/_pyodide/_base.py", line 394, in run_async
coroutine = eval(self.code, globals, locals)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 5, in
File "", line 12, in read_json
File "/lib/python3.11/site-packages/pandas/util/_decorators.py", line 211, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/util/_decorators.py", line 331, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/io/json/_json.py", line 757, in read_json
return json_reader.read()
^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/io/json/_json.py", line 915, in read
obj = self._get_object_parser(self.data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/io/json/_json.py", line 937, in _get_object_parser
obj = FrameParser(json, **kwargs).parse()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/io/json/_json.py", line 1064, in parse
self._parse_no_numpy()
File "/lib/python3.11/site-packages/pandas/io/json/_json.py", line 1320, in _parse_no_numpy
self.obj = DataFrame(
^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/core/frame.py", line 664, in init
mgr = dict_to_mgr(data, index, columns, dtype=dtype, copy=copy, typ=manager)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/core/internals/construction.py", line 493, in dict_to_mgr
return arrays_to_mgr(arrays, columns, index, dtype=dtype, typ=typ, consolidate=copy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/core/internals/construction.py", line 118, in arrays_to_mgr
index = _extract_index(arrays)
^^^^^^^^^^^^^^^^^^^^^^
File "/lib/python3.11/site-packages/pandas/core/internals/construction.py", line 656, in _extract_index
raise ValueError("If using all scalar values, you must pass an index")
ValueError: If using all scalar values, you must pass an index

at new_error (pyodide.asm.js:9:12519)
at pyodide.asm.wasm:0x158827
at pyodide.asm.wasm:0x15fcd5
at _PyCFunctionWithKeywords_TrampolineCall (pyodide.asm.js:9:123052)
at pyodide.asm.wasm:0x1a3091
at pyodide.asm.wasm:0x289e4d
at pyodide.asm.wasm:0x1e3f77
at pyodide.asm.wasm:0x1a3579
at pyodide.asm.wasm:0x1a383a
at pyodide.asm.wasm:0x1a38dc
at pyodide.asm.wasm:0x2685c5
at pyodide.asm.wasm:0x26e3d0
at pyodide.asm.wasm:0x1a3a04
at pyodide.asm.wasm:0x1a3694
at pyodide.asm.wasm:0x15f45e
at Module.callPyObjectKwargs (pyodide.asm.js:9:81732)
at Module.callPyObject (pyodide.asm.js:9:82066)
at wrapper (pyodide.asm.js:9:58562)

[piebro]

There seems to be a problem when reading the data. Maybe Spotify changed their data format. I just requested my own data history again to see if there is the same problem with mine too.

[piebro]

I just downloaded my Spotify data and everything worked as expected. Is your data also from a recent download?

[landiswenger-sudo]

It looks like Spotify has changed the format of their data since this conversation.

[piebro]

Do you get a similar error? I have a data dump from about a month ago it it worked just fine. I just requested another spotify data dump and will test if anything changed.

[piebro]

I just tried to recreate the issue with my current spotify "entiry listening history" dump and I could not recreate it. Are you sure that you requested the right dump?

In the Zip file it should look like this or similar to this:

Spotify Extended Streaming History
├── ReadMeFirst_ExtendedStreamingHistory.pdf
├── Streaming_History_Audio_2011-2015_0.json
├── Streaming_History_Audio_2015-2016_1.json
├── Streaming_History_Audio_2016-2017_3.json
├── Streaming_History_Audio_2016_2.json
....

Does it look like this in you .zip file?

[landiswenger-sudo]

Oh sorry, I must have messed something up. I just got the data and tried again, and it worked. Thank you for building this. I have been really enjoying it!