Update to DataFusion v.52

[milenkovicm]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Once the DataFusion 52 has been released we need to update Ballista to latest release.
Current release process can be tracked at #18566

Ballista has been tested with apache/datafusion@9a9ff8d and looks like there are two changes needed

• new metrics type should be introduced
• there is change of interface in repartition

Describe the solution you'd like

Describe alternatives you've considered

Additional context

[killzoner]

Starting on this in the following days

[milenkovicm]

there is no rush on it, datafusion has not been released yet. you could use latest master to test, but i think its not a big deal of update this time

[milenkovicm]

apache/datafusion#19668 may help with repartition interface change

[milenkovicm]

hey @killzoner still interested to take this task ?

[killzoner]

Hey sure, I can take this one
Not sure to see the link with #1357 though, is there a patch to reproduce at ballista level following this change?

[milenkovicm]

ah i did a quick test, not sure if i ever push the link.
just go and replace all datafusion versions to latest (and ballista) and then keep fixing it until compiler is happy 😊 then you do cargo update and copy datafusion and datafusion proto files across to ballista

thanks a lot