feat: Update to use Pydantic V2 and enable chunking #288

Job	Run time
Python (macos-latest, 3.10) / macos-latest, python 3.10	1m 15s
Python (macos-latest, 3.11) / macos-latest, python 3.11	55s
Python (macos-latest, 3.12) / macos-latest, python 3.12	49s
Python (macos-latest, 3.9) / macos-latest, python 3.9	1m 3s
Python (ubuntu-latest, 3.10) / ubuntu-latest, python 3.10	50s
Python (ubuntu-latest, 3.11) / ubuntu-latest, python 3.11	50s
Python (ubuntu-latest, 3.12) / ubuntu-latest, python 3.12	57s
Python (ubuntu-latest, 3.9) / ubuntu-latest, python 3.9	53s
Python (windows-latest, 3.10) / windows-latest, python 3.10	2m 37s
Python (windows-latest, 3.11) / windows-latest, python 3.11	3m 4s
Python (windows-latest, 3.12) / windows-latest, python 3.12	2m 4s
Python (windows-latest, 3.9) / windows-latest, python 3.9	2m 28s
	17m 45s

Provide feedback