Model selection by conversation

[cbutler-captech]

A great feature for this repo would be the ability to select a model by conversation. Our company has plans to use APIM to allow devs to hit models based on their user groups and redirect to models that have different user and global quotas. A good idea would be to use the standard azure openai deployments api response (but make it configurable so it can be intercepted by APIM and modified based on security). https://learn.microsoft.com/en-us/rest/api/aiservices/accountmanagement/deployments/list?view=rest-aiservices-accountmanagement-2023-05-01&tabs=HTTP

Thoughts?