Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Properly close chat stream iterator even if response generation fails
Previously chat stream iterator wasn't closed when response streaming for offline chat model threw an exception. This would require restarting the application. Now application doesn't hang even if current response generation fails with exception
- Loading branch information