Properly close chat stream iterator even if response generation fails

Browse Source

Previously chat stream iterator wasn't closed when response streaming
for offline chat model threw an exception.

This would require restarting the application. Now application doesn't
hang even if current response generation fails with exception

...

This commit is contained in:

Debanjum Singh Solanky

2024-08-23 02:06:26 -07:00

parent bdb81260ac

commit 5927ca8032

1 changed files with 1 additions and 1 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files