2023-11-24 09:58:44 | ERROR | stderr | INFO:     Started server process [61043]
2023-11-24 09:58:44 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 09:58:44 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 09:58:44 | ERROR | stderr | ERROR:    [Errno 48] error while attempting to bind on address ('127.0.0.1', 20000): address already in use
2023-11-24 09:58:44 | ERROR | stderr | INFO:     Waiting for application shutdown.
2023-11-24 09:58:44 | ERROR | stderr | INFO:     Application shutdown complete.
2023-11-24 10:01:38 | ERROR | stderr | INFO:     Started server process [61129]
2023-11-24 10:01:38 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:01:38 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:01:38 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:02:12 | INFO | stdout | INFO:     ::1:63368 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:02:12 | ERROR | stderr | ERROR:    Exception in ASGI application
2023-11-24 10:02:12 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 10:02:12 | ERROR | stderr |     yield
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 10:02:12 | ERROR | stderr |     event = self._h11_state.next_event()
2023-11-24 10:02:12 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 10:02:12 | ERROR | stderr |     event = self._extract_next_receive_event()
2023-11-24 10:02:12 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 10:02:12 | ERROR | stderr |     event = self._reader.read_eof()  # type: ignore[attr-defined]
2023-11-24 10:02:12 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 10:02:12 | ERROR | stderr |     raise RemoteProtocolError(
2023-11-24 10:02:12 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:02:12 | ERROR | stderr | 
2023-11-24 10:02:12 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:02:12 | ERROR | stderr | 
2023-11-24 10:02:12 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 10:02:12 | ERROR | stderr |     yield
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr |     async for part in self._httpcore_stream:
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr |     async for part in self._stream:
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr |     raise exc
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr |     async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 10:02:12 | ERROR | stderr |     event = await self._receive_event(timeout=timeout)
2023-11-24 10:02:12 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 10:02:12 | ERROR | stderr |     with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:02:12 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 10:02:12 | ERROR | stderr |     raise to_exc(exc) from exc
2023-11-24 10:02:12 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:02:12 | ERROR | stderr | 
2023-11-24 10:02:12 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:02:12 | ERROR | stderr | 
2023-11-24 10:02:12 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 10:02:12 | ERROR | stderr |     result = await app(  # type: ignore[func-returns-value]
2023-11-24 10:02:12 | ERROR | stderr |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     return await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await super().__call__(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     raise exc
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await self.app(scope, receive, _send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     raise exc
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await self.app(scope, receive, sender)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     raise e
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     await route.handle(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 10:02:12 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 10:02:12 | ERROR | stderr |     await response(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 10:02:12 | ERROR | stderr |     async with anyio.create_task_group() as task_group:
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 10:02:12 | ERROR | stderr |     raise exceptions[0]
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 10:02:12 | ERROR | stderr |     await func()
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 10:02:12 | ERROR | stderr |     async for chunk in self.body_iterator:
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 10:02:12 | ERROR | stderr |     async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 10:02:12 | ERROR | stderr |     async for raw_chunk in response.aiter_raw():
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 10:02:12 | ERROR | stderr |     async for raw_stream_bytes in self.stream:
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr |     async for chunk in self._stream:
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr |     with map_httpcore_exceptions():
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:02:12 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 10:02:12 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 10:02:12 | ERROR | stderr |     raise mapped_exc(message) from exc
2023-11-24 10:02:12 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:04:00 | ERROR | stderr | INFO:     Started server process [61185]
2023-11-24 10:04:00 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:04:00 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:04:00 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:04:14 | INFO | stdout | INFO:     ::1:63500 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:04:37 | ERROR | stderr | INFO:     Started server process [61223]
2023-11-24 10:04:37 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:04:37 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:04:37 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:12:09 | ERROR | stderr | INFO:     Started server process [61355]
2023-11-24 10:12:09 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:12:09 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:12:09 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:12:38 | INFO | stdout | INFO:     ::1:63824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:12:38 | ERROR | stderr | ERROR:    Exception in ASGI application
2023-11-24 10:12:38 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 10:12:38 | ERROR | stderr |     yield
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 10:12:38 | ERROR | stderr |     event = self._h11_state.next_event()
2023-11-24 10:12:38 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 10:12:38 | ERROR | stderr |     event = self._extract_next_receive_event()
2023-11-24 10:12:38 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 10:12:38 | ERROR | stderr |     event = self._reader.read_eof()  # type: ignore[attr-defined]
2023-11-24 10:12:38 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 10:12:38 | ERROR | stderr |     raise RemoteProtocolError(
2023-11-24 10:12:38 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:12:38 | ERROR | stderr | 
2023-11-24 10:12:38 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:12:38 | ERROR | stderr | 
2023-11-24 10:12:38 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 10:12:38 | ERROR | stderr |     yield
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr |     async for part in self._httpcore_stream:
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr |     async for part in self._stream:
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr |     raise exc
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr |     async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 10:12:38 | ERROR | stderr |     event = await self._receive_event(timeout=timeout)
2023-11-24 10:12:38 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 10:12:38 | ERROR | stderr |     with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:12:38 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 10:12:38 | ERROR | stderr |     raise to_exc(exc) from exc
2023-11-24 10:12:38 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:12:38 | ERROR | stderr | 
2023-11-24 10:12:38 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:12:38 | ERROR | stderr | 
2023-11-24 10:12:38 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 10:12:38 | ERROR | stderr |     result = await app(  # type: ignore[func-returns-value]
2023-11-24 10:12:38 | ERROR | stderr |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     return await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await super().__call__(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     raise exc
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await self.app(scope, receive, _send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     raise exc
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await self.app(scope, receive, sender)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     raise e
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     await route.handle(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 10:12:38 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 10:12:38 | ERROR | stderr |     await response(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 10:12:38 | ERROR | stderr |     async with anyio.create_task_group() as task_group:
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 10:12:38 | ERROR | stderr |     raise exceptions[0]
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 10:12:38 | ERROR | stderr |     await func()
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 10:12:38 | ERROR | stderr |     async for chunk in self.body_iterator:
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 10:12:38 | ERROR | stderr |     async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 10:12:38 | ERROR | stderr |     async for raw_chunk in response.aiter_raw():
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 10:12:38 | ERROR | stderr |     async for raw_stream_bytes in self.stream:
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr |     async for chunk in self._stream:
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr |     with map_httpcore_exceptions():
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:12:38 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 10:12:38 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 10:12:38 | ERROR | stderr |     raise mapped_exc(message) from exc
2023-11-24 10:12:38 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:15:22 | INFO | stdout | INFO:     ::1:64016 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2023-11-24 10:16:21 | INFO | stdout | INFO:     ::1:64047 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2023-11-24 10:19:40 | ERROR | stderr | INFO:     Started server process [61513]
2023-11-24 10:19:40 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:19:40 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:19:40 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:20:08 | INFO | stdout | INFO:     ::1:64247 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:20:08 | ERROR | stderr | ERROR:    Exception in ASGI application
2023-11-24 10:20:08 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 10:20:08 | ERROR | stderr |     yield
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 10:20:08 | ERROR | stderr |     event = self._h11_state.next_event()
2023-11-24 10:20:08 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 10:20:08 | ERROR | stderr |     event = self._extract_next_receive_event()
2023-11-24 10:20:08 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 10:20:08 | ERROR | stderr |     event = self._reader.read_eof()  # type: ignore[attr-defined]
2023-11-24 10:20:08 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 10:20:08 | ERROR | stderr |     raise RemoteProtocolError(
2023-11-24 10:20:08 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:20:08 | ERROR | stderr | 
2023-11-24 10:20:08 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:20:08 | ERROR | stderr | 
2023-11-24 10:20:08 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 10:20:08 | ERROR | stderr |     yield
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr |     async for part in self._httpcore_stream:
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr |     async for part in self._stream:
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr |     raise exc
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr |     async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 10:20:08 | ERROR | stderr |     event = await self._receive_event(timeout=timeout)
2023-11-24 10:20:08 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 10:20:08 | ERROR | stderr |     with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:20:08 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 10:20:08 | ERROR | stderr |     raise to_exc(exc) from exc
2023-11-24 10:20:08 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:20:08 | ERROR | stderr | 
2023-11-24 10:20:08 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:20:08 | ERROR | stderr | 
2023-11-24 10:20:08 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 10:20:08 | ERROR | stderr |     result = await app(  # type: ignore[func-returns-value]
2023-11-24 10:20:08 | ERROR | stderr |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     return await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await super().__call__(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     raise exc
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await self.app(scope, receive, _send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     raise exc
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await self.app(scope, receive, sender)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     raise e
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     await route.handle(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 10:20:08 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 10:20:08 | ERROR | stderr |     await response(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 10:20:08 | ERROR | stderr |     async with anyio.create_task_group() as task_group:
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 10:20:08 | ERROR | stderr |     raise exceptions[0]
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 10:20:08 | ERROR | stderr |     await func()
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 10:20:08 | ERROR | stderr |     async for chunk in self.body_iterator:
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 10:20:08 | ERROR | stderr |     async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 10:20:08 | ERROR | stderr |     async for raw_chunk in response.aiter_raw():
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 10:20:08 | ERROR | stderr |     async for raw_stream_bytes in self.stream:
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr |     async for chunk in self._stream:
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr |     with map_httpcore_exceptions():
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:20:08 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 10:20:08 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 10:20:08 | ERROR | stderr |     raise mapped_exc(message) from exc
2023-11-24 10:20:08 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:24:49 | ERROR | stderr | INFO:     Started server process [61597]
2023-11-24 10:24:49 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:24:49 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:24:49 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:25:04 | INFO | stdout | INFO:     ::1:64683 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:25:36 | ERROR | stderr | INFO:     Started server process [61641]
2023-11-24 10:25:36 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 10:25:36 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 10:25:36 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:26:17 | INFO | stdout | INFO:     ::1:64765 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 13:33:33 | ERROR | stderr | INFO:     Started server process [63574]
2023-11-24 13:33:33 | ERROR | stderr | INFO:     Waiting for application startup.
2023-11-24 13:33:33 | ERROR | stderr | INFO:     Application startup complete.
2023-11-24 13:33:33 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 13:33:52 | INFO | stdout | INFO:     ::1:62144 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 13:33:53 | ERROR | stderr | ERROR:    Exception in ASGI application
2023-11-24 13:33:53 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 13:33:53 | ERROR | stderr |     yield
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 13:33:53 | ERROR | stderr |     event = self._h11_state.next_event()
2023-11-24 13:33:53 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 13:33:53 | ERROR | stderr |     event = self._extract_next_receive_event()
2023-11-24 13:33:53 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 13:33:53 | ERROR | stderr |     event = self._reader.read_eof()  # type: ignore[attr-defined]
2023-11-24 13:33:53 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 13:33:53 | ERROR | stderr |     raise RemoteProtocolError(
2023-11-24 13:33:53 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 13:33:53 | ERROR | stderr | 
2023-11-24 13:33:53 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 13:33:53 | ERROR | stderr | 
2023-11-24 13:33:53 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 13:33:53 | ERROR | stderr |     yield
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr |     async for part in self._httpcore_stream:
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr |     async for part in self._stream:
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr |     raise exc
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr |     async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 13:33:53 | ERROR | stderr |     event = await self._receive_event(timeout=timeout)
2023-11-24 13:33:53 | ERROR | stderr |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 13:33:53 | ERROR | stderr |     with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 13:33:53 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 13:33:53 | ERROR | stderr |     raise to_exc(exc) from exc
2023-11-24 13:33:53 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 13:33:53 | ERROR | stderr | 
2023-11-24 13:33:53 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 13:33:53 | ERROR | stderr | 
2023-11-24 13:33:53 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 13:33:53 | ERROR | stderr |     result = await app(  # type: ignore[func-returns-value]
2023-11-24 13:33:53 | ERROR | stderr |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     return await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await super().__call__(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     raise exc
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await self.app(scope, receive, _send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     raise exc
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await self.app(scope, receive, sender)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     raise e
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     await route.handle(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 13:33:53 | ERROR | stderr |     await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 13:33:53 | ERROR | stderr |     await response(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 13:33:53 | ERROR | stderr |     async with anyio.create_task_group() as task_group:
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 13:33:53 | ERROR | stderr |     raise exceptions[0]
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 13:33:53 | ERROR | stderr |     await func()
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 13:33:53 | ERROR | stderr |     async for chunk in self.body_iterator:
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 13:33:53 | ERROR | stderr |     async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 13:33:53 | ERROR | stderr |     async for raw_chunk in response.aiter_raw():
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 13:33:53 | ERROR | stderr |     async for raw_stream_bytes in self.stream:
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr |     async for chunk in self._stream:
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr |     with map_httpcore_exceptions():
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 13:33:53 | ERROR | stderr |     self.gen.throw(typ, value, traceback)
2023-11-24 13:33:53 | ERROR | stderr |   File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 13:33:53 | ERROR | stderr |     raise mapped_exc(message) from exc
2023-11-24 13:33:53 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)