aidatagov
/
langchain-chatchat-old
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
测试部署
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
2 Commits
1 Branch
0 Tags
22 MiB
Branch: main
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'main'
${ noResults }
langchain-chatchat-old/logs/openai_api.log.2023-11-24

436 lines
51 KiB
Raw Permalink Normal View History

Initial commit
1 month ago
2023-11-24 09:58:44 | ERROR | stderr | INFO: Started server process [61043]
2023-11-24 09:58:44 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 09:58:44 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 09:58:44 | ERROR | stderr | ERROR: [Errno 48] error while attempting to bind on address ('127.0.0.1', 20000): address already in use
2023-11-24 09:58:44 | ERROR | stderr | INFO: Waiting for application shutdown.
2023-11-24 09:58:44 | ERROR | stderr | INFO: Application shutdown complete.
2023-11-24 10:01:38 | ERROR | stderr | INFO: Started server process [61129]
2023-11-24 10:01:38 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:01:38 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:01:38 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:02:12 | INFO | stdout | INFO: ::1:63368 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:02:12 | ERROR | stderr | ERROR: Exception in ASGI application
2023-11-24 10:02:12 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 10:02:12 | ERROR | stderr | yield
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 10:02:12 | ERROR | stderr | event = self._h11_state.next_event()
2023-11-24 10:02:12 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 10:02:12 | ERROR | stderr | event = self._extract_next_receive_event()
2023-11-24 10:02:12 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 10:02:12 | ERROR | stderr | event = self._reader.read_eof() # type: ignore[attr-defined]
2023-11-24 10:02:12 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 10:02:12 | ERROR | stderr | raise RemoteProtocolError(
2023-11-24 10:02:12 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:02:12 | ERROR | stderr |
2023-11-24 10:02:12 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:02:12 | ERROR | stderr |
2023-11-24 10:02:12 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 10:02:12 | ERROR | stderr | yield
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr | async for part in self._httpcore_stream:
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr | async for part in self._stream:
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr | raise exc
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr | async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 10:02:12 | ERROR | stderr | event = await self._receive_event(timeout=timeout)
2023-11-24 10:02:12 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 10:02:12 | ERROR | stderr | with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:02:12 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 10:02:12 | ERROR | stderr | raise to_exc(exc) from exc
2023-11-24 10:02:12 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:02:12 | ERROR | stderr |
2023-11-24 10:02:12 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:02:12 | ERROR | stderr |
2023-11-24 10:02:12 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 10:02:12 | ERROR | stderr | result = await app( # type: ignore[func-returns-value]
2023-11-24 10:02:12 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 10:02:12 | ERROR | stderr | return await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await super().__call__(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await self.middleware_stack(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 10:02:12 | ERROR | stderr | raise exc
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await self.app(scope, receive, _send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 10:02:12 | ERROR | stderr | raise exc
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await self.app(scope, receive, sender)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 10:02:12 | ERROR | stderr | raise e
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 10:02:12 | ERROR | stderr | await route.handle(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 10:02:12 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 10:02:12 | ERROR | stderr | await response(scope, receive, send)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 10:02:12 | ERROR | stderr | async with anyio.create_task_group() as task_group:
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 10:02:12 | ERROR | stderr | raise exceptions[0]
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 10:02:12 | ERROR | stderr | await func()
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 10:02:12 | ERROR | stderr | async for chunk in self.body_iterator:
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 10:02:12 | ERROR | stderr | async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 10:02:12 | ERROR | stderr | async for raw_chunk in response.aiter_raw():
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 10:02:12 | ERROR | stderr | async for raw_stream_bytes in self.stream:
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr | async for chunk in self._stream:
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 10:02:12 | ERROR | stderr | with map_httpcore_exceptions():
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:02:12 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 10:02:12 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 10:02:12 | ERROR | stderr | raise mapped_exc(message) from exc
2023-11-24 10:02:12 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:04:00 | ERROR | stderr | INFO: Started server process [61185]
2023-11-24 10:04:00 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:04:00 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:04:00 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:04:14 | INFO | stdout | INFO: ::1:63500 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:04:37 | ERROR | stderr | INFO: Started server process [61223]
2023-11-24 10:04:37 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:04:37 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:04:37 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:12:09 | ERROR | stderr | INFO: Started server process [61355]
2023-11-24 10:12:09 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:12:09 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:12:09 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:12:38 | INFO | stdout | INFO: ::1:63824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:12:38 | ERROR | stderr | ERROR: Exception in ASGI application
2023-11-24 10:12:38 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 10:12:38 | ERROR | stderr | yield
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 10:12:38 | ERROR | stderr | event = self._h11_state.next_event()
2023-11-24 10:12:38 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 10:12:38 | ERROR | stderr | event = self._extract_next_receive_event()
2023-11-24 10:12:38 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 10:12:38 | ERROR | stderr | event = self._reader.read_eof() # type: ignore[attr-defined]
2023-11-24 10:12:38 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 10:12:38 | ERROR | stderr | raise RemoteProtocolError(
2023-11-24 10:12:38 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:12:38 | ERROR | stderr |
2023-11-24 10:12:38 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:12:38 | ERROR | stderr |
2023-11-24 10:12:38 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 10:12:38 | ERROR | stderr | yield
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr | async for part in self._httpcore_stream:
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr | async for part in self._stream:
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr | raise exc
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr | async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 10:12:38 | ERROR | stderr | event = await self._receive_event(timeout=timeout)
2023-11-24 10:12:38 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 10:12:38 | ERROR | stderr | with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:12:38 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 10:12:38 | ERROR | stderr | raise to_exc(exc) from exc
2023-11-24 10:12:38 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:12:38 | ERROR | stderr |
2023-11-24 10:12:38 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:12:38 | ERROR | stderr |
2023-11-24 10:12:38 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 10:12:38 | ERROR | stderr | result = await app( # type: ignore[func-returns-value]
2023-11-24 10:12:38 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 10:12:38 | ERROR | stderr | return await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await super().__call__(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await self.middleware_stack(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 10:12:38 | ERROR | stderr | raise exc
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await self.app(scope, receive, _send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 10:12:38 | ERROR | stderr | raise exc
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await self.app(scope, receive, sender)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 10:12:38 | ERROR | stderr | raise e
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 10:12:38 | ERROR | stderr | await route.handle(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 10:12:38 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 10:12:38 | ERROR | stderr | await response(scope, receive, send)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 10:12:38 | ERROR | stderr | async with anyio.create_task_group() as task_group:
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 10:12:38 | ERROR | stderr | raise exceptions[0]
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 10:12:38 | ERROR | stderr | await func()
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 10:12:38 | ERROR | stderr | async for chunk in self.body_iterator:
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 10:12:38 | ERROR | stderr | async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 10:12:38 | ERROR | stderr | async for raw_chunk in response.aiter_raw():
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 10:12:38 | ERROR | stderr | async for raw_stream_bytes in self.stream:
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr | async for chunk in self._stream:
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 10:12:38 | ERROR | stderr | with map_httpcore_exceptions():
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:12:38 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 10:12:38 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 10:12:38 | ERROR | stderr | raise mapped_exc(message) from exc
2023-11-24 10:12:38 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:15:22 | INFO | stdout | INFO: ::1:64016 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2023-11-24 10:16:21 | INFO | stdout | INFO: ::1:64047 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2023-11-24 10:19:40 | ERROR | stderr | INFO: Started server process [61513]
2023-11-24 10:19:40 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:19:40 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:19:40 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:20:08 | INFO | stdout | INFO: ::1:64247 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:20:08 | ERROR | stderr | ERROR: Exception in ASGI application
2023-11-24 10:20:08 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 10:20:08 | ERROR | stderr | yield
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 10:20:08 | ERROR | stderr | event = self._h11_state.next_event()
2023-11-24 10:20:08 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 10:20:08 | ERROR | stderr | event = self._extract_next_receive_event()
2023-11-24 10:20:08 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 10:20:08 | ERROR | stderr | event = self._reader.read_eof() # type: ignore[attr-defined]
2023-11-24 10:20:08 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 10:20:08 | ERROR | stderr | raise RemoteProtocolError(
2023-11-24 10:20:08 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:20:08 | ERROR | stderr |
2023-11-24 10:20:08 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:20:08 | ERROR | stderr |
2023-11-24 10:20:08 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 10:20:08 | ERROR | stderr | yield
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr | async for part in self._httpcore_stream:
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr | async for part in self._stream:
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr | raise exc
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr | async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 10:20:08 | ERROR | stderr | event = await self._receive_event(timeout=timeout)
2023-11-24 10:20:08 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 10:20:08 | ERROR | stderr | with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:20:08 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 10:20:08 | ERROR | stderr | raise to_exc(exc) from exc
2023-11-24 10:20:08 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:20:08 | ERROR | stderr |
2023-11-24 10:20:08 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 10:20:08 | ERROR | stderr |
2023-11-24 10:20:08 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 10:20:08 | ERROR | stderr | result = await app( # type: ignore[func-returns-value]
2023-11-24 10:20:08 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 10:20:08 | ERROR | stderr | return await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await super().__call__(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await self.middleware_stack(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 10:20:08 | ERROR | stderr | raise exc
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await self.app(scope, receive, _send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 10:20:08 | ERROR | stderr | raise exc
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await self.app(scope, receive, sender)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 10:20:08 | ERROR | stderr | raise e
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 10:20:08 | ERROR | stderr | await route.handle(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 10:20:08 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 10:20:08 | ERROR | stderr | await response(scope, receive, send)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 10:20:08 | ERROR | stderr | async with anyio.create_task_group() as task_group:
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 10:20:08 | ERROR | stderr | raise exceptions[0]
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 10:20:08 | ERROR | stderr | await func()
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 10:20:08 | ERROR | stderr | async for chunk in self.body_iterator:
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 10:20:08 | ERROR | stderr | async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 10:20:08 | ERROR | stderr | async for raw_chunk in response.aiter_raw():
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 10:20:08 | ERROR | stderr | async for raw_stream_bytes in self.stream:
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr | async for chunk in self._stream:
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 10:20:08 | ERROR | stderr | with map_httpcore_exceptions():
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 10:20:08 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 10:20:08 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 10:20:08 | ERROR | stderr | raise mapped_exc(message) from exc
2023-11-24 10:20:08 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 10:24:49 | ERROR | stderr | INFO: Started server process [61597]
2023-11-24 10:24:49 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:24:49 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:24:49 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:25:04 | INFO | stdout | INFO: ::1:64683 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 10:25:36 | ERROR | stderr | INFO: Started server process [61641]
2023-11-24 10:25:36 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 10:25:36 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 10:25:36 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 10:26:17 | INFO | stdout | INFO: ::1:64765 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 13:33:33 | ERROR | stderr | INFO: Started server process [63574]
2023-11-24 13:33:33 | ERROR | stderr | INFO: Waiting for application startup.
2023-11-24 13:33:33 | ERROR | stderr | INFO: Application startup complete.
2023-11-24 13:33:33 | ERROR | stderr | INFO: Uvicorn running on http://localhost:20000 (Press CTRL+C to quit)
2023-11-24 13:33:52 | INFO | stdout | INFO: ::1:62144 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2023-11-24 13:33:53 | ERROR | stderr | ERROR: Exception in ASGI application
2023-11-24 13:33:53 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
2023-11-24 13:33:53 | ERROR | stderr | yield
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 209, in _receive_event
2023-11-24 13:33:53 | ERROR | stderr | event = self._h11_state.next_event()
2023-11-24 13:33:53 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 469, in next_event
2023-11-24 13:33:53 | ERROR | stderr | event = self._extract_next_receive_event()
2023-11-24 13:33:53 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_connection.py", line 419, in _extract_next_receive_event
2023-11-24 13:33:53 | ERROR | stderr | event = self._reader.read_eof() # type: ignore[attr-defined]
2023-11-24 13:33:53 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/h11/_readers.py", line 204, in read_eof
2023-11-24 13:33:53 | ERROR | stderr | raise RemoteProtocolError(
2023-11-24 13:33:53 | ERROR | stderr | h11._util.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 13:33:53 | ERROR | stderr |
2023-11-24 13:33:53 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 13:33:53 | ERROR | stderr |
2023-11-24 13:33:53 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
2023-11-24 13:33:53 | ERROR | stderr | yield
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 249, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr | async for part in self._httpcore_stream:
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/connection_pool.py", line 361, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr | async for part in self._stream:
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 337, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr | raise exc
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 329, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr | async for chunk in self._connection._receive_response_body(**kwargs):
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 198, in _receive_response_body
2023-11-24 13:33:53 | ERROR | stderr | event = await self._receive_event(timeout=timeout)
2023-11-24 13:33:53 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_async/http11.py", line 208, in _receive_event
2023-11-24 13:33:53 | ERROR | stderr | with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}):
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 13:33:53 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2023-11-24 13:33:53 | ERROR | stderr | raise to_exc(exc) from exc
2023-11-24 13:33:53 | ERROR | stderr | httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)
2023-11-24 13:33:53 | ERROR | stderr |
2023-11-24 13:33:53 | ERROR | stderr | The above exception was the direct cause of the following exception:
2023-11-24 13:33:53 | ERROR | stderr |
2023-11-24 13:33:53 | ERROR | stderr | Traceback (most recent call last):
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
2023-11-24 13:33:53 | ERROR | stderr | result = await app( # type: ignore[func-returns-value]
2023-11-24 13:33:53 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
2023-11-24 13:33:53 | ERROR | stderr | return await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/applications.py", line 1106, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await super().__call__(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/applications.py", line 122, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await self.middleware_stack(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in __call__
2023-11-24 13:33:53 | ERROR | stderr | raise exc
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await self.app(scope, receive, _send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
2023-11-24 13:33:53 | ERROR | stderr | raise exc
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await self.app(scope, receive, sender)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
2023-11-24 13:33:53 | ERROR | stderr | raise e
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 718, in __call__
2023-11-24 13:33:53 | ERROR | stderr | await route.handle(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
2023-11-24 13:33:53 | ERROR | stderr | await self.app(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/routing.py", line 69, in app
2023-11-24 13:33:53 | ERROR | stderr | await response(scope, receive, send)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 270, in __call__
2023-11-24 13:33:53 | ERROR | stderr | async with anyio.create_task_group() as task_group:
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 597, in __aexit__
2023-11-24 13:33:53 | ERROR | stderr | raise exceptions[0]
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 273, in wrap
2023-11-24 13:33:53 | ERROR | stderr | await func()
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/starlette/responses.py", line 262, in stream_response
2023-11-24 13:33:53 | ERROR | stderr | async for chunk in self.body_iterator:
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 458, in chat_completion_stream_generator
2023-11-24 13:33:53 | ERROR | stderr | async for content in generate_completion_stream(gen_params, worker_addr):
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/fastchat/serve/openai_api_server.py", line 638, in generate_completion_stream
2023-11-24 13:33:53 | ERROR | stderr | async for raw_chunk in response.aiter_raw():
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_models.py", line 990, in aiter_raw
2023-11-24 13:33:53 | ERROR | stderr | async for raw_stream_bytes in self.stream:
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_client.py", line 146, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr | async for chunk in self._stream:
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 248, in __aiter__
2023-11-24 13:33:53 | ERROR | stderr | with map_httpcore_exceptions():
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/contextlib.py", line 155, in __exit__
2023-11-24 13:33:53 | ERROR | stderr | self.gen.throw(typ, value, traceback)
2023-11-24 13:33:53 | ERROR | stderr | File "/opt/homebrew/Caskroom/miniconda/base/envs/lc027/lib/python3.11/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
2023-11-24 13:33:53 | ERROR | stderr | raise mapped_exc(message) from exc
2023-11-24 13:33:53 | ERROR | stderr | httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)