File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -57,15 +57,15 @@ pip install dist/fastdeploy-2.0.0a0-py3-none-any.whl
5757
5858在安装后,执行如下命令快速部署Qwen2模型, 更多参数的配置与含义参考[ 参数说明] ( docs/serving.md ) .
5959
60- ```
60+ ``` shell
6161# 下载与解压Qwen模型
6262wget https://fastdeploy.bj.bcebos.com/llm/models/Qwen2-7B-Instruct.tar.gz && tar xvf Qwen2-7B-Instruct.tar.gz
6363# 指定单卡部署
6464python -m fastdeploy.entrypoints.openai.api_server --model ./Qwen2-7B-Instruct --port 8188 --tensor-parallel-size 1
6565```
6666
6767使用如下命令请求模型服务
68- ```
68+ ``` shell
6969curl -X POST " http://0.0.0.0:8188/v1/chat/completions" \
7070-H " Content-Type: application/json" \
7171-d ' {
@@ -75,7 +75,7 @@ curl -X POST "http://0.0.0.0:8188/v1/chat/completions" \
7575}'
7676```
7777响应结果如下所示
78- ```
78+ ``` json
7979{
8080 "id" : " chatcmpl-db662f47-7c8c-4945-9a7a-db563b2ddd8d" ,
8181 "object" : " chat.completion" ,
You can’t perform that action at this time.
0 commit comments