flask流式接口

大小瓶

已于 2025-07-31 18:15:26 修改

阅读量740

点赞数 1

CC 4.0 BY-SA版权

分类专栏：其他文章标签： flask python 后端

于 2024-05-30 10:09:01 首次发布

本文链接：https://blog.csdn.net/qq_43655307/article/details/139315300

其他专栏收录该内容

37 篇文章

订阅专栏

一、接口封装

1.普通

from flask import Flask, request, Response, stream_with_context
app = Flask(__name__)
app.logger.disabled = True

def chat_stream_(prompt):
    for new_text in ['1','2','3']:
        yield new_text

@app.route('/chat_stream', methods=['POST'])
def chat_stream():
    prompt = request.json['prompt']
    return Response(stream_with_context(chat_stream_(prompt)),  mimetype='text/event-stream',  headers={  'Cache-Control': 'no-cache',  'X-Accel-Buffering': 'no' })


if __name__ == '__main__':
    app.run('0.0.0.0', 1000)

2.SSE

from flask import Flask, request, Response, stream_with_context
app = Flask(__name__)
app.logger.disabled = True

def chat_stream_(prompt):
    for new_text in ['1','2','3']:
        yield f"data: {new_text}\n\n"

@app.route('/chat_stream', methods=['POST'])
def chat_stream():
    prompt = request.json['prompt']
    return Response(stream_with_context(chat_stream_(prompt)),  mimetype='text/event-stream',  headers={  'Cache-Control': 'no-cache',  'X-Accel-Buffering': 'no' })


if __name__ == '__main__':
    app.run('0.0.0.0', 1000)

3.对于vllm资源问题报错，单卡可以设置单线程

app.run('0.0.0.0', 1000, threaded=False, processes=1)

二、接收流式返回

1.普通

import requests
url = "http://127.0.0.1:1000/chat_stream"
data = {"prompt":"怎么编研文档"}
res = requests.post(url, json=data, stream=True)
for token in res:
    print(token.decode("utf-8"))

2.SSE

'''
pip install sseclient-py
'''
import requests
import sseclient
url = "http://127.0.0.1:1000/chat_stream"
data = {"prompt":"怎么编研文档"}
res = requests.post(url, json=data, stream=True)
# 使用 sseclient 解析 SSE 数据流
client = sseclient.SSEClient(res)

# 遍历事件并处理数据
for event in client.events():
    print(event.data)