Skip to content

Fix: MLflow streaming spans for Anthropic passthrough - #17288

Merged
2 commits merged into
BerriAI:mainfrom
uc4w6c:fix/mlflow-anthropic-stream
Dec 5, 2025
Merged

2 commits merged into
BerriAI:mainfrom
uc4w6c:fix/mlflow-anthropic-stream

Conversation

@uc4w6c

@uc4w6c uc4w6c commented Nov 30, 2025

Copy link
Copy Markdown
Contributor

Title

Fix: MLflow streaming spans for Anthropic passthrough

Relevant issues

#N/A

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
  • I have added a screenshot of my new test passing locally
  • My PR passes all unit tests on make test-unit
  • My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🐛 Bug Fix
✅ Test

Changes

https://www.loom.com/share/bfa28a2660a14fe7a4cd14ed840ea3fd

@vercel

vercel Bot commented Nov 30, 2025

Copy link
Copy Markdown

@uc4w6c is attempting to deploy a commit to the CLERKIEAI Team on Vercel.

A member of the Team first needs to authorize it.

from mlflow.entities import SpanEvent

try:
for choice in response_obj.choices:

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this looks like a bug @uc4w6c - logging integrations should not need to worry about streaming chunks. The litellm_logging.py should be giving them an assembled regular object

is this potentially an upstream error?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@krrishdholakia Thanks for pointing that out - you're right, that handling wasn't needed.
I’ve removed it accordingly. Appreciate the feedback!

@ghost ghost added the changes requested label Dec 2, 2025
@vercel

vercel Bot commented Dec 3, 2025 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
litellm Error Error Dec 3, 2025 9:20pm

@ghost
ghost merged commit 4d39a1a into BerriAI:main Dec 5, 2025
4 of 8 checks passed
@uc4w6c
uc4w6c deleted the fix/mlflow-anthropic-stream branch December 6, 2025 00:22
fzowl pushed a commit to fzowl/litellm that referenced this pull request Jun 24, 2026
* Fix: MLflow streaming spans for Anthropic passthrough

* fix: Revert "Handle MLflow chunk events without delta"
This pull request was closed.

This branch had an error being deployed

1 failed deployment
Preview — 742e23e7 Deployed Dec 3, 2025 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant