Repository navigation
fix(bedrock): handle cohere v4 embed response dictionary format - #17220
Merged
1 commit merged intoNov 28, 2025
Merged
1 commit merged into
1 commit merged into
Conversation
|
@AndyForest is attempting to deploy a commit to the CLERKIEAI Team on Vercel. A member of the Team first needs to authorize it. |
fzowl
pushed a commit
to fzowl/litellm
that referenced
this pull request
Jun 24, 2026
This pull request was closed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Title
Fix parsing of bedrock cohere embed v4 responses
Relevant issues
This PR fixes an issue where
bedrock/cohere.embed-v4models return a dictionary of embeddings (keyed by type, e.g.,float,int8) instead of a flat list, causing LiteLLM to incorrectly parse the response.Previously, LiteLLM would iterate over the dictionary keys (returning
["float", "int8"]) instead of the actual embedding vectors. This change explicitly checks if theembeddingsfield in the response is a dictionary and handles it asembeddings_by_type.Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unitI have also verified this in a live integration environment using
bedrock/cohere.embed-v4:0as well as confirming other embedding models are not affected such asbedrock/cohere.embed-multilingual-v3andbedrock/amazon.titan-embed-text-v2:0.Type
🐛 Bug Fix
✅ Test
Changes
litellm/llms/cohere/embed/v1_transformation.py
Added new code here to check the returned data.
tests/test_litellm/llms/bedrock/embed/test_bedrock_cohere_v4.py
I have added a new unit test that mocks the Cohere v4 response structure.