feat(openrouter): price typesafe/jev-1.13 and add an openrouter decisions pass-through by devin-ai-integration[bot] · Pull Request #42301 · BerriAI/litellm

devin-ai-integration · 2026-09-21T20:22:40Z

TLDR

Problem this solves:

openrouter/typesafe/jev-1.13 had no pricing row, so spend logged as 0
OpenRouter rejects this model on /chat/completions, so no proxy route could reach it

How it solves it:

Adds the openrouter/typesafe/jev-1.13 row to both cost maps
Adds a /openrouter/{path} pass-through rooted at OPENROUTER_API_BASE minus its /v1 (default https://openrouter.ai/api)
Prices /alpha/decisions responses from the new row using the shared TypeSafe usage handler; other OpenRouter paths keep generic pass-through logging

User Flow

Before: a developer cannot run a Jev decision through the proxy at all

They add openrouter/typesafe/jev-1.13 to the proxy model list with an OpenRouter key
They send POST https://litellm-domain/v1/chat/completions with "model": "jev" and a messages array
OpenRouter answers 400: "typesafe/jev-1.13 is a decisions model and cannot be used with the chat/completions endpoint. Use the /api/alpha/decisions endpoint instead", with x-litellm-response-cost: 0
They send POST https://litellm-domain/openrouter/alpha/decisions and get 404, since the proxy has no such route

After: the same developer sends a decisions request through the proxy and it is priced

They set OPENROUTER_API_KEY on the proxy (or a model-list deployment with use_in_pass_through: true)
They send POST https://litellm-domain/openrouter/alpha/decisions with {"model": "typesafe/jev-1.13", "state": "...", "questions": {"blue": {"type": "noul", "instructions": "..."}}}
They get 200 with OpenRouter's body: {"model": "typesafe/jev-1.13-20260917", "answers": {...}, "usage": {"input_tokens": 282, "output_tokens": 20, ...}}
The request is logged under openrouter/typesafe/jev-1.13-20260917 with spend 282 * 4.2e-08 = 1.1844e-05, matching OpenRouter's own usage.cost

Relevant issues

Affected release

Linear ticket

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

I have added meaningful tests
The handful of test files covering my change pass locally, e.g. uv run pytest tests/test_litellm/<your_test_file>.py -v. Leave the suites (make test-unit-*, make test-unit) to CI: it finishes in ~15 minutes where a laptop takes an hour or more
My PR passes all required CI/CD checks (e.g., lint, schema.d.ts sync check, etc.)
My PR's scope is as isolated as possible; it only solves 1 specific problem
I have received a Greptile Confidence Score of at least 4/5 before requesting a maintainer review (Greptile reviews automatically once the PR is opened; only comment @greptileai to re-request a review after pushing changes)

Delays in PR merge?

If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).

Screenshots / Proof of Fix

Setup: proxy on localhost:4123 with OPENROUTER_API_KEY set and a model list entry jev -> openrouter/typesafe/jev-1.13, real OpenRouter calls.

Before (`662e5b6`)

curl -si http://localhost:4123/v1/chat/completions -H 'Authorization: Bearer sk-1234' -H 'Content-Type: application/json' -d '{"model":"jev","messages":[{"role":"user","content":"Is the sky blue? Answer yes or no."}]}'
HTTP/1.1 400 Bad Request, x-litellm-response-cost: 0, body: typesafe/jev-1.13 is a decisions model and cannot be used with the chat/completions endpoint. Use the /api/alpha/decisions endpoint instead.
curl -si http://localhost:4123/openrouter/alpha/decisions ... returns 404 Not Found (no such route)

After (`5ae939f`; commits `4408ed1` and `d994218` only sync generated OpenAPI types and the gateway allowlist; `5752c81` changes the base default to `https://openrouter.ai/api/v1` with the `/v1` stripped, which resolves to the same target shown below, and limits pricing to `/alpha/decisions`)

curl -si http://localhost:4123/openrouter/alpha/decisions -H 'Authorization: Bearer sk-1234' -H 'Content-Type: application/json' -d '{"model":"typesafe/jev-1.13","state":"The sky is blue on a clear day.","questions":{"blue":{"type":"noul","instructions":"Is the sky described as blue?"}}}'
Output:

HTTP/1.1 200 OK
x-provider-name: TypeSafe
x-litellm-call-id: 94b95553-030a-4992-be57-2332039af5b4
x-litellm-model-api-base: https://openrouter.ai/api/alpha/decisions

{"model":"typesafe/jev-1.13-20260917","answers":{"blue":{"type":"noul","noul":0.99}},"usage":{"input_tokens":282,"output_tokens":20,"cost":0.000011844},"id":"gen-dec-1790025451-5xbBS4UbLxPw0gOzppNb","provider":"TypeSafe"}

Success callback for that call: model=openrouter/typesafe/jev-1.13-20260917 custom_llm_provider=openrouter response_cost=1.1844e-05 (282 * 4.2e-08, equal to OpenRouter's reported usage.cost)
Direct TypeSafe pass-through still prices the same way after the shared handler grew a custom_llm_provider parameter (same proxy, TYPESAFE_API_KEY set, real TypeSafe call):

curl -si http://localhost:4123/typesafe/v1/systemone -H 'Authorization: Bearer sk-1234' -H 'Content-Type: application/json' -d '{"model":"jev-latest","state":"The sky is blue on a clear day.","questions":{"blue":{"type":"noul","instructions":"Is the sky described as blue?"}}}'

HTTP/1.1 200 OK
x-litellm-model-api-base: https://api.typesafe.ai/v1/systemone
{"model":"jev-1.13.0","answers":{"blue":{"type":"noul","noul":0.99}},"usage":{"input_tokens":282,"output_tokens":20}}

Success callback: model=typesafe/jev-1.13.0 custom_llm_provider=typesafe response_cost=1.1844e-05

Mutation check for the tests: changing the route default to https://openrouter.ai fails test_uses_default_target_when_base_is_unset; dropping the request-model fallback in the pricing lookup fails test_openrouter_decisions_response_is_priced_from_request_model_registry_row with cost 0

Type

🆕 New Feature

Caveats (if any)

Medium

Any OpenRouter path is forwarded, but only /alpha/decisions responses are priced; other paths log 0 cost
The response model is dated (jev-1.13-20260917), so pricing falls back to the request model row; spend is logged under the dated name

Low

Route has no streaming support, same as the TypeSafe pass-through
/openrouter/ route pricing uses the cost map, not OpenRouter's usage.cost

Final Attestation

The tests check the right things, including the edge cases, and regressions in the respective real-world customer use-cases are not possible after this PR

Link to Devin session: https://app.devin.ai/sessions/6af5bb4bbf474464af3e36f31cd88bb5
Open in Devin Desktop: https://app.devin.ai/desktop/session/6af5bb4bbf474464af3e36f31cd88bb5?variant=devin

Note

Medium Risk
New authenticated proxy surface forwards arbitrary OpenRouter paths upstream; spend logging is specialized only for /alpha/decisions, so other routes may still log zero cost.

Overview
Adds OpenRouter LLM pass-through at /openrouter/{endpoint} so clients can reach non-chat APIs (notably /alpha/decisions for TypeSafe Jev models). The route forwards all HTTP methods to OPENROUTER_API_BASE (default https://openrouter.ai/api after stripping a trailing /v1) with OPENROUTER credentials, and is wired into the gateway allowlist, lazy-loaded passthrough feature, and OpenAPI snapshots.

Registers openrouter/typesafe/jev-1.13 in the model cost maps and extends the shared TypeSafe pass-through logging handler to take a custom_llm_provider argument. Pass-through success logging now applies that handler only for TypeSafe and for OpenRouter paths ending in /alpha/decisions, so decisions responses get token usage and registry-based spend; other OpenRouter pass-through paths keep generic logging (no TypeSafe pricing).

^{Reviewed by Cursor Bugbot for commit eaea4ae. Bugbot is set up for automated code reviews on this repo. Configure here.}

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration · 2026-09-21T20:22:42Z

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

Disable automatic comment, CI, and merge conflict monitoring

CLAassistant · 2026-09-21T20:22:54Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

greptile-apps · 2026-09-21T20:24:51Z

Confidence Score: 4/5

The PR is not yet safe to merge because decisions requests with a trailing slash still bypass spend calculation, and the provider-specific proxy implementation still violates an explicit repository requirement.

Findings

Trailing Slash Skips Pricing ▶
Provider Logic Outside Integration ▶

Summary

Adds an OpenRouter pass-through route for decisions requests and pricing support for openrouter/typesafe/jev-1.13.

Registers /openrouter/{endpoint} across proxy routing, gateway allowlisting, lazy loading, and generated API schemas.
Reuses the TypeSafe usage handler to price OpenRouter decisions responses, including request-model fallback for dated response model names.
Adds cost-map entries and regression coverage for routing, credentials, URL construction, and spend calculation.
Changes since the previous review consist of merging the updated base branch; the OpenRouter feature files themselves are unchanged.

_{Reviews (4) · Last reviewed commit: "Merge remote-tracking branch 'origin/mai..."}

codspeed · 2026-09-21T20:25:07Z

Merging this PR will not alter performance

✅ 31 untouched benchmarks

_{Comparing devin/1790022076-openrouter-typesafe-jev (eaea4ae) with main (5d3d99e)}

codecov · 2026-09-21T20:31:51Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

litellm-stampbot · 2026-09-22T00:47:53Z

@greptile run

litellm-stampbot · 2026-09-22T00:47:58Z

@BugBot run

cursor

Stale Bugbot comment from a previous run.

cursor · 2026-09-22T00:50:51Z

+    fastapi_response: Response,
+    user_api_key_dict: Annotated[UserAPIKeyAuth, Depends(user_api_key_auth)],
+):
+    base_target_url: Final = get_secret_str("OPENROUTER_API_BASE") or "https://openrouter.ai/api"


OpenRouter base path conflicts with existing default

Medium Severity

The new /openrouter/ pass-through reads OPENROUTER_API_BASE but falls back to https://openrouter.ai/api, while every other OpenRouter integration in LiteLLM defaults to https://openrouter.ai/api/v1. When that env var is already set to the existing standard base, decisions requests are forwarded to /api/v1/alpha/decisions instead of /api/alpha/decisions, so the new route fails for deployments that already use OpenRouter chat.

^{Reviewed by Cursor Bugbot for commit d994218. Configure here.}

Fixed in 5752c81: default is now https://openrouter.ai/api/v1 like the rest, and a trailing /v1 is stripped to derive the api root

…i base and price only decisions responses Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

litellm-stampbot · 2026-09-22T02:26:07Z

@greptileai

litellm-stampbot · 2026-09-22T02:26:08Z

bugbot run

cursor

Stale Bugbot comment from a previous run.

greptile-apps · 2026-09-22T02:28:35Z

        return custom_llm_provider == "typesafe"

+    def is_openrouter_decisions_route(self, url_route: str, custom_llm_provider: str | None) -> bool:
+        return custom_llm_provider == "openrouter" and urlparse(url_route).path.endswith("/alpha/decisions")


Trailing Slash Skips Pricing

A decisions request with a trailing slash produces a path ending in /alpha/decisions/, which does not pass this exact suffix check. The upstream request can still succeed, but its usage and spend are not recorded. Normalize the trailing slash before matching.

Suggested change

return custom_llm_provider == "openrouter" and urlparse(url_route).path.endswith("/alpha/decisions")

return custom_llm_provider == "openrouter" and urlparse(url_route).path.rstrip("/").endswith(

"/alpha/decisions"

)

greptile-apps · 2026-09-22T02:28:35Z

+    base_target_url: Final = get_secret_str("OPENROUTER_API_BASE") or "https://openrouter.ai/api/v1"
+    api_root: Final = base_target_url.removesuffix("/").removesuffix("/v1")
+    encoded_endpoint: Final = httpx.URL(endpoint).path
+    normalized_endpoint: Final = encoded_endpoint if encoded_endpoint.startswith("/") else f"/{encoded_endpoint}"
+    base_url: Final = httpx.URL(api_root)
+    updated_url: Final = base_url.copy_with(
+        path=HttpPassThroughEndpointHelpers.join_base_and_endpoint_path(base_url, normalized_endpoint),
+    )
+    openrouter_api_key: Final = passthrough_endpoint_router.get_credentials(
+        custom_llm_provider="openrouter",
+        region_name=None,
+    )
+    endpoint_func: Final = create_pass_through_route(
+        endpoint=endpoint,
+        target=str(updated_url),
+        custom_headers={  # mutable-ok: pass-through request headers require a mutable mapping
+            "Authorization": f"Bearer {openrouter_api_key}",
+            "Content-Type": "application/json",
+        },
+        custom_llm_provider="openrouter",
+        is_streaming_request=False,


Provider Logic Outside Integration

This proxy module directly implements OpenRouter-specific URL normalization, credential selection, authorization headers, and routing behavior. That violates the repository directive to keep provider-specific code under llms/. This repository requirement must be satisfied before merging by moving this behavior behind the OpenRouter integration and leaving the proxy layer generic.

Rule Used: What: Avoid writing provider-specific code outside of the llms/ directory. Why: This practice ensures better maintainability and reduces complexity over time. Good: ```python # Handle provider-specific logic within llms/vertex_ai/transformation.py ... (source)

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!

…router-typesafe-jev

litellm-stampbot · 2026-09-22T02:36:49Z

@greptileai

litellm-stampbot · 2026-09-22T02:36:50Z

bugbot run

cursor

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit eaea4ae. Configure here.}

…ions pass-through (#42301) Backport of #42301 to stable/1.102.x. Cherry-picked from 1106b16 (main).

…ions pass-through (#42301) Backport of #42301 to stable/1.101.x. Cherry-picked from 1106b16 (main).

feat(openrouter): add typesafe/jev-1.13 pricing

fdb21bc

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration Bot requested a review from a team September 21, 2026 20:22

devin-ai-integration Bot requested review from litellm-stampbot, mateo-berri and ryan-crabbe-berri as code owners September 21, 2026 20:22

greptile-apps Bot reviewed Sep 21, 2026

View reviewed changes

Comment thread model_prices_and_context_window.json

feat(proxy): route OpenRouter decisions through pass-through

5ae939f

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration Bot had a problem deploying to e2e-changed September 21, 2026 21:21 Error

devin-ai-integration Bot changed the title ~~feat(openrouter): add typesafe/jev-1.13 pricing~~ feat(openrouter): price typesafe/jev-1.13 and add an openrouter decisions pass-through Sep 21, 2026

chore(proxy): sync generated OpenAPI types

4408ed1

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration Bot had a problem deploying to e2e-changed September 21, 2026 21:45 Error

fix(proxy): expose OpenRouter passthrough in gateway

d994218

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration Bot had a problem deploying to e2e-changed September 21, 2026 22:06 Error

greptile-apps Bot reviewed Sep 22, 2026

View reviewed changes

Comment thread litellm/proxy/pass_through_endpoints/success_handler.py Outdated

cursor Bot reviewed Sep 22, 2026

View reviewed changes

fix(openrouter): derive the pass-through root from the standard v1 ap…

5752c81

…i base and price only decisions responses Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration Bot had a problem deploying to e2e-changed September 22, 2026 02:25 Error

cursor Bot reviewed Sep 22, 2026

View reviewed changes

greptile-apps Bot reviewed Sep 22, 2026

View reviewed changes

Merge remote-tracking branch 'origin/main' into devin/1790022076-open…

eaea4ae

…router-typesafe-jev

devin-ai-integration Bot requested a deployment to e2e-changed September 22, 2026 02:36 Waiting

cursor Bot reviewed Sep 22, 2026

View reviewed changes

litellm-stampbot enabled auto-merge (squash) September 22, 2026 02:42

litellm-stampbot approved these changes Sep 22, 2026

View reviewed changes

litellm-stampbot merged commit 1106b16 into main Sep 22, 2026
98 of 100 checks passed

litellm-stampbot deleted the devin/1790022076-openrouter-typesafe-jev branch September 22, 2026 02:44

litellm-stampbot mentioned this pull request Sep 22, 2026

[Feature]: Cost tracking for Jev when using OpenRouter #42200

Closed

1 task done

devin-ai-integration Bot added a commit that referenced this pull request Sep 22, 2026

feat(openrouter): price typesafe/jev-1.13 and add an openrouter decis…

d068734

…ions pass-through (#42301) Backport of #42301 to stable/1.102.x. Cherry-picked from 1106b16 (main).

devin-ai-integration Bot mentioned this pull request Sep 22, 2026

feat(typesafe): backport the jev change set to stable/1.102.x for v1.102.1 #42595

Merged

14 tasks done

devin-ai-integration Bot added a commit that referenced this pull request Sep 23, 2026

feat(openrouter): price typesafe/jev-1.13 and add an openrouter decis…

347ec67

…ions pass-through (#42301) Backport of #42301 to stable/1.101.x. Cherry-picked from 1106b16 (main).

This was referenced Sep 23, 2026

chore(backport): add the remaining jev changes to stable/1.100.x #42668

Open

chore(backport): add the remaining jev changes to stable/1.99.x #42669

Open

Aviator-Coding mentioned this pull request Sep 27, 2026

fix(litellm): lock down the built-in /openrouter pass-through to admin-only Aviator-Coding/home-ops#1812

Merged

9qeklajc mentioned this pull request Sep 29, 2026

feat: proxy OpenAI Decisions API at /v1/decisions Routstr/routstr-core#787

Merged

Conversation

devin-ai-integration Bot commented Sep 21, 2026 • edited by cursor Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

TLDR

User Flow

Relevant issues

Affected release

Linear ticket

Pre-Submission checklist

Delays in PR merge?

Screenshots / Proof of Fix

Before (662e5b6)

Type

Caveats (if any)

Medium

Low

Final Attestation

Uh oh!

devin-ai-integration Bot commented Sep 21, 2026

Uh oh!

CLAassistant commented Sep 21, 2026

Uh oh!

greptile-apps Bot commented Sep 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 4/5

Findings

Summary

Uh oh!

Uh oh!

codspeed Bot commented Sep 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will not alter performance

Uh oh!

codecov Bot commented Sep 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

litellm-stampbot commented Sep 22, 2026

Uh oh!

litellm-stampbot commented Sep 22, 2026

Uh oh!

Uh oh!

cursor Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

cursor Bot Sep 22, 2026

Choose a reason for hiding this comment

OpenRouter base path conflicts with existing default

Uh oh!

devin-ai-integration Bot Sep 22, 2026

Choose a reason for hiding this comment

Uh oh!

litellm-stampbot commented Sep 22, 2026

Uh oh!

litellm-stampbot commented Sep 22, 2026

Uh oh!

cursor Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

greptile-apps Bot Sep 22, 2026

Choose a reason for hiding this comment

Uh oh!

greptile-apps Bot Sep 22, 2026

Choose a reason for hiding this comment

Uh oh!

litellm-stampbot commented Sep 22, 2026

Uh oh!

litellm-stampbot commented Sep 22, 2026

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

This branch is waiting to be deployed

Reviewers

Assignees

Labels

Projects

devin-ai-integration Bot commented Sep 21, 2026 •

edited by cursor Bot

Loading

Before (`662e5b6`)

greptile-apps Bot commented Sep 21, 2026 •

edited

Loading

codspeed Bot commented Sep 21, 2026 •

edited

Loading

codecov Bot commented Sep 21, 2026 •

edited

Loading

cursor Bot left a comment •

edited

Loading

cursor Bot left a comment •

edited

Loading