Degraded

TokenMart

inference liveness across 9 models · last heartbeat 2m ago

claude-sonnet-4-6down · 2m ago · 1044ms · HTTP 404: {"error":{"message":"'claude-sonnet-4-6' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"re

0.0%

Uptime · 24h

0/96 checks

0.0%

Uptime · 7d

0/672 checks

33.3%

Uptime · 30d

960/2880 checks

—

Latency · 24h

7d —

claude-haiku-4-5-20251001down · 2m ago · 1027ms · HTTP 404: {"error":{"message":"'claude-haiku-4-5-20251001' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":n

0.0%

Uptime · 24h

0/96 checks

0.0%

Uptime · 7d

0/672 checks

0.0%

Uptime · 30d

0/2880 checks

—

Latency · 24h

7d —

gemini-3-flash-previewdown · 2m ago · 1289ms · HTTP 400: {"error":{"message":"Invalid JSON payload received. Unknown name \"messages\": Cannot find field.\nInvalid JSON payload received. Unknown name \"max_tokens\": Cannot find field","type":"server_error",

0.0%

Uptime · 24h

0/96 checks

0.0%

Uptime · 7d

0/672 checks

28.6%

Uptime · 30d

824/2880 checks

—

Latency · 24h

7d —

gemini-2.5-flashoperational · 2m ago · 2433ms

100%

Uptime · 24h

96/96 checks

98.7%

Uptime · 7d

663/672 checks

67.8%

Uptime · 30d

1952/2880 checks

2367ms

Latency · 24h

7d 2262ms

gemini-2.5-prooperational · 2m ago · 2976ms

97.9%

Uptime · 24h

94/96 checks

93.5%

Uptime · 7d

628/672 checks

65.8%

Uptime · 30d

1894/2880 checks

3207ms

Latency · 24h

7d 2901ms

glm-4.6down · 2m ago · 1000ms · HTTP 404: {"error":{"message":"'glm-4.6' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"request_id":

0.0%

Uptime · 24h

0/96 checks

0.0%

Uptime · 7d

0/672 checks

0.0%

Uptime · 30d

0/2880 checks

—

Latency · 24h

7d —

qwen3.5-flashdown · 2m ago · 984ms · HTTP 404: {"error":{"message":"'qwen3.5-flash' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"reques

0.0%

Uptime · 24h

0/96 checks

0.0%

Uptime · 7d

0/672 checks

0.0%

Uptime · 30d

0/2880 checks

—

Latency · 24h

7d —

gpt-5-nanodown · 2m ago · 2152ms · HTTP 404: {"error":{"message":"The requested resource was not found upstream","type":"server_error","code":"ERR_PROVIDER_005","param":null},"request_id":"01a0f4d0-bf77-7b57-8b36-812f52870f30"}

57.3%

Uptime · 24h

55/96 checks

86.0%

Uptime · 7d

578/672 checks

45.0%

Uptime · 30d

1297/2880 checks

2491ms

Latency · 24h

7d 2246ms

gpt-5.5down · 2m ago · 2141ms · HTTP 404: {"error":{"message":"The requested resource was not found upstream","type":"server_error","code":"ERR_PROVIDER_005","param":null},"request_id":"01a0f4d0-bf70-75f9-8ad2-2f2364b996a8"}

66.7%

Uptime · 24h

64/96 checks

88.8%

Uptime · 7d

597/672 checks

89.4%

Uptime · 30d

2576/2880 checks

2875ms

Latency · 24h

7d 2498ms

Integrity suite · daily

Protocol conformance from scripts/check-provider.sh · last run 50d ago. A fail here means this provider is not a safe least-cost target for that model.

claude-haiku-4-5-20251001

passbilling_drift2026-08-11: in $0.8500 vs $0.85 (0%), out $4.2500 vs $4.25 (0%)

claude-sonnet-4-6

passbilling_drift2026-08-11: in $2.5500 vs $2.55 (0%), out $12.7500 vs $12.75 (0%)

passTool call

passMulti-step tool loop

passmax_tokens honoredcompletion_tokens=8 for cap 8

passNo hidden-prompt injection

passToken count vs baselinethis=32 baseline=32 ratio=1.00x

passPrompt cachingcache_read_input_tokens=3753

gemini-2.5-flash

passbilling_drift2026-08-11: out $2.1250 vs $2.125 (0%)

gemini-2.5-pro

passbilling_drift2026-08-11: out $8.5000 vs $8.5 (0%)

failTool callno tool_calls — tools dropped?

skipMulti-step tool loopno tool_call id from step 1

failmax_tokens honoredcompletion_tokens=? for cap 8

passNo hidden-prompt injection

warnToken count vs baselineinconclusive (this=0 baseline=25)

gemini-3-flash-preview

passbilling_drift2026-08-11: out $2.5500 vs $2.55 (0%)

gpt-5-nano

passbilling_drift2026-08-05: out $0.3400 vs $0.34 (0%)

gpt-5.5

passbilling_drift2026-08-11: in $4.2500 vs $4.25 (0%), out $25.5000 vs $25.5 (-0%)

qwen3.5-flash

passbilling_drift2026-07-21: in $0.0850 vs $0.085 (0%), out $0.3400 vs $0.34 (0%)

Recent liveness failures

2026-10-01 00:15 UTCclaude-sonnet-4-6HTTP 404: {"error":{"message":"'claude-sonnet-4-6' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"re

2026-10-01 00:15 UTCclaude-haiku-4-5-20251001HTTP 404: {"error":{"message":"'claude-haiku-4-5-20251001' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":n

2026-10-01 00:15 UTCgemini-3-flash-previewHTTP 400: {"error":{"message":"Invalid JSON payload received. Unknown name \"messages\": Cannot find field.\nInvalid JSON payload received. Unknown name \"max_tokens\": Cannot find field","type":"server_error",

2026-10-01 00:15 UTCglm-4.6HTTP 404: {"error":{"message":"'glm-4.6' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"request_id":

2026-10-01 00:15 UTCqwen3.5-flashHTTP 404: {"error":{"message":"'qwen3.5-flash' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"reques

2026-10-01 00:15 UTCgpt-5-nanoHTTP 404: {"error":{"message":"The requested resource was not found upstream","type":"server_error","code":"ERR_PROVIDER_005","param":null},"request_id":"01a0f4d0-bf77-7b57-8b36-812f52870f30"}

2026-10-01 00:15 UTCgpt-5.5HTTP 404: {"error":{"message":"The requested resource was not found upstream","type":"server_error","code":"ERR_PROVIDER_005","param":null},"request_id":"01a0f4d0-bf70-75f9-8ad2-2f2364b996a8"}

2026-10-01 00:00 UTCclaude-sonnet-4-6HTTP 404: {"error":{"message":"'claude-sonnet-4-6' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"re

2026-10-01 00:00 UTCclaude-haiku-4-5-20251001HTTP 404: {"error":{"message":"'claude-haiku-4-5-20251001' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":n

2026-10-01 00:00 UTCgemini-3-flash-previewHTTP 400: {"error":{"message":"Invalid JSON payload received. Unknown name \"messages\": Cannot find field.\nInvalid JSON payload received. Unknown name \"max_tokens\": Cannot find field","type":"server_error",

2026-10-01 00:00 UTCglm-4.6HTTP 404: {"error":{"message":"'glm-4.6' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"request_id":

2026-10-01 00:00 UTCqwen3.5-flashHTTP 404: {"error":{"message":"'qwen3.5-flash' is not available on this API key's plan. Call GET /v1/models to see which models it can use.","type":"not_found_error","code":"ERR_MODEL_003","param":null},"reques