SF LLM Gateway

Salesforce LLM Gateway provider with model discovery

What it does

Complete Pi Provider for the Salesforce LLM Gateway. Pi-owned credential persistence and model storage, authenticated dynamic discovery with exact Pi-catalog admission, capability-coverage diagnostics and offline cache filtering, mixed-API dispatch, guarded Responses terminal-close recovery, Gateway-only prompt-cache-key omission, exact GPT Sol Responses priority requests, optional dedicated-model compaction, explicit refresh, connectivity diagnostics, opt-in bounded text/tool/generated-image probes, and usage status.

Start

Open the extension from its primary command:

/sf-llm-gateway

Open its Manager detail or change its package state with:

/sf-pi open sf-llm-gateway
/sf-pi enable sf-llm-gateway
/sf-pi disable sf-llm-gateway

Safety notes

• API-key input uses SF Pi's shared fixed-mask component and never enters Pi's visible stock prompt.
• Pi alone persists/removes active credentials; setup and import paths write no secrets.
• Extension config stores only non-secret settings; credentials remain Pi-owned.
• Dedicated compaction accepts only authenticated sf-llm-gateway models, never changes the chat model, and falls back to Pi.
• Discovery and restored cache entries publish only exact IDs backed by a reusable public Pi catalog API.
• Catalog-backed GPT models retain Pi's Responses transport even when Gateway discovery declares chat; other models continue to honor discovered route mode.
• Gateway OpenAI-compatible requests omit the optional prompt_cache_key field without changing other providers; this may reduce cache affinity.
• Only exact Gateway GPT-5.6 Sol and GPT-6 Sol Responses requests ask for priority; the effective tier is not asserted.
• Sentinel-only empty access clears stale selectable models; ambiguous discovery failures retain the last-known catalog.
• Recognized access, unsupported-image, transient-stream, and configuration failures are replaced with bounded guidance without echoing raw provider bodies.
• Responses terminal-close recovery accepts one terminal event only after all observed output items finish, preserves caller cancellation, and records a bounded warning diagnostic.
• Capability coverage counts only complete route records with mode, token limits, vision, reasoning, and function-calling declarations; missing or partial metadata is non-blocking for exact Pi-backed image input, while explicit contradictions warn in doctor.
• Ordinary doctor runs never invoke models; opt-in text, tool, and generated non-private image probes are bounded, billable, content-free, local-only, and never persisted or uploaded.
• Pi's settings.json is mutated through pi-settings.ts helpers with race-aware reads.

Exact reference

Show commands, tools, providers, and hooks

• Extension id: sf-llm-gateway
• Intent: Personalize pi
• Category: Provider
• Maturity: stable
• Default state: on
• Commands: /sf-llm-gateway
• LLM tools: none
• Providers: sf-llm-gateway
• Events/hooks: session_start, message_end, session_before_compact, turn_end, model_select, after_provider_response, session_shutdown

For contributors

• Full extension README
• Source folder
• Agent editing rules

Troubleshooting

See the Troubleshooting section in the full README for extension-specific recovery steps.