fix: use function body in DefaultChatTransport to send latest env vars

PROBLEM:
DefaultChatTransport body is cloned ONCE on mount, so env vars
were always empty {} even after localStorage loaded them.

SOLUTION:
Use a function for body instead of an object. AI SDK v6 calls
body() on each request, ensuring latest env vars are sent.

Changes:
- useChat.ts: body: { env } → body: () => ({ env: buildEnvObject() })
- buildEnvObject() is called fresh on each request
- Env vars now sent correctly to /api/chat

Credit: ChatGPT for identifying the exact AI SDK v6 pattern

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
Ajax Davis 2025-12-04 14:25:59 +10:00
parent 4094c661be
commit c6b4456baf
5 changed files with 111 additions and 14 deletions

View file

@ -0,0 +1,86 @@
# Environment Variables Not Sent to API - Frontend Transport Issue
## Problem
Environment variables saved in localStorage are NOT being sent to `/api/chat` endpoint.
**Evidence from logs:**
```
📥 Request body: {
"conversationId": "7xur5hf1GDSOQMgFYF-l7",
"env": {}, // ❌ EMPTY - should have FIRECRAWL_API_KEY
...
}
```
## Root Cause
The issue is in `apps/playground/src/hooks/useChat.ts`:
```typescript
export function useChat() {
const [conversationId] = useState(() => nanoid());
const envVars = useEnvVars(); // ❌ Empty on first render (useEffect loads async)
const envObject = envVars.reduce(
(acc, { key, value }) => {
acc[key] = value;
return acc;
},
{} as Record<string, string>
);
const chat = useAISDKChat({
transport: new DefaultChatTransport({ // ❌ Created ONCE with empty envObject
api: '/api/chat',
body: {
conversationId,
env: envObject, // ❌ This is {} on first render, never updates
},
}),
});
return { ...chat, conversationId };
}
```
**Why it fails:**
1. `useEnvVars()` loads from localStorage inside a `useEffect` (async)
2. On first render, `envVars = []`, so `envObject = {}`
3. `DefaultChatTransport` is created with `body: { env: {} }`
4. Even when `envVars` updates later, the transport is already created and doesn't re-create
## Attempted Solutions That Don't Work
**Just updating state** - Transport is created once and cached
**Using useEffect** - Transport is already created before effect runs
## What We Need
The `body` field in `DefaultChatTransport` needs to be **dynamic** and read the latest env vars on each request, not just once during component mount.
## Questions for ChatGPT
1. **How do we make `DefaultChatTransport` body dynamic?** Can we pass a function instead of an object?
2. **Does AI SDK have a way to update transport body between messages?** The env vars might change while the chat is open.
3. **Should we use a custom transport instead?** Can we implement our own transport that reads env vars fresh on each request?
4. **Alternative: Can we manually add env to each message?** Is there a way to inject extra data per-request instead of per-transport?
## Current Code Files
- `apps/playground/src/hooks/useChat.ts` - The broken hook
- `apps/playground/src/components/sidebar/SettingsSidebar.tsx` - Where env vars are stored (works fine)
- `apps/playground/src/app/api/chat/route.ts` - Server expects `body.env` but receives `{}`
## What We Know Works
✅ Saving env vars to localStorage - working
✅ Reading env vars from localStorage - working
✅ Server accepting and using env vars - working
❌ **Sending env vars from client to server - BROKEN**
The ONLY broken part is the transport not sending the latest env object.

View file

@ -32,7 +32,10 @@ export async function POST(request: NextRequest) {
const clientEnv: Record<string, string> = body.env || {};
console.log(`🔑 Conversation ID: ${conversationId}`);
console.log(`🔐 Client env vars: ${Object.keys(clientEnv).length} keys`, Object.keys(clientEnv));
console.log(
`🔐 Client env vars: ${Object.keys(clientEnv).length} keys`,
Object.keys(clientEnv)
);
// Store env vars for this conversation (so cached tools can access them)
setConversationEnv(conversationId, clientEnv);

View file

@ -18,22 +18,24 @@ export function useChat(): ReturnType<typeof useAISDKChat> & { conversationId: s
// Get environment variables from settings sidebar
const envVars = useEnvVars();
// Convert env vars to object format
const envObject = envVars.reduce(
(acc, { key, value }) => {
acc[key] = value;
return acc;
},
{} as Record<string, string>
);
// Convert env vars to object format (called fresh on each request)
const buildEnvObject = () =>
envVars.reduce(
(acc, { key, value }) => {
acc[key] = value;
return acc;
},
{} as Record<string, string>
);
const chat = useAISDKChat({
transport: new DefaultChatTransport({
api: '/api/chat',
body: {
// Use function body so it's evaluated on each request (not just once on mount)
body: () => ({
conversationId, // Pass conversation ID to API
env: envObject, // Pass environment variables to API
},
env: buildEnvObject(), // Pass LATEST environment variables to API
}),
}),
});

View file

@ -103,7 +103,10 @@ export async function loadToolDynamically(
// Get the latest env vars for this conversation (not from closure!)
const currentEnv = getConversationEnv(conversationId);
console.log(`🔐 Using env vars for conversation ${conversationId}:`, Object.keys(currentEnv));
console.log(
`🔐 Using env vars for conversation ${conversationId}:`,
Object.keys(currentEnv)
);
const execResponse = await fetch(`${RAILWAY_SERVICE_URL}/execute-tool`, {
method: 'POST',

View file

@ -231,7 +231,10 @@ async function executeTool(req: Request): Promise<Response> {
console.log(` ✅ Set ${key} = ${String(value).substring(0, 10)}...`);
}
// Verify they're set
console.log(`🔍 Verification - Deno.env has:`, envKeys.map(k => `${k}=${Deno.env.get(k)?.substring(0, 10)}...`));
console.log(
`🔍 Verification - Deno.env has:`,
envKeys.map((k) => `${k}=${Deno.env.get(k)?.substring(0, 10)}...`)
);
} else {
console.log(`⚠️ No env vars provided in request`);
}