Skip to content

fix: configure inference route after provider creation - #40

Merged
sauagarwa merged 3 commits into
validatedpatterns-sandbox:mainfrom
sauagarwa:fix/inference-route-regression
Aug 20, 2026
Merged

fix: configure inference route after provider creation#40
sauagarwa merged 3 commits into
validatedpatterns-sandbox:mainfrom
sauagarwa:fix/inference-route-regression

Conversation

@sauagarwa

Copy link
Copy Markdown
Collaborator

Summary

  • apply_bom.py now calls openshell inference set after creating the first inference-capable provider
  • Added model field to BOM provider profiles (data-science/default and cuda-dev)

Problem

The BOM refactor in PR #34 missed porting openshell inference set from the old monolithic setup script. The gateway's inference route was never configured, so inference.local returned "Not configured" and the OpenClaw TUI failed with "LLM request failed."

The old script (pre-#34) had:

openshell inference set --provider "${FULL_FIRST}" --model "${FIRST_MODEL}" --no-verify

This was lost during the refactor to apply_bom.py.

Test plan

  • Delete setup Job, re-run → openshell inference get shows configured route
  • OpenClaw TUI responds to prompts (inference.local resolves correctly)

🤖 Generated with Claude Code

sauagarwa and others added 2 commits August 19, 2026 11:05
apply_bom.py now calls openshell inference set after creating the
first inference-capable provider. The model is specified in the BOM
provider profile. Without this, inference.local returns "not configured".

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Add clean-stale-operators as a prerequisite to pattern-install. Removes
CNV CRDs with broken conversion webhooks and stuck ArgoCD app finalizers
left from a previous uninstall. Safe no-op on a clean cluster.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@sauagarwa
sauagarwa requested a review from LinoyBitan1 August 19, 2026 15:14
The BOM refactor put cuda-sandbox in workspace cuda-dev, but the
Makefile targets hardcoded .default. Now all targets accept WORKSPACE
(defaults to "default").

Usage:
  make nemoclaw-tui SANDBOX_NAME=cuda-sandbox WORKSPACE=cuda-dev
  make openclaw-tui SANDBOX_NAME=notebook
  make openclaw-gui SANDBOX_NAME=notebook GUI_PORT=28789

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@mtalvi
mtalvi self-requested a review August 20, 2026 07:39

@mtalvi mtalvi left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!
Tested on my cluster and all works.

@sauagarwa
sauagarwa merged commit 0a6b01e into validatedpatterns-sandbox:main Aug 20, 2026
@LinoyBitan1

LinoyBitan1 commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator

Hi, while testing this fix end-to-end on fresh clusters, I found issues that prevent the TUI and GUI from working after deployment. Opened PR #43 to address them

@mtalvi

mtalvi commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator

Hi, while testing this fix end-to-end on fresh clusters, I found issues that prevent the TUI and GUI from working after deployment. Opened PR #43 to address them

That is strange, because when I tested I did not face those issues. Maybe we are doing something differently. Let's sync.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants