Skip to content

Add forward endpoint and forward-only processing for custom losses#9

Open
benji-cannot-code wants to merge 1 commit into
mainfrom
codex/implement-custom-loss-function-support-65iq4z
Open

Add forward endpoint and forward-only processing for custom losses#9
benji-cannot-code wants to merge 1 commit into
mainfrom
codex/implement-custom-loss-function-support-65iq4z

Conversation

@benji-cannot-code
Copy link
Copy Markdown
Owner

Summary

  • add a /api/v1/forward endpoint and advertise it in the root API description
  • extend the engine with a forward-only execution path and scheduler support so clients can fetch logprobs without accumulating gradients
  • cover the new forward path with a unit test

Testing

  • pytest tests/tinker/test_engine.py::test_forward_batch_produces_logprobs_without_accumulating_grads (fails: ModuleNotFoundError: No module named 'tx')

Codex Task

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant