feat(events producer): subgraph indexing agreement event emitter to send events to kafka#649
Merged
Conversation
cmwhited
commented
Jun 24, 2026
- Exposes a kafka producer instance for sending messages on a given topic
- Exposes a wrapper interface for sending Subgraph Indexing Agreement messages to the configured kafka producer, if enabled
…end events to kafka
MoonBoi9001
approved these changes
Jun 25, 2026
…emitter in callsites (#656) * feat(events producer): implement subgraph indexing agreements events emitter in callsites * feat(events producer): only emit n_indexer_unavailable once * fix: correct expiry timestamps and a duplicated shortfall event (#658) * fix(reassess): send shortfall event after the chain-time read The "not enough indexers" event was sent before the step that reads chain time to stamp deadlines. In local runs that read can fail and retry the whole job, resending the event each round; sending it after the read makes a retried round emit it once. * fix(expiration): report proposal time from the deadline clock The expiry event mixed clocks: "proposed at" came from wall time, "expired at" from chain time, so with local time controls on, expiry could look earlier than the proposal. Agreements now stamp proposal time in the deadline's clock; old rows fall back to created_at. * feat(events producer): PR review. hardening. atomic retries. error and app shutdown handling * fix: announce agreement events promptly and pause on outages (#670) * fix(listener): announce agreement events on every chain poll A recovery sweep running only every 60th poll was the sole emitter of the accepted, terminated and expired announcements, delaying each by 30 minutes while polling fast and up to 5 hours once the last live agreement was cancelled. Run those three every poll. * fix(listener): pause event sweeps briefly after a Kafka send failure Now that the accepted, terminated and expired announcements sweep every poll, a hung Kafka broker made each of the 3 sweeps block on its 30-second send, stalling chain polling every poll. After a failed send the sweeps now back off from 30 seconds up to 300 before retrying. --------- Co-authored-by: MoonBoi9001 <67825802+MoonBoi9001@users.noreply.github.com>
98c254a
into
chris.whited/feat-producer/initial-crate-with-proto
11 checks passed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.