Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Emit events to indicate InferencePool and InferenceModel status #382

Open
Tracked by #362
ahg-g opened this issue Feb 20, 2025 · 0 comments
Open
Tracked by #362

Emit events to indicate InferencePool and InferenceModel status #382

ahg-g opened this issue Feb 20, 2025 · 0 comments
Assignees

Comments

@ahg-g
Copy link
Contributor

ahg-g commented Feb 20, 2025

What would you like to be added:

EPP emits events to log some InferencePool and InferenceModel statuses, the two main events I can think of are:

  • InferencePool synced and accepted
  • InferenceModel accepted by the epp to be served on the referenced and matching InferencePool

Emitting events when the InferenceModel doesn't match the InferencePool is not applicable since the model likely belongs to another epp/pool.

Why is this needed:

To improve debuggability in the absence of Status updates for the short term (xref #380).

@kfswain kfswain self-assigned this Feb 21, 2025
@ahg-g ahg-g mentioned this issue Feb 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants