flytekitplugins.inference.NIMSecrets#

class flytekitplugins.inference.NIMSecrets(ngc_image_secret, ngc_secret_key, secrets_prefix, ngc_secret_group=None, hf_token_group=None, hf_token_key=None)#
Parameters:

  • ngc_image_secret (str) – The name of the Kubernetes secret containing the NGC image pull credentials.

  • ngc_secret_key (str) – The key name for the NGC API key.

  • secrets_prefix (str) – The secrets prefix that Flyte appends to all mounted secrets.

  • ngc_secret_group (str | None) – The group name for the NGC API key.

  • hf_token_group (str | None) – The group name for the HuggingFace token.

  • hf_token_key (str | None) – The key name for the HuggingFace token.

Methods

Attributes

hf_token_group: str | None = None
hf_token_key: str | None = None
ngc_secret_group: str | None = None
ngc_image_secret: str
ngc_secret_key: str
secrets_prefix: str