genai package¶
- class genai.ApiClient[source]¶
Bases:
objectClass which provides methods for making API requests. It provides methods for obtaining synchronous and asynchronous HTTP clients.
- Config¶
alias of
BaseConfig
- __init__(*, credentials, config=None)[source]¶
- Parameters:
credentials (Credentials)
config (dict | BaseConfig | None)
- get_async_http_client(rate_limit_options=None, retry_options=None, client_options=None, **kwargs)[source]¶
Gets cached instance of AsyncHttpxClient (cache key is created from provided parameters).
- Raises:
ValueError – If both rate_limit_options and retry_options are provided.
RuntimeError – If the method is not called within an asynchronous environment.
- Parameters:
rate_limit_options (dict | None)
retry_options (dict | None)
client_options (dict | None)
- Return type:
AsyncHttpxClient
- class genai.Client[source]¶
Bases:
BaseService[BaseConfig,BaseServices]The Client class provides an interface for interacting with various services through an API client. It can be initialized with either an api_client or credentials along with optional configurations and services.
Example:
from genai import Credentials, Client credentials = Credentials.from_env() client = Client(credentials=credentials)
- text¶
An instance of the TextService class for text-related operations.
- request¶
An instance of the RequestService class for making request-related operations.
- tune¶
An instance of the TuneService class for tuning models.
- model¶
An instance of the ModelService class for managing models.
- file¶
An instance of the FileService class for managing files.
- prompt¶
An instance of the PromptService class for working with prompts.
- system_prompt¶
An instance of the SystemPromptService class for working with system prompts.
- user¶
An instance of the UserService class for managing user-related operations.
- tag¶
An instance of the TagService class for working with tags.
- folder¶
An instance of the FolderService class for working with folder.
- task¶
An instance of the TaskService class for working with tasks.
- Config¶
alias of
BaseConfig
- Services¶
alias of
BaseServices
- __init__(*, api_client: ApiClient, config: dict | BaseConfig | None = None, services: BaseServices | None = None) None[source]¶
- __init__(*, credentials: Credentials, config: dict | BaseConfig | None = None, services: BaseServices | None = None) None
- Parameters:
credentials – The credentials used to authenticate the API client.
api_client – The API client used to make requests to the API.
config – The configuration for the API client.
services – The services object containing instances of various service classes.
- Raises:
ValueError – Either ‘api_client’ or ‘credentials’ needs to be passed.
Note
The api_client parameter must be provided either directly or through credentials. If no services parameter is provided, the client will use the default one.
- pydantic model genai.Credentials[source]¶
Bases:
BaseModelThe Credentials class represents credentials required for accessing the GENAI API.
- - `api_key`
API key which can be retrieved from the UI.
- - `api_endpoint`
A string representing the GENAI API endpoint (default is BAM).
- Type:
optional
Examples
Create a Credentials instance with explicit api_endpoint:
credentials = Credentials(api_key="your_api_key", api_endpoint="https://bam-api.res.ibm.com")
Create a Credentials instance with default api_endpoint:
credentials = Credentials(api_key="your_api_key")
Create a Credentials instance from environment variables:
credentials = Credentials.from_env()
- Validators:
_validate_api_endpoint»api_endpoint
- field api_endpoint: str [Required]¶
GENAI API Endpoint
- Constraints:
min_length = 1
- Validated by:
_validate_api_endpoint
- field api_key: SecretStr [Required]¶
The GENAI API Key
- __init__(api_key, api_endpoint=None, **kwargs)[source]¶
Create a new model by parsing and validating input data from keyword arguments.
Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.
self is explicitly positional-only to allow self as a field name.
- Parameters:
api_key (str)
api_endpoint (str | None)
Subpackages¶
- genai.extensions package
- genai.file package
- genai.folder package
- genai.model package
- genai.prompt package
- genai.request package
- genai.schema package
AIMessageApiEndpointApiKeyRegenerateCreateEndpointApiKeyRegenerateCreateResponseApiKeyResultApiKeyRetrieveEndpointApiKeyRetrieveResponseBadRequestResponseBaseErrorExtensionBaseErrorResponseBaseMessageBaseTokensChatRoleConcurrencyLimitDecodingMethodDeploymentCreateEndpointDeploymentCreateResponseDeploymentIdDeleteEndpointDeploymentIdRetrieveEndpointDeploymentIdRetrieveResponseDeploymentResultDeploymentRetrieveEndpointDeploymentRetrieveResponseDeploymentStatusEvaluationCreateEndpointEvaluationCreateResponseEvaluationExperimentEvaluationExperimentCreateEndpointEvaluationExperimentCreateResponseEvaluationExperimentIdDeleteEndpointEvaluationExperimentIdRetrieveEndpointEvaluationExperimentIdRetrieveResponseEvaluationExperimentRetrieveEndpointEvaluationExperimentRetrieveResponseEvaluationExperimentSortByEvaluationFieldOperationEvaluationFileEvaluationIdDeleteEndpointEvaluationIdInstanceResultRetrieveEndpointEvaluationIdInstanceResultRetrieveResponseEvaluationIdRetrieveEndpointEvaluationIdRetrieveResponseEvaluationInstanceResultEvaluationLimitEvaluationLimitRetrieveEndpointEvaluationLimitRetrieveResponseEvaluationOperationTypeEvaluationParentTaskEvaluationPreviewCreateEndpointEvaluationPreviewCreateResponseEvaluationPromptEvaluationResultEvaluationResult.created_atEvaluationResult.descriptionEvaluationResult.experiment_idEvaluationResult.fileEvaluationResult.finished_atEvaluationResult.idEvaluationResult.model_idEvaluationResult.nameEvaluationResult.parametersEvaluationResult.promptEvaluationResult.resultEvaluationResult.started_atEvaluationResult.statusEvaluationResult.status_messageEvaluationResult.task_idEvaluationResult.template_idEvaluationResult.template_name
EvaluationRetrieveEndpointEvaluationRetrieveResponseEvaluationSortByEvaluationStatusEvaluationTaskEvaluationTemplateEvaluationTemplateIdRetrieveEndpointEvaluationTemplateIdRetrieveResponseEvaluationTemplateRetrieveEndpointEvaluationTemplateRetrieveResponseExtensionsExtensions1Extensions2Extensions3Extensions4Extensions5FileCreateEndpointFileCreateResponseFileDescendantFileFormatFileIdContentRetrieveEndpointFileIdDeleteEndpointFileIdPatchEndpointFileIdPatchResponseFileIdRetrieveEndpointFileIdRetrieveResponseFileListSortByFileMetadataFileMetadataStatsFilePurposeFileResultFileRetrieveEndpointFileRetrieveResponseFolderCreateEndpointFolderCreateResponseFolderIdDeleteEndpointFolderIdPatchEndpointFolderIdPatchResponseFolderIdRetrieveEndpointFolderIdRetrieveResponseFolderIdUpdateEndpointFolderIdUpdateResponseFolderResultFolderRetrieveEndpointFolderRetrieveResponseGeneratedTokenHAPOptionsHumanMessageInputInternalServerErrorResponseLengthPenaltyMessageFileMetricMetricsModelFacetModelFacetTypeModelFamilyModelIdRetrieveEndpointModelIdRetrieveResponseModelIdRetrieveResultModelIdRetrieveResult.descriptionModelIdRetrieveResult.developerModelIdRetrieveResult.disabledModelIdRetrieveResult.facetsModelIdRetrieveResult.idModelIdRetrieveResult.is_liveModelIdRetrieveResult.labelModelIdRetrieveResult.model_familyModelIdRetrieveResult.nameModelIdRetrieveResult.preferredModelIdRetrieveResult.prompt_builder_exampleModelIdRetrieveResult.sizeModelIdRetrieveResult.source_model_idModelIdRetrieveResult.system_promptModelIdRetrieveResult.system_prompt_idModelIdRetrieveResult.tagsModelIdRetrieveResult.tasksModelIdRetrieveResult.token_limitsModelIdRetrieveResult.warning
ModelRetrieveEndpointModelRetrieveResponseModelRetrieveResultsModelTokenLimitsModelTypeModerationHAPModerationHAPInputModerationHAPOutputModerationImplicitHateModerationImplicitHateInputModerationImplicitHateOutputModerationParametersModerationPositionModerationSocialBiasModerationSocialBiasInputModerationSocialBiasOutputModerationStigmaModerationStigmaInputModerationStigmaOutputModerationTokensNotFoundResponsePromptCreateEndpointPromptCreateResponsePromptIdDeleteEndpointPromptIdPatchEndpointPromptIdPatchResponsePromptIdRetrieveEndpointPromptIdRetrieveResponsePromptIdUpdateEndpointPromptIdUpdateResponsePromptListSortByPromptListSourcePromptModerationParametersPromptResultPromptResult.authorPromptResult.created_atPromptResult.dataPromptResult.descriptionPromptResult.folder_idPromptResult.idPromptResult.inputPromptResult.messagesPromptResult.metadataPromptResult.model_idPromptResult.moderationsPromptResult.namePromptResult.outputPromptResult.parametersPromptResult.prompt_idPromptResult.publicPromptResult.tagsPromptResult.taskPromptResult.typePromptResult.updated_atPromptResult.usage_count
PromptResultAuthorPromptResultTaskPromptRetrieveEndpointPromptRetrieveResponsePromptTagPromptTagTypePromptTemplateDataPromptTypeRequestApiVersionRequestChatConversationIdDeleteEndpointRequestChatConversationIdRetrieveEndpointRequestChatConversationIdRetrieveResponseRequestChatConversationIdRetrieveResultsRequestChatConversationIdRetrieveResults.created_atRequestChatConversationIdRetrieveResults.durationRequestChatConversationIdRetrieveResults.idRequestChatConversationIdRetrieveResults.parent_idRequestChatConversationIdRetrieveResults.requestRequestChatConversationIdRetrieveResults.responseRequestChatConversationIdRetrieveResults.statusRequestChatConversationIdRetrieveResults.version
RequestChatConversationIdRetrieveResultsRequestRequestChatConversationIdRetrieveResultsResponseRequestEndpointRequestFeedbackCategoryRequestFeedbackCategory.CORRECT_CONTENTRequestFeedbackCategory.CORRECT_STYLERequestFeedbackCategory.INACCURATERequestFeedbackCategory.KNOWLEDGE_GAPRequestFeedbackCategory.NOT_RELEVANTRequestFeedbackCategory.OFFENSIVE_HARMFULRequestFeedbackCategory.OTHER_CONTENTRequestFeedbackCategory.OTHER_STYLERequestFeedbackCategory.TOO_LONGRequestFeedbackCategory.TOO_SHORTRequestFeedbackCategory.WRONG_FORMATRequestFeedbackCategory.WRONG_TONE
RequestFeedbackResultRequestFeedbackVoteRequestIdDeleteEndpointRequestIdFeedbackCreateEndpointRequestIdFeedbackCreateResponseRequestIdFeedbackRetrieveEndpointRequestIdFeedbackRetrieveResponseRequestIdFeedbackUpdateEndpointRequestIdFeedbackUpdateResponseRequestOriginRequestResultVersionRequestRetrieveEndpointRequestRetrieveResponseRequestRetrieveResultsRequestStatusSocialBiasOptionsSortDirectionStopReasonStorageProviderLocationSystemMessageSystemPromptSystemPromptAuthorSystemPromptCreateEndpointSystemPromptCreateResponseSystemPromptIdDeleteEndpointSystemPromptIdRetrieveEndpointSystemPromptIdRetrieveResponseSystemPromptIdUpdateEndpointSystemPromptIdUpdateResponseSystemPromptRetrieveEndpointSystemPromptRetrieveResponseSystemPromptTypeTagTagRetrieveEndpointTagRetrieveResponseTagTypeTaskRetrieveEndpointTaskRetrieveResponseTasksTextChatCreateEndpointTextChatCreateResponseTextChatGenerationStreamResultTextChatGenerationStreamResult.generated_textTextChatGenerationStreamResult.generated_token_countTextChatGenerationStreamResult.generated_tokensTextChatGenerationStreamResult.input_textTextChatGenerationStreamResult.input_token_countTextChatGenerationStreamResult.input_tokensTextChatGenerationStreamResult.seedTextChatGenerationStreamResult.stop_reasonTextChatGenerationStreamResult.stop_sequence
TextChatOutputCreateEndpointTextChatOutputCreateResponseTextChatStreamCreateEndpointTextChatStreamCreateResponseTextClassificationCreateDataTextClassificationCreateEndpointTextClassificationCreateResponseTextClassificationResultTextClassificationTypeTextCreateResponseModerationTextEmbeddingCreateEndpointTextEmbeddingCreateResponseTextEmbeddingLimitTextEmbeddingLimitRetrieveEndpointTextEmbeddingLimitRetrieveResponseTextEmbeddingParametersTextExtractionLimitRetrieveEndpointTextGenerationComparisonCreateEndpointTextGenerationComparisonCreateRequestRequestTextGenerationComparisonCreateRequestRequest.dataTextGenerationComparisonCreateRequestRequest.inputTextGenerationComparisonCreateRequestRequest.model_idTextGenerationComparisonCreateRequestRequest.moderationsTextGenerationComparisonCreateRequestRequest.parametersTextGenerationComparisonCreateRequestRequest.prompt_idTextGenerationComparisonCreateRequestRequest.use_default
TextGenerationComparisonCreateResponseTextGenerationComparisonCreateResultsTextGenerationComparisonCreateResultsParametersTextGenerationComparisonCreateResultsParameters.length_penaltyTextGenerationComparisonCreateResultsParameters.model_idTextGenerationComparisonCreateResultsParameters.repetition_penaltyTextGenerationComparisonCreateResultsParameters.temperatureTextGenerationComparisonCreateResultsParameters.top_kTextGenerationComparisonCreateResultsParameters.top_pTextGenerationComparisonCreateResultsParameters.typical_p
TextGenerationComparisonCreateResultsResultTextGenerationComparisonParametersTextGenerationComparisonParameters.length_penaltyTextGenerationComparisonParameters.model_idTextGenerationComparisonParameters.repetition_penaltyTextGenerationComparisonParameters.temperatureTextGenerationComparisonParameters.top_kTextGenerationComparisonParameters.top_pTextGenerationComparisonParameters.typical_p
TextGenerationCreateEndpointTextGenerationCreateResponseTextGenerationFeedbackCategoryTextGenerationFeedbackCategory.CORRECT_CONTENTTextGenerationFeedbackCategory.CORRECT_STYLETextGenerationFeedbackCategory.INACCURATETextGenerationFeedbackCategory.KNOWLEDGE_GAPTextGenerationFeedbackCategory.NOT_RELEVANTTextGenerationFeedbackCategory.OFFENSIVE_HARMFULTextGenerationFeedbackCategory.OTHER_CONTENTTextGenerationFeedbackCategory.OTHER_STYLETextGenerationFeedbackCategory.TOO_LONGTextGenerationFeedbackCategory.TOO_SHORTTextGenerationFeedbackCategory.WRONG_FORMATTextGenerationFeedbackCategory.WRONG_TONE
TextGenerationFeedbackResultTextGenerationFeedbackResult.api_requestTextGenerationFeedbackResult.categoriesTextGenerationFeedbackResult.commentTextGenerationFeedbackResult.contact_consentTextGenerationFeedbackResult.created_atTextGenerationFeedbackResult.idTextGenerationFeedbackResult.updated_atTextGenerationFeedbackResult.vote
TextGenerationFeedbackVoteTextGenerationIdFeedbackCreateEndpointTextGenerationIdFeedbackCreateResponseTextGenerationIdFeedbackRetrieveEndpointTextGenerationIdFeedbackRetrieveResponseTextGenerationIdFeedbackUpdateEndpointTextGenerationIdFeedbackUpdateResponseTextGenerationLimitTextGenerationLimitRetrieveEndpointTextGenerationLimitRetrieveResponseTextGenerationOutputCreateEndpointTextGenerationOutputCreateResponseTextGenerationParametersTextGenerationParameters.beam_widthTextGenerationParameters.decoding_methodTextGenerationParameters.include_stop_sequenceTextGenerationParameters.length_penaltyTextGenerationParameters.max_new_tokensTextGenerationParameters.min_new_tokensTextGenerationParameters.random_seedTextGenerationParameters.repetition_penaltyTextGenerationParameters.return_optionsTextGenerationParameters.stop_sequencesTextGenerationParameters.temperatureTextGenerationParameters.time_limitTextGenerationParameters.top_kTextGenerationParameters.top_pTextGenerationParameters.truncate_input_tokensTextGenerationParameters.typical_p
TextGenerationResultTextGenerationResult.generated_textTextGenerationResult.generated_token_countTextGenerationResult.generated_tokensTextGenerationResult.input_textTextGenerationResult.input_token_countTextGenerationResult.input_tokensTextGenerationResult.moderationsTextGenerationResult.seedTextGenerationResult.stop_reasonTextGenerationResult.stop_sequence
TextGenerationReturnOptionsTextGenerationStreamCreateEndpointTextGenerationStreamCreateResponseTextGenerationStreamResultTextGenerationStreamResult.generated_textTextGenerationStreamResult.generated_token_countTextGenerationStreamResult.generated_tokensTextGenerationStreamResult.input_textTextGenerationStreamResult.input_token_countTextGenerationStreamResult.input_tokensTextGenerationStreamResult.seedTextGenerationStreamResult.stop_reasonTextGenerationStreamResult.stop_sequence
TextModerationTextModerationCreateEndpointTextModerationCreateResponseTextRerankCreateEndpointTextRerankCreateResponseTextRerankParametersTextRerankResultTextRerankReturnOptionsTextSentenceSimilarityCreateEndpointTextSentenceSimilarityCreateResponseTextSentenceSimilarityCreateResultTextSentenceSimilarityParametersTextTokenizationCreateEndpointTextTokenizationCreateResponseTextTokenizationCreateResultsTextTokenizationParametersTextTokenizationReturnOptionsTimeSerieForecastingCreateEndpointTimeSerieForecastingCreateResponseTimeSerieLimitRetrieveEndpointTimeSerieLimitRetrieveResponseTimeSeriesLimitTooManyRequestsResponseTrimMethodTuneAssetTypeTuneCreateEndpointTuneCreateResponseTuneFromFileCreateEndpointTuneFromFileCreateResponseTuneIdContentRetrieveEndpointTuneIdContentTypeRetrieveEndpointTuneIdDeleteEndpointTuneIdPatchEndpointTuneIdPatchResponseTuneIdRetrieveEndpointTuneIdRetrieveResponseTuneListSortByTuneParametersTunePreflightCreateEndpointTunePreflightCreateResponseTuneResultTuneResult.contentsTuneResult.created_atTuneResult.datapointsTuneResult.evaluation_filesTuneResult.finished_atTuneResult.idTuneResult.last_used_atTuneResult.model_idTuneResult.model_nameTuneResult.nameTuneResult.parametersTuneResult.preferredTuneResult.started_atTuneResult.statusTuneResult.status_messageTuneResult.task_idTuneResult.task_nameTuneResult.training_filesTuneResult.tuning_typeTuneResult.validation_filesTuneResult.vectors
TuneResultContentTuneResultDatapointTuneResultDatapointLossDataTuneResultDatapointValidationLossTuneResultDatapointValidationLossDataTuneResultFilesTuneRetrieveEndpointTuneRetrieveResponseTuneStatusTunesResultDatapointLossTuningTypeRetrieveEndpointTuningTypeRetrieveResponseTuningTypeRetrieveResultsUnauthorizedResponseUnavailableResponseUserApiKeyUserCreateEndpointUserCreateResponseUserCreateResultUserDeleteEndpointUserGenerationDefaultUserPatchEndpointUserPatchResponseUserResultUserRetrieveEndpointUserRetrieveResponse
- genai.system_prompt package
- genai.tag package
- genai.task package
- genai.text package
- genai.tune package
- genai.user package
Submodules¶
- genai.client module
BaseConfigBaseServicesBaseServices.DeploymentServiceBaseServices.FileServiceBaseServices.FolderServiceBaseServices.ModelServiceBaseServices.PromptServiceBaseServices.RequestServiceBaseServices.SystemPromptServiceBaseServices.TagServiceBaseServices.TaskServiceBaseServices.TextServiceBaseServices.TuneServiceBaseServices.UserService
Client
- genai.credentials module
- genai.exceptions module
- genai.utils module