Cloud Pak for Data Watson Studio Job Schedule Information
Monitor Summary
This monitor will generate the following observations:
- Number of Cloud Pak for Data Watson Studio scheduled jobs across all projects
- Number of Cloud Pak for Data Watson Studio scheduled jobs per project
- Number of Cloud Pak for Data Watson Studio scheduled jobs per user
- Number of Cloud Pak for Data Watson Studio scheduled Notebook jobs per user
- Number of Cloud Pak for Data Watson Studio scheduled DataStage jobs per user
- Run information of Last failed Cloud Pak for Data Watson Studio scheduled job
- Epoch time in seconds for the next run of Cloud Pak for Data Watson Studio scheduled job
- Last Run Duration time in seconds of Cloud Pak for Data Watson Studio scheduled job
- Last Run Epoch time in seconds of Cloud Pak for Data Watson Studio scheduled job
Monitor Requirements
In order for Watson Studio Job Information to be available, CCS (Common Core Services) must be available on the Cloud Pak for Data instance. Catridges like Watson Studio and Watson Machine Learning automatically install CCS as part of their dependencies. If CCS is not available, no watson studio job information is available.
Deployment of the monitor
This monitor can be deployed using the IBM Cloud Pak Deployer or manually deployed using oc commands:
Monitor Source
Source folder containing the script can be found here (cp4d-watsonstudio-job-schedule-info).
Generated observations
Once the monitor is deployed, the following observations are available in IBM Cloud Pak for Data Metrics:
Using the IBM Cloud Pak for Data Platform Management Events:
https://<CP4D-BASE-URL>/zen/#/platformManagement/events
On the Platform Management Events page the following entries are added:
| Event | Event Type | Possible values | Description |
|---|---|---|---|
| Cloud Pak for Data Watson Studio Jobs Schedule Overall Count | umber of Cloud Pak for Data Watson Studio scheduled jobs across all projects | info | The Cloud Pak for Data Platform Projects and Jobs information are requested. |
| Cloud Pak for Data Waston Studio Jobs Schedule Project Count | Number of Cloud Pak for Data Watson Studio scheduled jobs per project | info | The Cloud Pak for Data Platform Projects and Jobs information are requested. |
| Cloud Pak for Data Waston Studio Jobs Schedule User Overall Count | Number of Cloud Pak for Data Watson Studio scheduled jobs per user | info | The Cloud Pak for Data Platform Projects and Jobs information are requested. |
| Cloud Pak for Data Waston Studio Jobs Schedule User Notebook Count | Number of Cloud Pak for Data Watson Studio scheduled Notebook jobs per user | info | The Cloud Pak for Data Platform Projects and Jobs information are requested. |
| Cloud Pak for Data Waston Studio Jobs Schedule User DataStage Count | Number of Cloud Pak for Data Watson Studio scheduled DataStage jobs per user | info | The Cloud Pak for Data Platform Projects and Jobs information are requested. |
| Cloud Pak for Data Waston Studio Job Schedule Last Run Fail | Run information of Last failed Cloud Pak for Data Watson Studio scheduled job | info | The Cloud Pak for Data Platform Projects and Jobs information are requested. |
| Cloud Pak for Data Waston Studio Job Schedule Next Run Epoch Time | Epoch time in seconds for the next run of Cloud Pak for Data Watson Studio scheduled job | info | The Cloud Pak for Data Platform Projects, Jobs information are requested. |
| Cloud Pak for Data Waston Studio Job Schedule Last Run Duration Seconds | Last Run Duration time in seconds of Cloud Pak for Data Watson Studio scheduled job | info | The Cloud Pak for Data Platform Projects, Jobs, and Job Details information are requested. |
| Cloud Pak for Data Waston Studio Job Schedule Last Run Epoch Time | Last Run Epoch time in seconds of Cloud Pak for Data Watson Studio scheduled job | info | The Cloud Pak for Data Platform Projects, Jobs, and Job Details information are requested. |
Using the IBM Cloud Pak for Data Prometheus endpoint
https://<CP4D-BASE-URL>/zen/metrics
It will generate 2 types of metrics:
- Actual Result metrics
These metrics contain the observed values - Zen Watchdog metrics
These metrics are used by the Cloud Pak for Data Zen Watchdog to monitor the state and trigger notifications
Actual Result metrics:
- cp4d_watsonstudio_jobs_schedule_overall_count Provides number of Cloud Pak for Data Watson Studio scheduled jobs across all projects
- cp4d_watsonstudio_jobs_schedule_project_count Provides number of Cloud Pak for Data Watson Studio scheduled jobs per project
- cp4d_watsonstudio_jobs_schedule_user_overall_count Provides number of Cloud Pak for Data Watson Studio scheduled jobs per user
- cp4d_watsonstudio_jobs_schedule_user_notebook_count Provides number of Cloud Pak for Data Watson Studio scheduled Notebook jobs per user
- cp4d_watsonstudio_jobs_schedule_user_datastage_count Provides number of Cloud Pak for Data Watson Studio scheduled DataStage jobs per user
- cp4d_watsonstudio_job_schedule_last_run_fail Provides run information of Last failed Cloud Pak for Data Watson Studio scheduled job
- cp4d_watsonstudio_job_schedule_next_run_epoch_time Provides epoch time in seconds for the next run of Cloud Pak for Data Watson Studio scheduled job
- cp4d_watsonstudio_job_schedule_last_run_duration_seconds Provides last run duration time in seconds of Cloud Pak for Data Watson Studio scheduled job
- cp4d_watsonstudio_job_schedule_last_run_epoch_time Provides last run epoch time in seconds of Cloud Pak for Data Watson Studio scheduled job
# HELP cp4d_watsonstudio_job_schedule_last_run_duration_seconds# TYPE cp4d_watsonstudio_job_schedule_last_run_duration_seconds gaugecp4d_watsonstudio_job_schedule_last_run_duration_seconds{event_type="cp4d_watsonstudio_job_schedule_last_run_duration_seconds",monitor_type="cp4dplatformwatsonstudiojobscheduleinfo",reference="demo-project_notebook-job"} 320# HELP cp4d_watsonstudio_job_schedule_last_run_epoch_time# TYPE cp4d_watsonstudio_job_schedule_last_run_epoch_time gaugecp4d_watsonstudio_job_schedule_last_run_epoch_time{event_type="cp4d_watsonstudio_job_schedule_last_run_epoch_time",monitor_type="cp4dplatformwatsonstudiojobscheduleinfo",reference="demo-project_notebook-job"} 1.654066811e+09# HELP cp4d_watsonstudio_jobs_schedule_next_run_epoch_time# TYPE cp4d_watsonstudio_jobs_schedule_next_run_epoch_time gaugecp4d_watsonstudio_jobs_schedule_next_run_epoch_time{event_type="cp4d_watsonstudio_job_schedule_next_run_epoch_time",monitor_type="cp4dplatformwatsonstudiojobscheduleinfo",reference="demo-project_notebook-job"} 1.6540674e+09
Zen Watchdog metrics (used in platform management events)
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_jobs_schedule_overall_count
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_jobs_schedule_project_count
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_jobs_schedule_user_overall_count
- atchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_jobs_schedule_user_notebook_count
- atchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_jobs_schedule_user_notebook_count
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_fail
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_next_run_epoch_time
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_duration_seconds
- watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_epoch_time
Zen Watchdog metrics can have the following values:
- 2 (info)
- 1 (warning)
- 0 (critical)
# HELP watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_duration_seconds# TYPE watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_duration_seconds gaugewatchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_duration_seconds{event_type="cp4d_watsonstudio_job_schedule_last_run_duration_seconds",monitor_type="cp4dplatformwatsonstudiojobscheduleinfo",reference="demo-project_notebook-job"} 2# HELP watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_epoch_time# TYPE watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_epoch_time gaugewatchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_last_run_epoch_time{event_type="cp4d_watsonstudio_job_schedule_last_run_epoch_time",monitor_type="cp4dplatformwatsonstudiojobscheduleinfo",reference="demo-project_notebook-job"} 2# HELP watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_next_run_epoch_time# TYPE watchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_next_run_epoch_time gaugewatchdog_cp4dplatformwatsonstudiojobscheduleinfo_cp4d_watsonstudio_job_schedule_next_run_epoch_time{event_type="cp4d_watsonstudio_job_schedule_next_run_epoch_time",monitor_type="cp4dplatformwatsonstudiojobscheduleinfo",reference="demo-project_notebook-job"} 2