Manipulate Transformatoin Scripts Collectively

 Posted on 2022-08-06  |  3 minutes  |  490 words  |  Kazuhiko Takata

At described in Start Deep Dive to Machine Learning and Action Flow it is possible to manipulate Celonis EMS function by Machine Learning Workbench. Function relevant to EMS data is already discussed at last post Store Time Series of Metrics to Table. Machine learning Workbench also enables to manipulate programs in EMS for developers. Today I would like to demonstrate some of functions to manipulate Transformation (SQL) script developed in Data Integration. [Read More]
Machine Learning  Data Integration  Transformation 

Store Time Series of Metrics to Table

 Posted on 2022-07-30  |  3 minutes  |  570 words  |  Kazuhiko Takata

At last post Schedule Notebook to Run Data Jobs I showed you how to schedule Data Job using Machine Learning Workbench. Of course, not only Data Job but any kind of tasks can be scheduled by Python script. Today I would like to schedule backup some kind of data to table by Machine Learning Workbench. Store time series of metrics Imagine I am running Celonis EMS for months and I already established dash board Aalysis to observe some KPIs (metrics). [Read More]
Machine Learning  Data Integration  Process Analytics  Studio  Analysis 

Schedule Notebook to Run Data Jobs

 Posted on 2022-07-23  |  3 minutes  |  436 words  |  Kazuhiko Takata

From today I would like to use Machine Learning Workbench again. As described at Start Deep Dive to Machine Learning and Action Flow it can manipulate Celonis EMS functions from outside of it. And this manipulation can be scheduled periodically. Using scheduling function, Machine Learning Workbench can be extension of Data Job scheduler in Data Integration. Today I would like to build simple job scheduler. Parallel Data Job execution You may think your ETL duration is too long so you would like to shorten it as soon as possible. [Read More]
Machine Learning  Data Integration 

Use Webhook to Integrate Skill with Action Flow

 Posted on 2022-07-16  |  3 minutes  |  581 words  |  Kazuhiko Takata

Email from Celonis EMS Until last post Aggregate Bundles to Minimize Notification, first Action Flow scenario is developed as draft. Today I would like to improve notification part of scenario. Few days after I started scenario, I found that Sent box in my email account is unnecessarily increased due to notification I developed. That is because I used my email account to send it. If this is personal development that is fine, but if it is official one and in some time later you will leave your position, this email account is not available. [Read More]
Studio  Action Flow  Data Integration 

Aggregate Bundles to Minimize Notification

 Posted on 2022-07-09  |  3 minutes  |  587 words  |  Kazuhiko Takata

Integrate cancel operation bundles to one In the last Manage Bundles in between Action Flow Modules I successfully automated Data Job cancel operation. To do this, I used Iterator module to split one bundle of Data Pool to multiple bundles of Data Jobs, and filtered bundles to specify running Data Jobs. In the end, bundles of running Data Jobs are selected and cancelled. Continued from last post, goal of today is to notify result of automated operation by email (my Gmail), because I can not check automated operation is done correctly at midnight based on initial scenario. [Read More]
Studio  Action Flow  Data Integration 

Manage Bundles in between Action Flow Modules

 Posted on 2022-07-02  |  2 minutes  |  367 words  |  Kazuhiko Takata

Convert array to bundles by Iterator module At last post Run first Action Flow Scenario I created HTTP request module to check data job status. Based on the scenario, today I would like to create next module to cancel running data jobs. Because next module is also HTTP request, it is convenient to clone last module and modify something. I right click the last module, then select Clone menu, then new module is generated and connected with previous module. [Read More]
Studio  Action Flow  Data Integration 

Run first Action Flow Scenario

 Posted on 2022-06-25  |  3 minutes  |  530 words  |  Kazuhiko Takata

Action Flow as HTTP client From today I would like to introduce Action Flow, that is possible to automate scenario and integrate SaaS systems (also on-premise too). You may know that 100 over SaaS systems are registered in Action Flow and easily build your own scenario. Great, but I sometimes felt that I could not find appropriate module from that. How do I fullfill my requirement ? Actually Action Flow can be used HTTP client, so what I did by cURL at last post Operate Celonis from outside by REST API is also possible in Action Flow. [Read More]
Studio  Action Flow  Data Integration 

Operate Celonis from outside by REST API

 Posted on 2022-06-18  |  3 minutes  |  594 words  |  Kazuhiko Takata

About REST API Until last post, I explained some of API use cases (export Pool program and configure data job alert) using Pycelonis script from ML Workbench. Is is something Celonis “internal” operation. By the way, as I mentioned in Login to Celonis EMS from Jupyter Workbench, I can call API from outside of Celonis. Generally this kind of API using HTTP request is called REST API (or RESTful API) [Read More]
Machine Learning  Data Integration 

Include JSON data in HTTP Request and Response

 Posted on 2022-06-11  |  3 minutes  |  560 words  |  Kazuhiko Takata

About JSON Until last post, I did not intentionally mention about detail of input and output data in HTTP request. Actually HTTP request requires not only URL (URI) but header data like Authorization (refer to Observe HTTP request in Pycelonis login script). Also you can imagine it is possible to attach input form value (e.g. name, address, email). Generally in API world, JSON format is used to attach with HTTP request. [Read More]
Machine Learning  Data Integration 

Find out HTTP Request from GUI Function

 Posted on 2022-06-04  |  3 minutes  |  608 words  |  Kazuhiko Takata

In the previous post Observe HTTP request in Pycelonis login script, I showed how to observe HTTP request under Pycelonis API. In this observation I found HTTP request requires at least Authorization header and of course URL to reach to resource in Celonis EMS. Also I found that I can manage to investigate which HTTP request is sent when calling Pycelonis class method. By the way, not all HTTP requests are implemented in Pycelonis. [Read More]
Machine Learning  Data Integration