Why does running the ETL job for energy logs fail?


I know that TRIRIGA SaaS comes with predefined ETL jobs, and one of them is energy log fact. I have some energy logs on some buildings. However, all of my attempts to run the ETL job for energy logs have failed. Is there any missing parameter for me to add to make this work? I did try adding triEnvEnergyItem as a BO name, but no luck.

The ETLs each require different inputs depending on the ETL. Since, in general, ETL processing is a background process and runs through the scheduler, you would need to look in the server.log to see what the ETL needs if you are running it directly from the ETL Job form. You would also need to make sure that you have a license that allows you to run the ETLs, which would be a license that grants privileges to “Technology Metrics”.

Maybe this link will help: ETL and Metric Query Troubleshooting.

[Admin: To see other related posts, use the ETL tag.]

Continue reading

Advertisements

How do you transform an unsupported date format?


We would like to upload a date in “dd.mm.yyyy” format. As long as TRIRIGA doesn’t support this format, what would be the best way to transform a string with “dd.mm.yyyy” to Epoch date, and then copy it to a Date field inside TRIRIGA? For example, advanced formula, custom task, etc.?

I think one of the possible ways is to leverage an ETL tool (e.g. Kettle Spoon) to transform data. See the Data Management (PDF) user guide.

[Admin: To see other related posts, use the ETL tag.]

Continue reading

How do you configure TRIRIGA for Tivoli Directory Integrator (TDI)?


You can configure TRIRIGA to use Tivoli Directory Integrator as its ETL runtime engine to run ETLJobItems from within TRIRIGA.

Before you begin

Install Tivoli Directory Integrator, if not already installed, on all the TRIRIGA systems that could run a TDI ETL Job Item.  During the TDI install:

  • Make note of the installation directory you enter on the Destination panel. You will enter this value later in TRIRIGAWEB.properties.
  • Select either installation type. TRIRIGA requires only the TDI Server component.
  • When prompted for the location of the Solution Directory, you can select any option. TRIRIGA specifies its own solution directory at runtime.  However selecting the option “Use Install Directory” may simplify troubleshooting.
  • Make note of the value you enter in the Server Port field on the Server Port Values Panel. You will enter this value later in TRIRIGAWEB.properties.
  • Clear the “Start the Configuration Editor” check box on the Install Complete panel.
  • Note: This step is very important for TDI/TRIRIGA integration to work. After you have installed Tivoli Directory Integrator, update it with the recommended fix packs (per TRIRIGA support matrix). TDI must be at least at FP04 (7.1.1.4) or it  will not automatically start the TririgiaETLDispatch.xml assembly line which will result in ETL job items failing to run successfully.

Procedure

  1. Edit TRIRIGAWEB.properties file to enable TRIRIGA to manage TDI server.  Set the following properties…
  2. Install a JDBC driver library so that Tivoli Directory Integrator can use it to access TRIRIGA database…
  3. Edit TDI global.properties file to allow TRIRIGA to check and stop the TDI server from localhost without requiring authentication and authorization certificates. Set the api.remote.ssl.on property to false to tell TDI to trust requests from localhost…
  4. Start Tivoli Directory Integrator Agent from TRIRIGA Admin Console and verify that it starts successfully…

[Admin: This post is related to the 08.03.16 post about installing, upgrading, or uninstalling TRIRIGA TDI, and the 05.01.16 post about documentation on developing TDI with TRIRIGA. To see other related posts, use the TDI tag.]

Continue reading

IV97814: triTaskResourceFact and triDimTaskStatusTX have changed


When running an ETL Job in IBM TRIRIGA 3.5.2, we see the following error, because the T_triTaskResourceFact table, triTaskResourceFact BO, has changed, and the triDimTaskStatusTX field is no longer a locator:

ERROR [com.tririga.platform.workflow.runtime.taskhandler.ETL.KETTLE](triTaskResourceFactETL - Insert into triTaskResourceFact) Insert into triTaskResourceFact - org.pentaho.di.core.exception.KettleException: Error inserting row into table [T_TRITASKRESOURCEFACT] with values: ...
Error inserting/updating row ORA-00904: "TRIDIMTASKSTATUSTXOBJID ...

The status dimension data was not populating for the task resource metric table. Moving forward, we needed to make changes to populate the data correctly.

[Admin: To see other related posts, use the ETL tag.]

Continue reading

How do you run a simple Survey Fact ETL job item?


I would like to see an example of running an ETL job item, because simply running the process fails. When users see the activated record, they assume they can click “Run Process” and get results. But you need to enter a set of restraining data to get results.

Every ETL job item is different. You must fill in the record information to get the results necessary for the transformation or processing. More information can be found at the following link: IBM TRIRIGA – Running ETL transforms. This blog entry will describe a sample run of a Survey Fact ETL job item.

  1. First, from the menu, click on Tools > Job Scheduling > ETL Job Item.
  2. Then search for “Survey Fact” and open the record. It’s recommended that you click on More > Copy to create a copy that you can modify, test, and play with.
  3. After that, change the name to an friendly name and enter at least these mandatory fields: Date, Start Date, Fiscal Period, and End Date.
  4. For the Date field, take notice of the “Quarter” and “Month” to enter the other subsequent Start DateFiscal Period, and End Date.
  5. See the example for “Q2/2017 – June”. After all of the fields are entered, click Save. Then you can click Run Process.
  6. The record window will close. Then you can see “Processing” for the status of the record.
  7. After that, you can open it again and it should show “Completed” as the status. You can also click on the Workflow Instance tab to see the completed workflows.

[Admin: To see other related posts, use the ETL tag.]

Continue reading

Are there best practices for data warehouse reporting & analytics?


In my current project, there was a suggestion to extract (updated) data from TRIRIGA, with a high frequency, and import it into some kind of data warehouse (DW) or business intelligence (BI) solution. Then, from there, perform more advanced reporting and analytics. Have other TRIRIGA solutions implemented something similar? Are there any TRIRIGA best practices or recommendations for staging area, extract-transform-load (ETL), DW, or BI reporting solutions?

[Admin: This post is related to the 12.15.16 post about the IBM TRIRIGA Connector for Watson Analytics. To see other related posts, use the ETL tag or Analytics tag.]

Continue reading

How do you install, upgrade, or uninstall IBM TRIRIGA TDI?


IBM TRIRIGA platform version 3.4.1 and later provides integration with Tivoli Directory Integrator (TDI). TRIRIGA TDI integration offers support for running TDI-based ETL Job Items from within TRIRIGA. This wiki describes how to install the TDI feature of TRIRIGA. It also provides information about upgrading TRIRIGA when the TDI feature is installed and about uninstalling TRIRIGA TDI.

Installing TRIRIGA TDI

TDI is installed and configured by the TRIRIGA installer. The version of TDI installed is as follows…

Install Troubleshooting

Check the following install logs to verify that TDI installed successfully and to troubleshoot problems with TDI installation…

Upgrading TRIRIGA with TDI Installed

Before beginning a TRIRIGA upgrade: 1. Uninstall TDI (see Uninstalling TDI below)…

Uninstalling TDI

During a TRIRIGA upgrade, uninstall TDI before you rename the directory in which TRIRIGA is installed…

[Admin: This post is related to the 05.01.16 post about documentation on developing TDI with TRIRIGA. To see other related posts, use the TDI tag.]

Continue reading