topic AAAR_Etract.sh is failing due to connection in Alfresco Forum

AAAR_Etract.sh is failing due to connection

manirangasamy — Mon, 15 May 2017 05:28:44 GMT

Hi Francesco ,I am facing problem while executing the AAAR_Extract.sh.I am using mysql and I used AAAR_Manual_Installation.pdfPentaho Combined Server 7.0.0.0-25 Distributionmysql Ver 14.12 Distrib 5.0.95, for redhat-linux-gnu (x86_64) using readline 5.1Pentaho and Alfresco are not same servers.Belo

Re: AAAR_Etract.sh is failing due to connection

fcorti — Mon, 15 May 2017 07:48:03 GMT

Hi,

It seems you don't have AAAR_Kettle database installed or it is not reachable from the Kettle instance.

Please try to run spoon and have access to the AAAR repository.

You should experience the same issue and it should be faster to solve.

I hope this will help you.

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Tue, 16 May 2017 06:44:40 GMT

Database is created.

Ran the ./spoon.sh -rep=KettleDatabaseRepository -user=admin -pass=admin. As you said, it is not connecting to database.

and I got below error. I am not sure where to configure the database and how to troubleshoot. I am using MySQL server and updated the relevant drivers in the respective directories.

This is the

cat repositories.xml
<?xml version="1.0" encoding="UTF-8"?>
<repositories>
<connection>
    <name>AAAR_Kettle</name>
    <type>MYSQL</type>
    <access>JNDI</access>
    <database>AAAR_Kettle</database>
</connection>
<repository>
    <id>KettleDatabaseRepository</id>
    <name>AAAR_Kettle</name>
    <description>AAAR_Kettle</description>
    <connection>AAAR_Kettle</connection>
</repository>
</repositories>

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2017/05/16 16:39:24 - RepositoriesMeta - Reading repositories XML file: /oracle/app/pentaho/data-integration/repositories.xml
2017/05/16 16:39:26 - RepositoriesMeta - Reading repositories XML file: /oracle/app/pentaho/data-integration/repositories.xml
2017/05/16 16:39:27 - Spoon - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Sorry, we didn't recognize those connection details. Please check the user name and password and try again.
2017/05/16 16:39:38 - Spoon - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : No repositories defined on this system.

Re: AAAR_Etract.sh is failing due to connection

fcorti — Tue, 16 May 2017 06:58:27 GMT

Ok, good.
Probably it is corrupted or not correctly imported.
Once imported, you should be able to connect to it using Spoon.

I hope this help you.

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Wed, 17 May 2017 00:35:27 GMT

I am missing something.

"Once imported, you should be able to connect to it using Spoon."

Is it "imported" means, import data from Alfresco to AAAR_Kettle database using AAAR_Extract.sh?

If yes, this is not working because of connecting to mySQL database and same reason spoon also not loading.

I might be missed some configuration related to connection, it will be great to help me troubleshoot the connection issues to my MySql server

Regards

Mani

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Wed, 17 May 2017 02:30:10 GMT

Hi Francesco,

I moved on from this error and AAAR_Extract.sh is executing. script ended after 1 minutes with below error

2017/05/17 11:28:52 - Modified Java Script Value.0 - No starting Script found!
2017/05/17 11:28:52 - stg_workflow_instances.0 - Prepared statement : INSERT INTO stg_workflow_instances (alfresco_id, id, url, name, title, description, isActive, startDate, message, endDate, dueDate, package, initiator, definitionUrl) VALUES ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
org.pentaho.di.core.exception.KettleValueException:
Javascript error:
TypeError: Cannot read property "userName" from null (script#48)
        at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.addValues(ScriptValuesMod.java:475)
        at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.processRow(ScriptValuesMod.java:541)
        at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.mozilla.javascript.EcmaError: TypeError: Cannot read property "userName" from null (script#48)
        at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3785)
        at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3763)
        at org.mozilla.javascript.ScriptRuntime.typeError(ScriptRuntime.java:3791)
        at org.mozilla.javascript.ScriptRuntime.typeError2(ScriptRuntime.java:3810)
        at org.mozilla.javascript.ScriptRuntime.undefReadError(ScriptRuntime.java:3823)
        at org.mozilla.javascript.ScriptRuntime.getObjectProp(ScriptRuntime.java:1508)
        at org.mozilla.javascript.gen.script_6._c_script_0(script:48)
        at org.mozilla.javascript.gen.script_6.call(script)
        at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:426)
        at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3178)
        at org.mozilla.javascript.gen.script_6.call(script)
        at org.mozilla.javascript.gen.script_6.exec(script)
        at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.addValues(ScriptValuesMod.java:388)
        ... 3 more
2017/05/17 11:28:52 - Modified Java Script Value.0 - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Unexpected error
2017/05/17 11:28:52 - Modified Java Script Value.0 - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : org.pentaho.di.core.exception.KettleValueException:
2017/05/17 11:28:52 - Modified Java Script Value.0 - Javascript error:
2017/05/17 11:28:52 - Modified Java Script Value.0 - TypeError: Cannot read property "userName" from null (script#48)
2017/05/17 11:28:52 - Modified Java Script Value.0 -
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.addValues(ScriptValuesMod.java:475)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.processRow(ScriptValuesMod.java:541)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at java.lang.Thread.run(Thread.java:745)
2017/05/17 11:28:52 - Modified Java Script Value.0 - Caused by: org.mozilla.javascript.EcmaError: TypeError: Cannot read property "userName" from null (script#48)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3785)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3763)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.typeError(ScriptRuntime.java:3791)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.typeError2(ScriptRuntime.java:3810)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.undefReadError(ScriptRuntime.java:3823)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.getObjectProp(ScriptRuntime.java:1508)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.gen.script_6._c_script_0(script:48)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.gen.script_6.call(script)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:426)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3178)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.gen.script_6.call(script)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.mozilla.javascript.gen.script_6.exec(script)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.addValues(ScriptValuesMod.java:388)
2017/05/17 11:28:52 - Modified Java Script Value.0 -    ... 3 more
child index = 1, logging object : org.pentaho.di.core.logging.LoggingObject@6e6ea1ab parent=8943465d-663b-4e0b-b700-f8c04550efb4
2017/05/17 11:28:52 - Modified Java Script Value.0 - Finished processing (I=0, O=0, R=1, W=11, U=0, E=1)
2017/05/17 11:28:52 - Get workflow instances - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Errors detected!
2017/05/17 11:28:52 - Get workflow instances - Transformation detected one or more steps with errors.

Re: AAAR_Etract.sh is failing due to connection

fcorti — Wed, 17 May 2017 05:36:38 GMT

Ah...

This is an unexpected null value into the ETL in a javascript transformation.

I solved in Alflytics solution but for your version of AAAR you need to patch the source code.

I can give you guidance on this.

If available launch Spoon (the PDI user interface) and access to the repository and to the ETL source code.

Then I'll tell you where to change the code.

Please confirm.

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Wed, 17 May 2017 06:01:55 GMT

Hi Francesco,

I am able to lunch Spoon. Please guide me how to access the repository and ETL source code to fix the code.

Another question? Is this fixed in latest version of AAAR? Can I download try it?

Regards

Mani

Re: AAAR_Etract.sh is failing due to connection

fcorti — Wed, 17 May 2017 06:21:13 GMT

Hi,

Open the transformation named 'Get workflow instances' in the /Alfresco/Staging/Utility folder and edit the javascript task.

Inside the source code there is there is a line similar to this:

newRow[fieldNum++] = (wfInstance.initiator != null) ? wfInstance.initiator.userName : null;

Change the line according to the following source code:

newRow[fieldNum++] = (wfInstance.initiator != null) ? (wfInstance.initiator.userName != null ? wfInstance.initiator.userName : null) : null;

Save and extract again... the error should be solved.

About the newest version of AAAR:
It's called Alflytics (GitHub - fcorti/Alflytics: The Open Source Business Intelligence solution over the Alfresco platform. ).

I'm working on the latest tuning and documentation... so today is not yet released.

I hope this help you.

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Fri, 19 May 2017 02:36:10 GMT

Hi Francesco,

Thank you for response.

I am totally new to pentaho and spoon.

Please guide me or refer some documentation how to reach the code using spoon

I am able to lunch spoon. but not able to locate the source code.

I tried opening the all the *.ktr extension files under AAAR folder but not able to locate it. I am not sure I am doing right thing.

Regards

Mani

Re: AAAR_Etract.sh is failing due to connection

fcorti — Fri, 19 May 2017 05:51:43 GMT

Hi,

Using spoon, you have a "connect" button on the top right of the user interface.

Click the button you should have already a "AAAR_Kettle" connection.

Clicking this, you will be required to write login and password to connect to the repository (admin/admin).

Once done, a repository explorer will be available to you.

Open the transformation (name and path are above), modify the javascript source code and save.

That's all!

You can execute the extraction again.

Cheers.

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Tue, 23 May 2017 02:22:09 GMT

Thank you Francesco. Finally, I am able to locate the button. It was quit challenging to locate the button. 🙂 . Someone raised as bug in spoon and closed the bug with screenshoot :-). I got it from there.

Next challenge is while click on repository manager, it was throughing an error due to xulrunner compatibility. I updated the version recommended in the forum. Now, error is vanished but blank window appearing. I understand this not issues with AAAR. Did you come across such problem? Will updating firefox help ? or any suggestion to open repository manager?

Regards

Mani

Re: AAAR_Etract.sh is failing due to connection

fcorti — Tue, 23 May 2017 06:48:04 GMT

Mmmm, really strange.

I did not experience a similar issue in the past, sorry.

Are you using spoon on windows?

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Tue, 23 May 2017 06:50:13 GMT

I am using spoon on Linux

Re: AAAR_Etract.sh is failing due to connection

fcorti — Tue, 23 May 2017 06:53:33 GMT

Did you install this?

sudo apt-get install libwebkitgtk-1.0-0

How to install Pentaho Data Integration 7 (aka Kettle) - Francesco Corti

Re: AAAR_Etract.sh is failing due to connection

manirangasamy — Thu, 01 Jun 2017 06:43:48 GMT

Hi Francesco,

I am trying to compile and build webkitgtk from The WebKitGTK+ Project . I am going nut by get dependency after dependency while I am trying it.

I would like to ask one question, is it possible to edit the script using windows environment and load the repository in linux environment or is there any other way to edit script.in repository and deploy into linux (RHEL 5)

Regards

Mani

Re: AAAR_Etract.sh is failing due to connection

fcorti — Thu, 01 Jun 2017 08:14:58 GMT

You should not need to compile it.
Please note that you could install PDI on a different server/environment respect to the Pentaho BA server.