#apache phoenix

Logging to a NoSQL DB from Spark

Logging effectively is often a hard task in standard applications. But when the application runs in a distributed environment, for instance, a Spark job in a big YARN cluster, it becomes ten times harder. Jobs are split into thousands of tasks that run inside multiple worker machines, so the classic console logging is not a good option, because the logs get written to the standard output of…

In Our Office Mustafa needs to connect HBase from Pentaho Kettle. We find a solution for the problem. I want to share who need this.

Download suitable  Apache Phoenix version for you from the website: http://phoenix.apache.org/download.html

Copy two files from source directory to: PENTAHO_INSTALL_PATH/lib/ phoenix-core-4.3.1.jar phoenix-4.3.1-client.jar

Create a new project in Pentaho: File -> New -> Transformation

From left pane select **Design -> Input -> Table Input **and drag it to your transformation

Double click to your table input and give a name to your step

Click new next to Connection select box to create a new database connection

Give your connection a name (Ex: Phoenix) Connection Type: Generic Database Access: Native (JDBC) Custom Connection URL: Your ZooKeeper Hosts (Ex: jdbc:phoenix:localhost:2181:/hbase) Custom Driver Class Name: org.apache.phoenix.jdbc.PhoenixDriver And then click Ok to close database connection settings popup

Thanks to Mustafa Artuc