Spark Zeppelin and Elasticsearch

Spark Zeppelin and Elasticsearch

Open Zeppelin and select ‘Interpreter’

Visit this URL to get more information about my Elastisearch cluster
http://ubuntu-master:9200/

Configure these informations
elasticsearch.client.type = transport
elasticsearch.cluster.name = sillycatcluster
elasticsearch.host = ubuntu-master
elasticsearch.port = 9300
elasticsearch.result.size = 100

Save the config and restart the interpreter

Create a new notebook use Elasticsearch as default or put %elasticsearch

I saw this logging in Elasticsearch
[2019-06-06T18:48:27,637][WARN ][o.e.t.TcpTransport       ] [elastic1] exception caught on transport layer [Netty4TcpChannel{localAddress=/192.168.56.101:9300, remoteAddress=/192.168.56.101:46928}], closing connection
java.lang.IllegalStateException: Received message from unsupported version: [2.0.0] minimal compatible version is: [6.7.0]

It seems that the interpreter is too old.

References:
http://zeppelin.apache.org/docs/0.8.0/interpreter/elasticsearch.html
https://community.hortonworks.com/articles/54755/enabling-the-zeppelin-elasticsearch-interpreter.html