Created
July 20, 2015 12:46
-
-
Save ScottEvil/668fd0ea4f244458e078 to your computer and use it in GitHub Desktop.
Notes from installing GeoMesa on GeoServer and Hortonworks Sandbox
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Installing GeoMesa on GeoServer | |
- Downloaded geoserver 2.5.2 war wget http://downloads.sourceforge.net/project/geoserver/GeoServer/2.5.2/geoserver-2.5.2-war.zip | |
- and the corresponding WPS plugin wget http://downloads.sourceforge.net/project/geoserver/GeoServer/2.5.2/extensions/geoserver-2.5.2-wps-plugin.zip | |
- Deployed war file to Tomcat_HOME/webapps folder and then copied WPS plugin jars over to WEB-INF/lib and checked to ensure permissions were good | |
- Download Accumulo 1.5.3 :: wget http://apache.go-parts.com/accumulo/1.5.3/accumulo-1.5.3-bin.tar.gz | |
- Download Scala 2.10 :: wget http://downloads.typesafe.com/scala/2.10.5/scala-2.10.5.tgz | |
- Download Kafka 2.10-0.8.2.1 (Kafka 0.8 install that corresponds to scala 2.10) http://ftp.wayne.edu/apache/kafka/0.8.2.1/kafka_2.10-0.8.2.1.tgz | |
- Download Hadoop wget http://apache.mirrors.tds.net/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz | |
Unzip each of the downloads | |
Install scala (Reference http://decisionstats.com/2014/04/15/installing-scala-on-centos/) | |
mv scala-2.10.5 /usr/lib | |
ln -s /usr/lib/scala-2.10.5 /usr/lib/scala | |
export PATH=$PATH:/usr/lib/scala/bin | |
scala -version | |
Copy the necessary Accumulo jars to GeoServer | |
cp ~/Downloads/accumulo/accumulo-1.5.3/lib/accumulo-core.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/accumulo/accumulo-1.5.3/lib/accumulo-fate.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/accumulo/accumulo-1.5.3/lib/accumulo-trace.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
Copy the necessary Hadoop jars to GeoServer | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/common/lib/hadoop-auth-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0 /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cd var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
wget https://search.maven.org/remotecontent?filepath=org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar | |
wget https://search.maven.org/remotecontent?filepath=org/apache/thrift/libthrift/0.9.1/libthrift-0.9.1.jar | |
wget https://search.maven.org/remotecontent?filepath=commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar | |
wget https://search.maven.org/remotecontent?filepath=commons-lang/commons-lang/2.4/commons-lang-2.4.jar | |
make sure names and permissions are set properly on the jars | |
clone the geomesa github repository | |
mvn clean install -DskipTests | |
cp ~//Downloads/geomesa/geomesa/geomesa-plugin/target/geomesa-plugin-1.1.0-rc.3-SNAPSHOT-geoserver-plugin.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
restart GeoServer and make sure the accumulo data store is an option under stores | |
Run the steps in the GeoMesa Accumulo quickstart to verify everything works | |
Set up geomesa kafka plugin | |
cp ~/Downloads/geomesa/geomesa/geomesa-plugin/target/geomesa-plugin-1.1.0-rc.3-SNAPSHOT-geoserver-plugin.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
tar xvf kafka_2.10-0.8.2.1.tgz && cd kafka_2.10-0.8.2.1 | |
cp kafka-clients-0.8.2.1.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp kafka_2.10-0.8.2.1.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp metrics-core-2.2.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
cp zkclient-0.3.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/ | |
export CATALINA_OPTS="-Xms512M -Xmx1024M -XX:PermSize=256m -XX:MaxPermSize=256m" | |
restart GeoServer and make sure the kafka data store is an option under stores | |
On the Kafka machine run this command from the folder where the geomesa jars were built: | |
java -cp ./geomesa-examples/geomesa-kafka-quickstart/target/geomesa-kafka-quickstart-1.1.0-rc.3-SNAPSHOT.jar org.locationtech.geomesa.examples.KafkaQuickStart -brokers "192.168.99.75:6667" -zookeepers "192.168.99.75:2181" | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment