-
环境依赖
- hadoop-3.1.x
- spark-3.1.x
- hive-3.1.x
-
Kylin安装部署
-
上传Kylin安装包
apache-kylin-4.0.4-bin-spark3.tar.gz
到/opt/modules
目录下 -
解压
apache-kylin-4.0.1-bin-spark3.tar.gz
到/opt/installs
cd /opt/modules tar -zxvf apache-kylin-4.0.1-bin-spark3.tar.gz -C /opt/installs/ mv apache-kylin-4.0.1-bin-spark3.tar.gz kylin
-
将mysql连接驱动拷贝一份到Kylin的ext目录下,方便Kylin存储元数据
cp /opt/installs/hive/lib/mysql-connector-java-8.0.26.jar /opt/installs/kylin/ext
-
修改Kylin配置文件
kylin.properties
,根据实际情况修改以下参数cd /opt/installs/kylin/conf vim kylin.properties
#### METADATA | ENV ### # 元数据存储,用的mysql kylin.metadata.url=kylin_metadata@jdbc,url=jdbc:mysql://yourlocal:3306/kylin,username=root,password=123456,maxActive=10,maxIdle=10 # hdfs工作空间 kylin.env.hdfs-working-dir=/kylin # kylin在zk的工作目录 kylin.env.zookeeper-base-path=/kylin # 不用kylin自带的zk kylin.env.zookeeper-is-local=false # 外部zk连接字符串 kylin.env.zookeeper-connect string=bigdata01:2181,bigdata01:2181,bigdata01:2181 #### SPARK BUILD ENGINE CONFIGS ### # hadoop conf目录位置 kylin.env.hadoop-conf-dir=/opt/installs/hadoop/etc/hadoop
-
-
在MySQL里手动创建kylin数据库,方便Kylin存储元数据
create database kylin;
-
Kylin启动和关闭
- 启动kylin之前先启动Hadoop集群,Zookeeper集群
- 启动kylin
cd /opt/installs/kylin bin/kylin.sh start
出现如下内容代表启动成功:
Retrieving hadoop conf dir... ...................................................[PASS] KYLIN_HOME is set to /opt/installs/kylin Checking hive ...................................................[PASS] Checking hadoop shell ...................................................[PASS] Checking hdfs working dir WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. ...................................................[PASS] WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually. Retrieving hadoop conf dir... Retrieving Spark dependency... Skip spark which not owned by kylin. SPARK_HOME is /opt/installs/spark and KYLIN_HOME is /opt/installs/kylin. Please download the correct version of Apache Spark, unzip it, rename it to 'spark' and put it in /opt/installs/kylin directory. Do not use the spark that comes with your hadoop environment. If your hadoop environment is cdh6.x, you need to do some additional operations in advance. Please refer to the link: https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6. Start to check whether we need to migrate acl tables Not HBase metadata. Skip check. A new Kylin instance is started by root. To stop it, run 'kylin.sh stop' Check the log at /opt/installs/kylin/logs/kylin.log Web UI is at http://bigdata01:7070/kylin
-
关闭kylin
bin/kylin.sh stop
-
访问kylin web UI
username:ADMIN
password:KYLIN
http://bigdata01:7070/kylin
-
在第一次启动时,Web页面会报404,需要手动补充两 个Commons的jar包
- commons-configuration-1.3.jar
- commons-collections-3.2.2.jar
添加jar包到
/opt/installs/kylin/tomcat/webapps/kylin/WEB-INF/lib
目录下