超详细Kylin 4.0.4安装指南:从环境搭建到Web访问,保姆级教程一篇搞定!

  1. 环境依赖

    • hadoop-3.1.x
    • spark-3.1.x
    • hive-3.1.x
  2. Kylin安装部署

    • 上传Kylin安装包apache-kylin-4.0.4-bin-spark3.tar.gz/opt/modules目录下

    • 解压apache-kylin-4.0.1-bin-spark3.tar.gz/opt/installs

      cd /opt/modules
      tar -zxvf apache-kylin-4.0.1-bin-spark3.tar.gz -C /opt/installs/
      mv apache-kylin-4.0.1-bin-spark3.tar.gz kylin
      
    • 将mysql连接驱动拷贝一份到Kylin的ext目录下,方便Kylin存储元数据

      cp /opt/installs/hive/lib/mysql-connector-java-8.0.26.jar /opt/installs/kylin/ext
      
    • 修改Kylin配置文件kylin.properties,根据实际情况修改以下参数

      cd /opt/installs/kylin/conf
      vim kylin.properties
      
      #### METADATA | ENV ### 
      # 元数据存储,用的mysql 
      kylin.metadata.url=kylin_metadata@jdbc,url=jdbc:mysql://yourlocal:3306/kylin,username=root,password=123456,maxActive=10,maxIdle=10
      # hdfs工作空间  
      kylin.env.hdfs-working-dir=/kylin 
      # kylin在zk的工作目录 
      kylin.env.zookeeper-base-path=/kylin 
      # 不用kylin自带的zk 
      kylin.env.zookeeper-is-local=false 
      # 外部zk连接字符串 
      kylin.env.zookeeper-connect
      string=bigdata01:2181,bigdata01:2181,bigdata01:2181 
      #### SPARK BUILD ENGINE CONFIGS ### 
      # hadoop conf目录位置 
      kylin.env.hadoop-conf-dir=/opt/installs/hadoop/etc/hadoop 
      
  3. 在MySQL里手动创建kylin数据库,方便Kylin存储元数据

    create database kylin; 
    
  4. Kylin启动和关闭

    • 启动kylin之前先启动Hadoop集群,Zookeeper集群
    • 启动kylin
    cd /opt/installs/kylin
    bin/kylin.sh start 
    

    出现如下内容代表启动成功:

    Retrieving hadoop conf dir...
    ...................................................[PASS]
    KYLIN_HOME is set to /opt/installs/kylin
    Checking hive
    ...................................................[PASS]
    Checking hadoop shell
    ...................................................[PASS]
    Checking hdfs working dir
    WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
    ...................................................[PASS]
    WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
    WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
    
    Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.
    Retrieving hadoop conf dir...
    Retrieving Spark dependency...
    Skip spark which not owned by kylin. SPARK_HOME is /opt/installs/spark and KYLIN_HOME is /opt/installs/kylin.
      Please download the correct version of Apache Spark, unzip it, rename it to 'spark' and put it in /opt/installs/kylin directory.
      Do not use the spark that comes with your hadoop environment.
      If your hadoop environment is cdh6.x, you need to do some additional operations in advance.
      Please refer to the link: https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6.
    Start to check whether we need to migrate acl tables
    Not HBase metadata. Skip check.
    
    A new Kylin instance is started by root. To stop it, run 'kylin.sh stop'
    Check the log at /opt/installs/kylin/logs/kylin.log
    Web UI is at http://bigdata01:7070/kylin
    
    • 关闭kylin

      bin/kylin.sh stop 
      
  5. 访问kylin web UI

    ​ username:ADMIN

    ​ password:KYLIN

    http://bigdata01:7070/kylin
    
  6. 在第一次启动时,Web页面会报404,需要手动补充两 个Commons的jar包

    • commons-configuration-1.3.jar
    • commons-collections-3.2.2.jar

    添加jar包到/opt/installs/kylin/tomcat/webapps/kylin/WEB-INF/lib目录下

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值