Hadoop 安装Snappy

最新推荐文章于 2024-09-12 07:44:59 发布

转载最新推荐文章于 2024-09-12 07:44:59 发布 · 939 阅读

文章标签：

#hadoop #snappy #源码编译

hadoop 专栏收录该内容

2 篇文章

订阅专栏

1.wget http://pkgs.fedoraproject.org/repo/pkgs/snappy/snappy-1.1.1.tar.gz/8887e3b7253b22a31f5486bca3cbc1c2/snappy-1.1.1.tar.gz

2.http://pan.baidu.com/share/link?uk=3694838921&shareid=1608967052&third=0&adapt=pc&fr=ftw

3.下载 hadoop 源码src 包

4.安装svn 出错 :E：Package 'svn' has no installation candidate 解决： sudo apt-get update && sudo apt-get install svn

5.hadoop@ubuntu:/opt/app/native_snappy$ lsb_release -a
No LSB modules are available.
Distributor ID:Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial

6.E: apt-get install ncurses-devel 出错 Unable to locate package ncurses-devel

解决： sudo apt-get install libncurses-dev

7.apt-get install autoconf automake libtool cmake

8.apt-get install openssl-devel 出错 E: apt-get install openssl-devel Unable to locate package openssl-devel

解决 : sudo apt-get install openssl

RedHat、centos才是openssl-devel

9.sudo apt-get install gcc

10. tar -zxvf snappy-1.1.1.tar.gz

11.cd snappy-1.1.1/

12. ./configure

13. make

14. sudo make install

15. ls -lh /usr/local/lib |grep snappy

查看是否有显示

-rw-r--r-- 1 root root 229K Jun 21 15:46 libsnappy.a
-rwxr-xr-x 1 root root 953 Jun 21 15:46 libsnappy.la
lrwxrwxrwx 1 root root 18 Jun 21 15:46 libsnappy.so -> libsnappy.so.1.2.0
lrwxrwxrwx 1 root root 18 Jun 21 15:46 libsnappy.so.1 -> libsnappy.so.1.2.0
-rwxr-xr-x 1 root root 145K Jun 21 15:46 libsnappy.so.1.2.0

16. cd../

17. tar -zxvf protobuf-2.5.0.tar.gz

18. cd protobuf-2.5.0

19. ./configure

20.make

21. sudo make install

22.protoc -- version 验证出错 protoc: error while loading shared libraries: libprotoc.so.8: cannot open shared object file: No such file or directory

已经安装了该共享库, 但执行需要调用该共享库的程序的时候, 程序按照默认共享库路径找不到该共享库文件.

所以安装共享库后要注意共享库路径设置问题, 如下:

1) 如果共享库文件安装到了/lib或/usr/lib目录下, 那么需执行一下ldconfig命令

root 用户执行

# cat /etc/ld.so.conf
include ld.so.conf.d/*.conf
# echo "/usr/local/lib" >> /etc/ld.so.conf
# ldconfig

23. tar -zxvf hadoop-2.7.2-src.tar.gz
24. cd hadoop-2.7.2-src/
25. mvn clean package -DskipTests -Pdist,native -Dtar -Dsnappy.lib=/usr/local/lib -Dbundle.snappy