Sqoop安装配置

ZeroTeam_麒麟

于 2016-04-11 19:40:52 发布

阅读量730

点赞数

CC 4.0 BY-SA版权

本文链接：https://blog.csdn.net/qq_26840065/article/details/51124697

apache hadoop 同时被 2 个专栏收录

17 篇文章

订阅专栏

apache Sqoop

8 篇文章

订阅专栏

<span style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; background-color: rgb(255, 255, 255);">使用的系统</span>

Linux CentOS 6.5

Hadoop:hadoop-2.7.1

sqoop-1.99.6 下载地址:http://apache.fayea.com/sqoop/1.99.6/sqoop-1.99.6-bin-hadoop200.tar.gz

解压配置

tar zxvf sqoop-1.99.6-bin-hadoop200.tar.gz -C /home/hadoop/src/

配置环境变量

vim /etc/profile

export JAVA_HOME=/usr/jvm/jdk1.7.0_67
export HADOOP_HOME=/home/hadoop/src/hadoop-2.7.1
export SQOOP_HOME=/home/hadoop/src/sqoop
export CATALINE_BASE=$SQOOP_HOME/server
export CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$HADOOP_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/sbin:$HADOOP_HOME/bin:$SQOOP_HOME/bin

配置${SQOOP_HOME}/server/conf/catalina.properties

/home/hadoop/src/hadoop-2.7.1/share/hadoop/common/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/common/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/hdfs/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/hdfs/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/httpfs/tomcat/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/mapreduce/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/mapreduce/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/tools/lib/*.jar/home/hadoop/src/hadoop-2.7.1/share/hadoop/yarn/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/yarn/lib/*.jar

配置${SQOOP_HOME}/server/conf/sqoop.properties 文件

vim ./server/conf/sqoop.properties

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=修改为自己的Hadoop路径

sqoop的配置基本上已经结束：下面就开始测试是否安装成功！。。

先启动Hadoop集群

start-all.sh

由于刚刚配置的Sqoop的环境变量

sqoop2-server start

启动过Sqoop客户端

[hadoop@nn1 sqoop]$ sqoop.sh client
Sqoop home directory: /home/hadoop/src/sqoop
Apr 11, 2016 12:36:36 PM java.util.prefs.FileSystemPreferences$1 run
INFO: Created user preferences directory.
Sqoop Shell: Type 'help' or '\h' for help.

sqoop:000> help
For information about Sqoop, visit: http://sqoop.apache.org/

Available commands:
  exit    (\x  ) Exit the shell
  history (\H  ) Display, manage and recall edit-line history
  help    (\h  ) Display this help message
  set     (\st ) Configure various client options and settings
  show    (\sh ) Display various objects and configuration options
  create  (\cr ) Create new object in Sqoop repository
  delete  (\d  ) Delete existing object in Sqoop repository
  update  (\up ) Update objects in Sqoop repository
  clone   (\cl ) Create new object based on existing one
  start   (\sta) Start job
  stop    (\stp) Stop job
  status  (\stu) Display status of a job
  enable  (\en ) Enable object in Sqoop repository
  disable (\di ) Disable object in Sqoop repository
  grant   (\g  ) Grant access to roles and assign privileges
  revoke  (\r  ) Revoke access from roles and remove privileges