sqoop2 简单使用

1、启动、停止 Sqoop 2 server：

   bin/sqoop.sh server start

   验证地址：http://node3:12000/sqoop/

   bin/sqoop.sh server stop

2、sqoop2  命令行

bin/sqoop.sh client
输入help 查看命令

exit    (\x  ) Exit the shell
  history (\H  ) Display, manage and recall edit-line history
  help    (\h  ) Display this help message
  set     (\st ) Configure various client options and settings
  show    (\sh ) Display various objects and configuration options
  create  (\cr ) Create new object in Sqoop repository
  delete  (\d  ) Delete existing object in Sqoop repository
  update  (\up ) Update objects in Sqoop repository
  clone   (\cl ) Create new object based on existing one
  start   (\sta) Start job
  stop    (\stp) Stop job
  status  (\stu) Display status of a job
  enable  (\en ) Enable object in Sqoop repository
  disable (\di ) Disable object in Sqoop repository

3、设置sqoop server：
   set server --host node3 --port 12000 --webapp sqoop

Set Option 使用


verbose 客户端输出更多的日志
poll-timeout 10000 Server poll timeout in milliseconds

Example:

set option --name verbose --value true
set option --name poll-timeout --value 20000



查询已有连接

show connector
           
查询link
show link

查询job

show job

创建link
    create link --cid 1 or create link -c 1     "1" 为connector id

创建 job
   create job --from 1 --to 2 or create job --f 1 --t 2  "-f 或-- from" 为从link1  "-t 或 --to" 到 link2

  更新 link
  update link -l1 "-l1" 是linkid为1的

  更新job
  update job -j1   "-j1" 是jobid为1的

  启动一个job
  Argument   Description

   -j, --jid <x> Start job with id <x>
   -s, --synchronous Synchoronous job execution

    Example:
    start job --jid 1
    start job --jid 1 --synchronous

    Stop job

    -j, --jid <x> Interrupt running job with id <x>

     Example:

    stop job --jid 1
    
    clone job|link

     克隆时名称要修改

4 实例


实例：建立一个hdfslink
create link -c 3
Name: hdfs_link
HDFS URI: hdfs://ns1/
link was successfully created with status OK

实例：建立一个JDBC link
create link -c 4
Name: oracleJdbc_link

JDBC Driver Class: oracle.jdbc.driver.OracleDriver
JDBC Connection String: jdbc:oracle:thin:@hostip:1521:erpdb
Username: jlerp_v
Password: xxxxxx
JDBC Connection Properties:
There are currently 0 values in the map:
entry#
link was successfully created with status OK

实例 克隆oracleJdbc_link
sqoop:000> clone link -lid 5
Cloning link with id 5
Please update link:
Name: oracleJdbc_link_clone

Link configuration

JDBC Driver Class: oracle.jdbc.driver.OracleDriver
JDBC Connection String: jdbc:oracle:thin:@10.68.2.23:1521:erpdb
Username: jlerp_v
Password: *******
JDBC Connection Properties:
There are currently 0 values in the map:
entry#
link was successfully created with validation status WARNING and persistent id 8

注意 在创建JDBCjob时

Schema name:  Table name: 配对使用，如果输入了schema 和 table name ,Table SQL statement: 就不需要输入，如果输入了 sql语句就不填 schema 和 table name