Tutorial by Examples

For accessing the MS SQL Server database Sqoop requires an additional JDBC driver which can be downloaded from Microsoft. The following steps will install MSSQL Server JDBC driver to Sqoop: wget 'http://download.microsoft.com/download/0/2/A/02AAE597-3865-456C-AE7F-613F99F850A8/sqljdbc_4.0.2206.100_...

To check that the connection to the server is valid: sqoop list-tables --connect "jdbc:sqlserver://<server_ip>:1433;database=<database_name>" --username <user_name> --password <password> Before doing this it is recommended ...

To import data from SQL Server to Hadoop: sqoop import --table TestTable --connect "jdbc:sqlserver://192.168.1.100:1433;database=Test_db" --username user --password password --split-by id --target-dir /user/test ...

Query can be used instead of table in import operation: sqoop import --query 'select Id,Message from TestTable where $CONDITIONS' --where 'id>100' --connect "jdbc:sqlserver://192.168.1.100:1433;database=Test_db --username user -–pas...

The data can be imported directly into Hive: sqoop import --hive-import --table EventLog --connect "jdbc:sqlserver://192.168.1.99:1433;database=Test_db" --username user --password password --split-by id ...

The following sqoop command will be used to import the data from RDBMS table into HBase table, if the table does not exists in HBase it will create a new table and import the data into this table sqoop import \ --query 'select emp_id, emp_name, emp_sal from employee where $CONDITIONS' \ ...