oozie Oozie 101 How to pass configuration with Oozie Proxy Job submission


Example

When using the Oozie Proxy job submission API for submitting the Oozie Hive, Pig, and Sqoop actions. To pass any configuration to the action, is required to be in below format.

For Hive action:

  • oozie.hive.options.size : The number of options you'll be passing to Hive action.
  • oozie.hive.options.n : An argument to pass to Hive, the 'n' should be an integer starting with zero (0) to indicate the option number.
<property>
    <name>oozie.hive.options.1</name>
    <value>-Doozie.launcher.mapreduce.job.queuename=hive</value>
</property>
<property>
    <name>oozie.hive.options.0</name>
    <value>-Dmapreduce.job.queuename=hive</value>
</property>
<property>
    <name>oozie.hive.options.size</name>
    <value>2</value>
</property>

For Pig Action:

  • oozie.pig.options.size : The number of options you'll be passing to Pig action.
  • oozie.pig.options.n : An argument to pass to Pig, the 'n' should be an integer starting with zero (0) to indicate the option number.
<property>
    <name>oozie.pig.options.1</name>
    <value>-Doozie.launcher.mapreduce.job.queuename=pig</value>
</property>
<property>
    <name>oozie.pig.options.0</name>
    <value>-Dmapreduce.job.queuename=pig</value>
</property>
<property>
    <name>oozie.pig.options.size</name>
    <value>2</value>
</property>

For Sqoop Action:

  • oozie.sqoop.options.size : The number of options you'll be passing to Sqoop Hadoop job.
  • oozie.sqoop.options.n : An argument to pass to Sqoop. hadoop job conf, the 'n' should be an integer starting with zero(0) to indicate the option number.
<property>
    <name>oozie.sqoop.options.1</name>
    <value>-Doozie.launcher.mapreduce.job.queuename=sqoop</value>
</property>
<property>
    <name>oozie.sqoop.options.0</name>
    <value>-Dmapreduce.job.queuename=sqoop</value>
</property>
<property>
    <name>oozie.sqoop.options.size</name>
    <value>2</value>
</property>