provided some shell scripts for reducing parameters to submit a job by lvyanquan · Pull Request #930 · DTStack/chunjun
提供一些脚本,用于减少在不同模式下任务提交需要传入的参数,只需要传递-job和-confProp即可。
其他参数如flink配置文件和hadoop配置文件,通过FLINK_HOME/HADOOP_HOME等参数预先设定。
例如:
在local 模式
bash chunjun-local.sh -job ../chunjun-examples/json/stream/stream.json
在standalone模式
bash chunjun-standalone.sh -job ../chunjun-examples/json/stream/stream.json
启动效果
% bash local.sh -job ../chunjun-examples/json/stream/stream.json
CHUNJUN_HOME is auto set /Users/admin/fsdownload/chunjun-dist
FLINK_HOME is /Users/admin/flink-1.12.4
HADOOP_HOME is /Users/admin/hadoop
ChunJun starting ...
2022-06-09 14:43:37.128 [main] INFO com.dtstack.chunjun.Main - ------------program params-------------------------
2022-06-09 14:43:37.165 [main] INFO com.dtstack.chunjun.Main - -flinkLibDir
2022-06-09 14:43:37.166 [main] INFO com.dtstack.chunjun.Main - /Users/admin/flink-1.12.4/lib
2022-06-09 14:43:37.166 [main] INFO com.dtstack.chunjun.Main - -p
2022-06-09 14:43:37.166 [main] INFO com.dtstack.chunjun.Main -
2022-06-09 14:43:37.166 [main] INFO com.dtstack.chunjun.Main - -job