美文网首页
CDH5.15.2版本升级到flume1.9.0

CDH5.15.2版本升级到flume1.9.0

作者: 阿文很淘气 | 来源:发表于2020-05-08 14:43 被阅读0次

建议以下的jar 可以从 cdh高版本parcels中下载对面的jar。如果从apache flume里下载
1.9.0可能启动有问题,不能被 clouderamanager的webserver 状态进行监控管理。
/opt/cloudera/parcels/CDH-5.15.2-1.cdh5.15.2.p0.3/lib/flume-ng/lib
把原来的flume-* remove掉,换成新的1.9.0jar。



ln  -vfs  flume-avro-source-1.9.0-cdh6.2.0.jar  flume-avro-source.jar
ln  -vfs  flume-dataset-sink-1.9.0-cdh6.2.0.jar  flume-dataset-sink.jar
ln  -vfs  flume-file-channel-1.9.0-cdh6.2.0.jar   flume-file-channel.jar
ln  -vfs  flume-hdfs-sink-1.9.0-cdh6.2.0.jar   flume-hdfs-sink.jar
ln  -vfs  flume-hive-sink-1.9.0-cdh6.2.0.jar  flume-hive-sink.jar
ln  -vfs  flume-http-sink-1.9.0-cdh6.2.0.jar   flume-http-sink.jar
ln  -vfs  flume-irc-sink-1.9.0-cdh6.2.0.jar   flume-irc-sink.jar
ln  -vfs  flume-jdbc-channel-1.9.0-cdh6.2.0.jar  flume-jdbc-channel.jar
ln  -vfs  flume-jms-source-1.9.0-cdh6.2.0.jar  flume-jms-source.jar
ln  -vfs  flume-kafka-channel-1.9.0-cdh6.2.0.jar flume-kafka-channel.jar
ln  -vfs  flume-kafka-source-1.9.0-cdh6.2.0.jar flume-kafka-source.jar
ln  -vfs  flume-ng-auth-1.9.0-cdh6.2.0.jar  flume-ng-auth.jar
ln  -vfs  flume-ng-config-filter-api-1.9.0-cdh6.2.0.jar  flume-ng-config-filter-api.jar
ln  -vfs  flume-ng-configuration-1.9.0-cdh6.2.0.jar  flume-ng-configuration.jar
ln  -vfs  flume-ng-core-1.9.0-cdh6.2.0.jar  flume-ng-core.jar
ln  -vfs  flume-ng-embedded-agent-1.9.0-cdh6.2.0.jar  flume-ng-embedded-agent.jar
ln  -vfs  flume-ng-environment-variable-config-filter-1.9.0-cdh6.2.0.jar   flume-ng-environment-variable-config-filter.jar
ln  -vfs  flume-ng-external-process-config-filter-1.9.0-cdh6.2.0.jar  flume-ng-external-process-config-filter.jar
ln  -vfs  flume-ng-hadoop-credential-store-config-filter-1.9.0-cdh6.2.0.jar  flume-ng-hadoop-credential-store-config-filter.jar
ln  -vfs  flume-ng-hbase2-sink-1.9.0-cdh6.2.0.jar  flume-ng-hbase2-sink.jar
ln  -vfs  flume-ng-kafka-sink-1.9.0-cdh6.2.0.jar   flume-ng-kafka-sink.jar
ln  -vfs  flume-ng-log4jappender-1.9.0-cdh6.2.0.jar  flume-ng-log4jappender.jar
ln  -vfs  flume-ng-morphline-solr-sink-1.9.0-cdh6.2.0.jar  flume-ng-morphline-solr-sink.jar
ln  -vfs  flume-ng-node-1.9.0-cdh6.2.0.jar   flume-ng-node.jar
ln  -vfs  flume-ng-sdk-1.9.0-cdh6.2.0.jar   flume-ng-sdk.jar
ln  -vfs  flume-scribe-source-1.9.0-cdh6.2.0.jar   flume-scribe-source.jar
ln  -vfs  flume-shared-kafka-1.9.0-cdh6.2.0.jar   flume-shared-kafka.jar
ln  -vfs  flume-spillable-memory-channel-1.9.0-cdh6.2.0.jar   flume-spillable-memory-channel.jar
ln  -vfs  flume-taildir-source-1.9.0-cdh6.2.0.jar   flume-taildir-source.jar
ln  -vfs  flume-thrift-source-1.9.0-cdh6.2.0.jar  flume-thrift-source.jar
ln  -vfs  flume-tools-1.9.0-cdh6.2.0.jar   flume-tools.jar
ln  -vfs  flume-twitter-source-1.9.0-cdh6.2.0.jar  flume-twitter-source.jar
ln  -vfs spark-streaming-flume-sink_2.11-2.4.0-cdh6.2.0.jar  spark-streaming-flume-sink.jar

ll avro*
rm -f avro*
ln -vfs ../../../lib/avro/avro-ipc-1.8.2-cdh6.2.0.jar  avro-ipc.jar
ln -vfs ../../../lib/avro/avro-1.8.2-cdh6.2.0.jar   avro.jar

重启ok

相关文章

网友评论

      本文标题:CDH5.15.2版本升级到flume1.9.0

      本文链接:https://www.haomeiwen.com/subject/ykyfnhtx.html