美文网首页
Spark2.3.0-cdh5.16.1 standalone部

Spark2.3.0-cdh5.16.1 standalone部

作者: guaren2009 | 来源:发表于2020-05-24 23:21 被阅读0次

# 解压

[hadoop@hadoop software]$ cd /home/hadoop/software/

[hadoop@hadoop software]$ tar -xvf spark-2.3.0-bin-2.6.0-cdh5.16.1.tgz -C /home/hadoop/app/

# 软连接

[hadoop@hadoop software]$ cd /home/hadoop/app/

[hadoop@hadoop app]$ ln -s spark-2.3.0-bin-2.6.0-cdh5.16.1 spark

# 配置文件配置ip

[hadoop@hadoop app]$ cp spark/conf/spark-env.sh.template spark/conf/spark-env.sh

[hadoop@hadoop app]$ vim spark/conf/spark-env.sh

添加 SPARK_LOCAL_IP=hadoop

# 部署完成,启动spark-shell验证是否部署成功

[hadoop@hadoop app]$ cd spark/bin/

[hadoop@hadoop bin]$ ./spark-shell --master=local

相关文章

网友评论

      本文标题:Spark2.3.0-cdh5.16.1 standalone部

      本文链接:https://www.haomeiwen.com/subject/fjnsahtx.html