美文网首页
Apache Atlas安装部署

Apache Atlas安装部署

作者: 无量儿 | 来源:发表于2022-02-10 16:01 被阅读0次

前言

由于各方面的限制和原因,Apache Atlas 编译与安装十分麻烦,总共耗时大约一个月才完成,第一部分是第一次尝试,当时是在官网下载的源码,在MacOS系统下编译,出现的问题已经记录,但并未编译成功;
第二部分是第二次尝试,是在Github上下载的源码,在Linux环境下编译,已成功编译。

第一部分

0. 下载Apache Atlas Version 2.0.0

官方下载地址:http://atlas.apache.org/#/Downloads

image.png

1. 在服务器或本地编译源文件

Step 1. 执行如下命令

tar -zxvf apache-atlas-2.0.0-sources.tar.gz
cd apache-atlas-sources-2.0.0/
export MAVEN_OPTS="-Xms2g -Xmx4g"
mvn clean -DskipTests install

Step 2. 下面二选一

  1. 机器上已经装有HBase和Solr
mvn clean -DskipTests package -Pdist
  1. 机器上没有装HBase和Solr,Atlas自带HBase和Solr
mvn clean -DskipTests package -Pdist,embedded-hbase-solr

编译过程中错误一:

[ERROR] Cannot download "https://github.com/sass/node-sass/releases/download/v4.13.1/darwin-x64-57_binding.node":

image.png
解决方法:

Step 1.https://github.com/sass/node-sass/releases下载darwin-x64-57_binding.node
Step 2.
Situation 1. Mac将darwin-x64-57_binding.node放到/Users/aaron/.npm/node-sass/4.13.1目录下,如果没有该目录就新建
Situation 2. Linux将darwin-x64-57_binding.node放到用户/.npm/node-sass/(版本号)目录下

[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.4:npm (npm install) on project atlas-dashboardv2: Failed to run task: 'npm install' failed. org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) -> [Help 1]

image.png

npm WARN deprecated socks@1.1.10: If using 2.x branch, please upgrade to at least 2.1.6 to avoid a serious bug with socket data flow and an import issue introduced in 2.1.0

Mac下node.js安装与卸载

安装:

访问 http://nodejs.org/ 进入官网,下载 Mac 版本的 node.js,双击打开安装即可。

通过终端输入命令node -v验证node是否安装正确;npm -v验证npm是否安装正确。

卸载:

sudo rm -rf /usr/local/{bin/{node,npm},lib/node_modules/npm,lib/node,share/man/*/node.*}

Mac电脑由于系统原因出现如下错误:

image.png
解决文案:
xcode-select --install

编译到最后会一直卡在这个位置,原因是正在下hbase-2.0.2-bin.tar.gz,这个包大约100M,所以直接中断编译,去提示的网站手动下载,下载完成一定要改名为hbase-2.0.2.tar.gz,然后放在提示的位置即可

image.png

上一个问题解决完了重新编译还会卡在下载solr-7.5.0.tgz这里,和上面一样手动下载并放到提示位置即可

image.png image.png

第二部分

0. 下载Apache Atlas Version 2.0.0

下载地址:https://github.com/apache/atlas/tree/branch-2.0
一定要去Apache下载,官网下载的源码有问题,我从来没编译过去。

atlas元数据管理
https://blog.csdn.net/max_hello/article/details/102601537

https://www.pianshen.com/article/3820166801/

https://www.pianshen.com/article/3820166801/

https://blog.csdn.net/xiaobai51509660/article/details/90718730?depth_1-utm_source=distribute.pc_relevant.none-task&utm_source=distribute.pc_relevant.none-task

frontend-maven-plugin插件问题解决
https://www.jianshu.com/p/b378dfad09f6

https://www.cnblogs.com/susu8/p/9208826.html

https://www.cnblogs.com/linxizhifeng/p/9083788.html

https://blog.csdn.net/u012599988/article/details/81535136

https://blog.csdn.net/coderblack/article/details/104283606/

https://www.iotschool.com/wiki/tbinstall

npm安装
下载报错中对应的版本https://nodejs.org/download/release/v12.16.0/,上传解压

tar -zxvf node-v12.16.0-linux-x64.tar.gz -C ../servers/
ln -s /export/servers/node-v12.16.0-linux-x64/bin/node /usr/local/bin/
ln -s /export/servers/node-v12.16.0-linux-x64/bin/npm /usr/local/bin/

最后查看安装版本检验node和npm是否已变为全局

node -v
npm -v

npm设置国内淘宝镜像,不然会有下载失败的情况

npm config get registry
npm config set registry https://registry.npm.taobao.org/

编译报错:Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M3:enforce
解决方法:
这一般是pom.xml文件中对maven和java版本作了约束,进到源码的根目录下,检查后发现JAVA版本为1.8.0-141,更换高于1.8.0-151的版本后解决

image.png

编译报错:reason: certificate is not yet valid

image.png

解决方法:

npm config set strict-ssl false
npm install -g supervisor

编译报错:

image.png

解决方法:

yum install gcc-c++

https://blog.csdn.net/qq_19107011/article/details/86478148
https://blog.csdn.net/summer089089/article/details/108327368

atlas-env.sh

#添加HBase配置文件路径(使atlas能找到hbase的jar包)
export HBASE_CONF_DIR=/opt/module/atlas/conf/hbase/conf

atlas-application.properties

# 修改atlas存储数据主机
atlas.graph.storage.hostname=node01:2181,node02:2181,node03:2181
#修改地址,是外部能够访问
atlas.rest.address=http://node01:21000
#访问hbase
atlas.audit.hbase.zookeeper.quorum=node01:2181,node02:2181,node03:2181

出现如下错误:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project atlas-graphdb-janus: Error resolving project artifact: Could not transfer artifact com.sleepycat:je:pom:7.4.5 from/to hortonworks.repo (http://repo.hortonworks.com/content/repositories/releases): Transfer failed for http://repo.hortonworks.com/content/repositories/releases/com/sleepycat/je/7.4.5/je-7.4.5.pom for project com.sleepycat:je:jar:7.4.5: Connect to repo.hortonworks.com:80 [repo.hortonworks.com/54.225.131.199] failed: 拒绝连接 (Connection refused) -> [Help 1]
image.png

参考文章:
1、https://blog.csdn.net/coderblack/article/details/104283606/
2、https://www.cnblogs.com/djlsunshine/p/13453608.html
3、https://my.oschina.net/u/4382953/blog/3288926
4、https://blog.csdn.net/summer089089/article/details/108327368

https://blog.csdn.net/czq850114000

https://www.cnblogs.com/tovin/p/12161793.html

https://blog.csdn.net/czq850114000/article/details/89518215

CDH版本和Atlas版本对应:https://blog.csdn.net/young2018/article/details/103930325

kerberos认证:https://atlas.apache.org/1.1.0/Atlas-Authentication.html

org.springframework.web.util.Log4jConfigListener:
https://blog.csdn.net/qq_36666651/article/details/80295089

Atlas:0.8
https://blog.csdn.net/qq_26502245/article/details/108082993
https://blog.csdn.net/weixin_39618824/article/details/111204385

相关文章

网友评论

      本文标题:Apache Atlas安装部署

      本文链接:https://www.haomeiwen.com/subject/aeblyhtx.html