
前言:8 月 17 日,CloudQuery 社区第一期征文活动正式对外发布。小编也陆续收到了很多用户的投稿,再次感谢大家对 CQ 的支持。本文来自社区用户 ID:尚雷的分享,下面就来看看他的 CQ 初体验吧,希望能对初次接触 CQ 的你有所帮助。(
征文活动持续到9月28日,欢迎其他小伙伴积极参加哦~参加有礼)
“
前言
在日常数据库运维中,为连接多种数据库,经常要安装不同的客户端,非常繁琐,且占用大量存储空间。如果能有一种工具,可以不用在自己电脑上安装,而且能够同时连接多种数据库该多好。
恰好有一天,我看到一朋友在朋友圈发了一条朋友圈信息,说 CloudQuery 在进行有奖征文。最近我不是刚参加完 OpenGauss 有奖征文吗,趁热打铁,看看这东西是什么,写写文章,看看能否得奖
。
于是点开了她发的朋友圈链接,里面只是描述文章征文的内容,并没有讲过多东西,没有讲解 CloudQuery 是干什么的,能做哪些事情,觉得好像也没啥啊,就有点失望了,正好也有事,就没再继续多看下去。过了两天,正好无事,于是又打开了那链接,关注了公众号,登录下官网。我去,这才了解到了 CloudQuery 的一些知识,没想到这 CloudQuery 这么强大,竟然可以连接好多数据库,而且还有审计、提工单等作用。
于是,我决定好好使用了解下。
千里之行始于足下,先安装下试试,let’s go.
本篇主要讲述如何安装部署 CloudQuery 及相关注意事项,因为篇幅,下一篇将讲述如何使用 CloudQuery 来连接数据库。
“
下载 CloudQuery 安装包
登录CloudQuery官网,打开下载链接: https://www.cloudquery.club/download,可下载当前最新的社区版 V2.3.0.,(或直接点击文末阅读原文)适合在 RHEL/CentOS 等操作系统安装。
备注:由于我当时测试的时候 V2.3.0 还未发布,只进行了 V2.2.0 的安装,不过已经确认过,两个版本的安装操作相同,大家可放心参考。

点击“立即下载”,将软件下载到本地,下载后的软件名称为 cloudquery-club-V2.2.0.tar.gz 。
然后将下载的安装包上传到安装 CloudQuery 的服务器某个目录,我习惯放在 /root/soft 目录下。
“
安装 CloudQuery
安装 CloudQuery …
使用 root 用户安装 CloudQuery
解压 CloudQuery-club-V2.2.0.tar.gz,然后进行安装,操作如下:
--- 解压安装包[][]-- 执行安装[][]
完整安装结果如下,稍微有些长,为让大家看到整个安装过程,我把整个安装过程代码都附上,如下所示:
cloudquery-club-V2.2.0]# ./deploy.sh install: -- 此处可以直接按回车,默认安装在 /opt/cloudquery 目录realpath: ‘’: No such file or directorysetenforce: SELinux is disabled:/opt/cloudquery开始安装docker与docker-composesetenforce: SELinux is disabledCreatedsymlink from /etc/systemd/system/multi-user.target.wants/docker.service to /etc/systemd/system/docker.service.install success-----install success------is complete------开始加载docker镜像setenforce: SELinux is disabled开始加载base_support镜像Loadedimage: basejdkpython:8-jdk-slim-busterLoadedimage: base-redis:5.0.0Loadedimage: base-terminal:latestcb42413394c4: Loading layer [==================================================>] 72.51MB/72.51MB1c44f9d6c008: Loading layer [==================================================>] 9.079MB/9.079MBc9c81fb767cc: Loading layer [==================================================>] 3.584kB/3.584kBe339e3812d99: Loading layer [==================================================>] 127.2MB/127.2MB741b957481de: Loading layer [==================================================>] 340.5kB/340.5kB6db8ffdd7458: Loading layer [==================================================>] 12.49MB/12.49MB3da4783ff617: Loading layer [==================================================>] 36.54MB/36.54MB1b56d8f0f28d: Loading layer [==================================================>] 3.072kB/3.072kBLoadedimage: base-zookeeper:3.6.2b93c1bd012ab: Loading layer [==================================================>] 80.33MB/80.33MB680d4ad25629: Loading layer [==================================================>] 80.66MB/80.66MB7f7e8ccae681: Loading layer [==================================================>] 759.9MB/759.9MB5f9f0ed99f1d: Loading layer [==================================================>] 578.6kB/578.6kB06b4d412e3fe: Loading layer [==================================================>] 3.063MB/3.063MB7e7548a12c69: Loading layer [==================================================>] 1.536kB/1.536kB615b033a1040: Loading layer [==================================================>] 3.584kB/3.584kBdd007340d02c: Loading layer [==================================================>] 9.728kB/9.728kB5f70bf18a086: Loading layer [==================================================>] 1.024kB/1.024kBLoadedimage: clickhouse/clickhouse-server:23.3.2.37e8cf91efbcb0: Loading layer [==================================================>] 58.49MB/58.49MB00f438525221: Loading layer [==================================================>] 10.44MB/10.44MB53225373e343: Loading layer [==================================================>] 339.5kB/339.5kB4d5f0af8bd5c: Loading layer [==================================================>] 4.174MB/4.174MB7599efc97cb6: Loading layer [==================================================>] 17.1MB/17.1MBf7ee3866e7fe: Loading layer [==================================================>] 1.425MB/1.425MB717ce2a08388: Loading layer [==================================================>] 1.536kB/1.536kBcdaa32d2ec3d: Loading layer [==================================================>] 9.216kB/9.216kB535acdbb15a8: Loading layer [==================================================>] 197.7MB/197.7MB919e5a1fcb6c: Loading layer [==================================================>] 56.32kB/56.32kB52c5b1e57bcd: Loading layer [==================================================>] 2.048kB/2.048kB72434b8f5e29: Loading layer [==================================================>] 3.072kB/3.072kBf88c039d7fc6: Loading layer [==================================================>] 14.34kB/14.34kB73321121ac16: Loading layer [==================================================>] 1.536kB/1.536kBLoadedimage: postgres:11.8开始加载业务镜像Sendingbuild context to Docker daemon 144.1MBStep1/11 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/11 : MAINTAINER zhiyou "jian.huang@bintools.cn"Running in a26680e23237Removingintermediate container a26680e23237d33533b24031Step3/11 : WORKDIR /opt/cloudqueryRunning in 9f43335e0f92Removingintermediate container 9f43335e0f92a36c7d68ab49Step4/11 : ADD target/cloudquery-user*.jar ./cloudquery-user.jar7ce80605ccccStep5/11 : RUN mkdir config && mkdir -p /opt/cloudquery/dmc/modules && mkdir -p /opt/cloudquery/dmc/dms_homeRunning in e1c7dc094ef6Removingintermediate container e1c7dc094ef62fb90af3cc3aStep6/11 : ADD ignore/dmc/modules /opt/cloudquery/dmc/modules64f5755ab83eStep7/11 : COPY target/classes/application-prod.yml ./config/application.yml024bbe6c6901Step8/11 : ADD target/sjt_agent.jar ./sjt_agent.jara04332697017Step9/11 : EXPOSE 8002Running in fb0652633b36Removingintermediate container fb0652633b36b5acf1ea6ecbStep10/11 : EXPOSE 8802Running in bd5d1c34d64bRemovingintermediate container bd5d1c34d64bc4b7fa6fc7e4Step11/11 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=8802","-jar","cloudquery-user.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in d51313e590d3Removingintermediate container d51313e590d3bf2a930020f5Successfullybuilt bf2a930020f5Successfullytagged user:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 161MBStep1/11 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/11 : MAINTAINER lianjun "lianjun@bintools.cn"Running in 23fb56316bbfRemovingintermediate container 23fb56316bbfaa9481f7b501Step3/11 : WORKDIR /opt/cloudqueryRunning in 1de42dc9c07dRemovingintermediate container 1de42dc9c07db7dd7ddcd9a3Step4/11 : RUN mkdir -p /opt/cloudquery/dmc/modules && mkdir -p /opt/cloudquery/dmc/dms_home && mkdir configRunning in 9e3e6b4156ceRemovingintermediate container 9e3e6b4156ce8afc18cc3e3bStep5/11 : ADD ignore/dmc/modules /opt/cloudquery/dmc/modules3f534f93c81fStep6/11 : ADD target/cloudquery-data-dict*.jar ./cloudquery-data-dict.jar7396e1a1ee6dStep7/11 : COPY target/classes/application-prod.yml ./config/application.yml2b94014373beStep8/11 : ADD target/sjt_agent.jar ./sjt_agent.jarcbcc86c8943dStep9/11 : EXPOSE 9191Running in 33b7abe5fc19Removingintermediate container 33b7abe5fc19e90d22adf102Step10/11 : EXPOSE 9100Running in 0d4e999a0d06Removingintermediate container 0d4e999a0d06ff61a94e587bStep11/11 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=9100","-jar","cloudquery-data-dict.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in 47f3b9409cf4Removingintermediate container 47f3b9409cf4335f5fae4f74Successfullybuilt 335f5fae4f74Successfullytagged data-dict:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 158.3MBStep1/11 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/11 : MAINTAINER zhiyou "jian.huang@bintools.cn"Using cached33533b24031Step3/11 : WORKDIR /opt/cloudqueryUsing cachea36c7d68ab49Step4/11 : RUN mkdir -p /opt/cloudquery/dmc/modules && mkdir -p /opt/cloudquery/dmc/dms_home && mkdir configRunning in 17d4c5f7be69Removingintermediate container 17d4c5f7be69f9414ee93a6dStep5/11 : ADD ignore/dmc/modules /opt/cloudquery/dmc/modules931aea6894d9Step6/11 : ADD target/cloudquery-desens*.jar ./cloudquery-desens.jarca1bb6fd3e6dStep7/11 : COPY target/classes/application-prod.yml ./config/application.yml866c73123d19Step8/11 : ADD target/sjt_agent.jar ./sjt_agent.jarf63712fb10e2Step9/11 : EXPOSE 6202Running in defa7e77cf08Removingintermediate container defa7e77cf0810386a8c7eaeStep10/11 : EXPOSE 6203Running in 1d72029d8df3Removingintermediate container 1d72029d8df30b9517a32a3bStep11/11 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=6203","-jar","cloudquery-desens.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in a50584fed44fRemovingintermediate container a50584fed44f0c6285c465efSuccessfullybuilt 0c6285c465efSuccessfullytagged desens:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 528MBStep1/12 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/12 : MAINTAINER zhiyou "jian.huang@bintools.cn"Using cached33533b24031Step3/12 : WORKDIR /opt/cloudqueryUsing cachea36c7d68ab49Step4/12 : RUN mkdir -p /opt/cloudquery/dmc/modules && mkdir -p /opt/cloudquery/dmc/dms_home && mkdir configUsing cachef9414ee93a6dStep5/12 : ADD ignore/dmc/modules /opt/cloudquery/dmc/modulesb6145b227132Step6/12 : ADD src/main/resources/DataSourceStatement.stg /opt/cloudquery/dmc/modulese9ac4c90a5f1Step7/12 : ADD target/cloudquery-dms.jar ./cloudquery-dms.jarb591a32bcb13Step8/12 : ADD target/sjt_agent.jar ./sjt_agent.jarddac7fdd18ecStep9/12 : COPY target/classes/application-prod.yml ./config/application.yml83aa3f9a2058Step10/12 : EXPOSE 9001Running in 601925e4e89dRemovingintermediate container 601925e4e89d4f692cd59da7Step11/12 : EXPOSE 9802Running in 2a3eee066264Removingintermediate container 2a3eee066264db45a370b3c3Step12/12 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-jar","cloudquery-dms.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in a1cdfe8593f1Removingintermediate container a1cdfe8593f110490b0fb46dSuccessfullybuilt 10490b0fb46dSuccessfullytagged dms:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 386.1MBStep1/11 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/11 : MAINTAINER zhiyou "jian.huang@bintools.cn"Using cached33533b24031Step3/11 : WORKDIR /opt/cloudqueryUsing cachea36c7d68ab49Step4/11 : RUN mkdir -p /opt/cloudquery/dmc/modules && mkdir -p /opt/cloudquery/dmc/dms_home && mkdir configUsing cachef9414ee93a6dStep5/11 : ADD ignore/dmc/modules /opt/cloudquery/dmc/modulesc546352c13efStep6/11 : ADD target/cloudquery-export*.jar ./cloudquery-export.jar619df2c5cfe8Step7/11 : COPY target/classes/application-prod.yml ./config/application.ymla08981a20c41Step8/11 : ADD target/sjt_agent.jar ./sjt_agent.jar2cf3b93bad45Step9/11 : EXPOSE 9001Running in d66a72bc0bc8Removingintermediate container d66a72bc0bc8dbd312de5ef8Step10/11 : EXPOSE 9803Running in d48a09fc5521Removingintermediate container d48a09fc55217db16d4b5a28Step11/11 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=9803","-jar","cloudquery-export.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in 5d55134339fcRemovingintermediate container 5d55134339fc6a7df0842d60Successfullybuilt 6a7df0842d60Successfullytagged export:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 121.8MBStep1/10 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/10 : MAINTAINER zhiyou "qipeng.lu@bintools.cn"Running in 7d682f308838Removingintermediate container 7d682f3088386d449362ae74Step3/10 : WORKDIR /opt/cloudqueryRunning in 340ab95b7dd5Removingintermediate container 340ab95b7dd5d06ee0715f23Step4/10 : ADD target/cloudquery-flow*.jar ./cloudquery-flow.jarf950a7a25d5fStep5/10 : RUN mkdir configRunning in d640caa4c469Removingintermediate container d640caa4c469bac2e203c398Step6/10 : COPY target/classes/application-prod.yml ./config/application.yml67537c5abd07Step7/10 : ADD target/sjt_agent.jar ./sjt_agent.jar7a09048f8ee5Step8/10 : EXPOSE 9876Running in cc25a20eca44Removingintermediate container cc25a20eca4409e54c1ba1d7Step9/10 : EXPOSE 9877Running in 738d017bd0e2Removingintermediate container 738d017bd0e2aca0e0a98d68Step10/10 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=9877","-jar","cloudquery-flow.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in 61bf43525a06Removingintermediate container 61bf43525a067c4d91244fe7Successfullybuilt 7c4d91244fe7Successfullytagged flow:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 116.1MBStep1/11 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/11 : MAINTAINER zhiyou "jian.huang@bintools.cn"Using cached33533b24031Step3/11 : WORKDIR /opt/cloudqueryUsing cachea36c7d68ab49Step4/11 : ADD target/cloudquery-message*.jar ./cloudquery-message.jar26170fd14fa8Step5/11 : RUN mkdir configRunning in 3a8c7b9a2443Removingintermediate container 3a8c7b9a244371c56c427e27Step6/11 : COPY target/classes/application-prod.yml ./config/application.ymlc9b4916ea0ccStep7/11 : ADD target/sjt_agent.jar ./sjt_agent.jar39529834997eStep8/11 : EXPOSE 8899Running in 2cef156e6fa7Removingintermediate container 2cef156e6fa761afeb9cc053Step9/11 : EXPOSE 8892Running in b4d4410b5c74Removingintermediate container b4d4410b5c74e4ce66cdeb1fStep10/11 : EXPOSE 7090Running in 31e541a6134cRemovingintermediate container 31e541a6134cf1081157a8f6Step11/11 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=8892","-jar","cloudquery-message.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in 86ae64218e85Removingintermediate container 86ae64218e85cecf9f36db5dSuccessfullybuilt cecf9f36db5dSuccessfullytagged message:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 113MBStep1/10 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/10 : MAINTAINER zhiyou "qipeng.lu@bintools.cn"Using cache6d449362ae74Step3/10 : WORKDIR /opt/cloudqueryUsing cached06ee0715f23Step4/10 : ADD target/cloudquery-gateway*.jar ./cloudquery-gateway.jarba68324cc4d6Step5/10 : RUN mkdir configRunning in 22222ec884d9Removingintermediate container 22222ec884d9845c80c3fa4fStep6/10 : COPY target/classes/application-prod.yml ./config/application.yml67d133819769Step7/10 : ADD target/sjt_agent.jar ./sjt_agent.jarf282c4b50759Step8/10 : EXPOSE 8888Running in e8e361bf6b84Removingintermediate container e8e361bf6b84ba7c8abbced9Step9/10 : EXPOSE 8889Running in 1ff9e0083d20Removingintermediate container 1ff9e0083d2067d08e686955Step10/10 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=8889","-jar","cloudquery-gateway.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in 0f468e451704Removingintermediate container 0f468e451704f7a9a73d3f9eSuccessfullybuilt f7a9a73d3f9eSuccessfullytagged gateway:cloudquery-club-V2.2.0Sendingbuild context to Docker daemon 93.54MBStep1/9 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/9 : MAINTAINER zhiyou "jian.huang@bintools.cn"Using cached33533b24031Step3/9 : WORKDIR /opt/cloudqueryUsing cachea36c7d68ab49Step4/9 : ADD target/cloudquery-debug*.jar ./cloudquery-debug.jarfa561413a862Step5/9 : COPY target/classes/application.yml ./config/application.yml2afd7b4f0352Step6/9 : ADD target/sjt_agent.jar ./sjt_agent.jar8c53b271460fStep7/9 : EXPOSE 8899Running in 7a0294d3dfd0Removingintermediate container 7a0294d3dfd0119203055625Step8/9 : EXPOSE 8890Running in 44d30edea545Removingintermediate container 44d30edea545d2a9cb49d292Step9/9 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-Xdebug","-Xrunjdwp:transport=dt_socket,suspend=n,server=y,address=8890","-jar","cloudquery-debug.jar","--spring.config.location=/opt/cloudquery/config/application.yml"]Running in 54b5edfa62fcRemovingintermediate container 54b5edfa62fcc9b39ecfb814Successfullybuilt c9b39ecfb814Successfullytagged debug:cloudquery-club-V2.2.0unableto prepare context: path "./CloudQuery/audit-etl" not foundunableto prepare context: path "./CloudQuery/audit-display" not foundSendingbuild context to Docker daemon 140.7MBStep1/13 : FROM basejdkpython:8-jdk-slim-buster AS buildered637a4763c8Step2/13 : MAINTAINER zhiyou "yaolei.chen@bintools.cn"Running in 11ff1a1b1c67Removingintermediate container 11ff1a1b1c67e88f813b16dfStep3/13 : WORKDIR /opt/cloudqueryRunning in 9f2a054b8c6eRemovingintermediate container 9f2a054b8c6e599c6759f30bStep4/13 : ADD target/cloudquery-analyze*.jar ./cloudquery-analyze.jarf233c62166b2Step5/13 : RUN mkdir configRunning in 9296f1ce7aecRemovingintermediate container 9296f1ce7aece4789694c8e5Step6/13 : RUN mkdir script-pathRunning in 1aff06afc22aRemovingintermediate container 1aff06afc22ac4e8c16bc1c0Step7/13 : COPY target/classes/application-prod.yml ./config/application.yml45eb3f2c0acfStep8/13 : COPY target/classes/sql.properties ./config/sql.properties72abb64ac241Step9/13 : COPY target/classes/spring-context.xml ./config/spring-context.xml6ad9b295277aStep10/13 : COPY target/classes/script-path ./script-path9d638d4fed78Step11/13 : ADD target/sjt_agent.jar ./sjt_agent.jar36c2f83b8c95Step12/13 : EXPOSE 9007Running in b4b5d7c648e8Removingintermediate container b4b5d7c648e89a5ee9b6be9dStep13/13 : ENTRYPOINT ["java","-javaagent:/opt/cloudquery/sjt_agent.jar","-jar","cloudquery-analyze.jar","--spring.config.location=file:/opt/cloudquery/config/application.yml"]Running in 7e5695e3dc82Removingintermediate container 7e5695e3dc8245be2be0d08bSuccessfullybuilt 45be2be0d08bSuccessfullytagged analyze:cloudquery-club-V2.2.043b3c4e3001c: Loading layer [==================================================>] 83.87MB/83.87MB3a8f99f3bd90: Loading layer [==================================================>] 62.03MB/62.03MB9f803fac20f7: Loading layer [==================================================>] 3.072kB/3.072kB42e6e8955651: Loading layer [==================================================>] 4.096kB/4.096kB35f05d5547f4: Loading layer [==================================================>] 3.584kB/3.584kBe36a14968fa3: Loading layer [==================================================>] 7.168kB/7.168kBb823f0fa5eab: Loading layer [==================================================>] 76.6MB/76.6MBLoadedimage: base-web:cloudquery-club-V2.2.0生成cloudquery运行目录WARNING: bridge-nf-call-iptables is disabledWARNING: bridge-nf-call-ip6tables is disabledWARNING: bridge-nf-call-iptables is disabledWARNING: bridge-nf-call-ip6tables is disabledCreatingnetwork "resource_cloudquerynet" with driver "bridge"Creatingcloudquery-postgreSQL ... doneCreatingcloudquery-clickhouse ... doneCreatingcloudquery-redis ... doneCreatingcloudquery-zookeeper ... done开始初始化postgreSQL数据...正在初始化postgreSQL数据....初始化postgreSQL数据完成...Creatingcloudquery-desens ... doneis up-to-dateCreatingcloudquery-dms ... doneCreatingcloudquery-message ... doneCreatingcloudquery-gateway ... doneCreatingcloudquery-flow ... doneCreatingcloudquery-debug ... doneCreatingcloudquery-user ... doneCreatingcloudquery-analyze ... doneCreatingcloudquery-terminal ... doneCreatingcloudquery-export ... doneCreatingenterprise_web ... done启动
查看进程 …
可通过如下两种方式查看进程:
-- 通过docker命令查看[]CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES68618d8a2b01 base-web:cloudquery-club-V2.2.0"/docker-entrypoint.…"56 minutes ago Up 56 minutes 80/tcp, 0.0.0.0:80->9898/tcp, 0.0.0.0:81->9999/tcp enterprise_web3e4b39f8294b debug:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 8890/tcp, 8899/tcp cloudquery-debuge8ee86fc4533 dms:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9001/tcp, 9802/tcp cloudquery-dms5f1b1c152b52 user:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 8002/tcp, 8802/tcp cloudquery-userb3eff991fc2e desens:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 6202-6203/tcp cloudquery-desens3a849cda4bb7 export:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9001/tcp, 9803/tcp cloudquery-export046eeb0f23a6 flow:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9876-9877/tcp cloudquery-flow20e33e8f123b gateway:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 8888-8889/tcp cloudquery-gatewayfefd276df63a base-terminal:latest "/opt/cloudquery/ter…"56 minutes ago Up 56 minutes 9950/tcp cloudquery-terminal7366934b8802 analyze:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9007/tcp cloudquery-analyze4c396281a6a1 message:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 7090/tcp, 8892/tcp, 8899/tcp cloudquery-messagea3f3edd22d74 base-redis:5.0.0"docker-entrypoint.s…"2 hours ago Up 58 minutes 6379/tcp cloudquery-redisdabcf1209ac1 base-zookeeper:3.6.2"/docker-entrypoint.…"2 hours ago Up 58 minutes 2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp, 8080/tcp cloudquery-zookeeper20639899b5a0 clickhouse/clickhouse-server:23.3.2.37"/entrypoint.sh"2 hours ago Up 58 minutes 9000/tcp, 0.0.0.0:8123->8123/tcp, 9009/tcp cloudquery-clickhousebcc95d1519df postgres:11.8"docker-entrypoint.s…"2 hours ago Up 58 minutes 0.0.0.0:5432->5432/tcp cloudquery-postgreSQL[][]CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES68618d8a2b01 base-web:cloudquery-club-V2.2.0"/docker-entrypoint.…"56 minutes ago Up 56 minutes 80/tcp, 0.0.0.0:80->9898/tcp, 0.0.0.0:81->9999/tcp enterprise_web3e4b39f8294b debug:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 8890/tcp, 8899/tcp cloudquery-debuge8ee86fc4533 dms:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9001/tcp, 9802/tcp cloudquery-dms5f1b1c152b52 user:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 8002/tcp, 8802/tcp cloudquery-userb3eff991fc2e desens:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 6202-6203/tcp cloudquery-desens3a849cda4bb7 export:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9001/tcp, 9803/tcp cloudquery-export046eeb0f23a6 flow:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9876-9877/tcp cloudquery-flow20e33e8f123b gateway:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 8888-8889/tcp cloudquery-gatewayfefd276df63a base-terminal:latest "/opt/cloudquery/ter…"56 minutes ago Up 56 minutes 9950/tcp cloudquery-terminal7366934b8802 analyze:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 9007/tcp cloudquery-analyze4c396281a6a1 message:cloudquery-club-V2.2.0"java -javaagent:/op…"56 minutes ago Up 56 minutes 7090/tcp, 8892/tcp, 8899/tcp cloudquery-messagea3f3edd22d74 base-redis:5.0.0"docker-entrypoint.s…"2 hours ago Up 58 minutes 6379/tcp cloudquery-redisdabcf1209ac1 base-zookeeper:3.6.2"/docker-entrypoint.…"2 hours ago Up 58 minutes 2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp, 8080/tcp cloudquery-zookeeper20639899b5a0 clickhouse/clickhouse-server:23.3.2.37"/entrypoint.sh"2 hours ago Up 58 minutes 9000/tcp, 0.0.0.0:8123->8123/tcp, 9009/tcp cloudquery-clickhousebcc95d1519df postgres:11.8 "docker-entrypoint.s…" 2 hours ago Up 58 minutes 0.0.0.0:5432->5432/tcp cloudquery-postgreSQL

还可以使用 cloudquery.sh 脚本来查看,如下所示:
-- root用户[root-node2 ~]# cd /cloudquery/[root-node2 cloudquery]# ./cloudquery.sh statusName Command State Ports---------------------------------------------------------------------------------------------------------------------cloudquery-clickhouse /entrypoint.sh Up 0.0.0.0:8123->8123/tcp, 9000/tcp, 9009/tcpcloudquery-postgreSQL docker-entrypoint.sh postgres Up 0.0.0.0:5432->5432/tcpcloudquery-redis docker-entrypoint.sh redis ... Up 6379/tcpcloudquery-zookeeper /docker-entrypoint.sh zkSe ... Up 0.0.0.0:2181->2181/tcp, 2888/tcp, 3888/tcp, 8080/tcpName Command State Ports-------------------------------------------------------------------------------------------cloudquery-analyze java -javaagent:/opt/cloud ... Up 9007/tcpcloudquery-debug java -javaagent:/opt/cloud ... Up 8890/tcp, 8899/tcpcloudquery-desens java -javaagent:/opt/cloud ... Up 6202/tcp, 6203/tcpcloudquery-dms java -javaagent:/opt/cloud ... Up 9001/tcp, 9802/tcpcloudquery-export java -javaagent:/opt/cloud ... Up 9001/tcp, 9803/tcpcloudquery-flow java -javaagent:/opt/cloud ... Up 9876/tcp, 9877/tcpcloudquery-gateway java -javaagent:/opt/cloud ... Up 8888/tcp, 8889/tcpcloudquery-message java -javaagent:/opt/cloud ... Up 7090/tcp, 8892/tcp, 8899/tcpcloudquery-terminal /opt/cloudquery/terminal - ... Up 9950/tcpcloudquery-user java -javaagent:/opt/cloud ... Up 8002/tcp, 8802/tcpName Command State Ports------------------------------------------------------------------------------------------------------------enterprise_web /docker-entrypoint.sh ngin ... Up 80/tcp, 0.0.0.0:80->9898/tcp, 0.0.0.0:81->9999/tcp状态

启停 CloudQuery …
可以使用如下方式启停 CloudQuery:
-- root用户[root@xsky-node2 cloudquery]# ./cloudquery.sh stopStopping enterprise_web ... doneRemoving enterprise_web ... doneNetwork resource_cloudquerynet is external, skippingStopping cloudquery-terminal ... doneStopping cloudquery-export ... doneStopping cloudquery-analyze ... doneStopping cloudquery-user ... doneStopping cloudquery-message ... doneStopping cloudquery-debug ... doneStopping cloudquery-flow ... doneStopping cloudquery-gateway ... doneStopping cloudquery-dms ... doneStopping cloudquery-desens ... doneRemoving cloudquery-terminal ... doneRemoving cloudquery-export ... doneRemoving cloudquery-analyze ... doneRemoving cloudquery-user ... doneRemoving cloudquery-message ... doneRemoving cloudquery-debug ... doneRemoving cloudquery-flow ... doneRemoving cloudquery-gateway ... doneRemoving cloudquery-dms ... doneRemoving cloudquery-desens ... doneNetwork resource_cloudquerynet is external, skipping停止除resource之外的服务[root@xsky-node2 cloudquery]#[root@xsky-node2 cloudquery]# ./cloudquery.sh startcloudquery-clickhouse is up-to-datecloudquery-zookeeper is up-to-datecloudquery-postgreSQL is up-to-datecloudquery-redis is up-to-date等待postgreSQL数据库启动...postgreSQL数据库启动完成...Creating cloudquery-message ... doneCreating cloudquery-analyze ... doneCreating cloudquery-flow ... doneCreating cloudquery-export ... doneCreating cloudquery-gateway ... doneCreating cloudquery-dms ... doneCreating cloudquery-terminal ... doneCreating cloudquery-debug ... doneCreating cloudquery-desens ... doneCreating cloudquery-user ... doneCreating enterprise_web ... done启动

排查日志 …
可以通过如下方法来查看应用相关日志:
[]
“
登录 CloudQuery
CloudQuery 安装部署后,默认使用80端口,可通过http://IP:端口(默认 80)进行页面登录。
使用如下默认账号和密码登录控制台。
默认帐号: admin001
默认密码: Hello123$

登录后的控制台主界面如下:

“
附录
安装部署过程中,可能会遇到如下问题:
服务器上原已安装 redis …
我初次安装时其中一台服务器出现了如下报错。
ERROR: for redis Cannot start service redis: driver failed programming external connectivity on endpoint cloudquery-redis (c9d193b21566f6174e7328a8b214b37e0df0e86088f9057f1aab441aa0f5ab17): Errorstarting userland proxy: listen tcp 0.0.0.0:6379: bind: address already inuseERROR: Encountered errors while bringing up the project.
CloudQuery 内部通讯需要使用 Redis,如果已安装了 Redis,会因端口导致冲突,为此,可通过如下方式进行调整:
# cd /cloudquery/resource/--修改 docker-compose.yml 文件-- 注释 redis的端口,如下所示

然后通过:cloudquery.sh stop/start 启停服务。
Docker 版本过低 …
如果安装 CloudQuery 的服务器已安装了 Docker,但版本过低,会导致安装失败,如下所所示。
[root@xsky-node2 cloudquery-club-V2.2.0]# ./deploy.sh install请输入cloudQuery安装绝对路径(默认为/opt/cloudquery):/opt/cloudquerysetenforce: SELinux is disabled输入路径为无效文件夹,使用默认路径:/opt/cloudquerydocker 已安装docker版本小于19,无法运行cloudQuery。请安装新版本docker与docker-compose。[root@xsky-node2 cloudquery-club-V2.2.0]# docker --versionDocker version 18.09.9, build 039a7df9ba

安装新版CloudQuery V2 要求Docker 版本不能低于 19.03.12,如果服务器未安装Docker,安装CloudQuery后安装的Docker版本是19.03.12。
此时可有两种解决办法:
一是升级 Docker 版本,二是完全卸载当前 Docker,使用软件自动安装的 Docker。
服务器未安装 docker-compose …
如果服务器安装了 Docker,且版本不低于 CloudQuery 要求的版本,但未安装 docker-compose,也会导致安装失败。
此时可以采用完全卸载服务器上的 Docker,或者单独安装 docker-compose 至合适版本,然后重新执行 deploy.sh 进行软件安装。
软件安装后无法页面登录 …
有时会遇到软件安装后,进程也都正常,但使用http://IP:端口 却无法访问:

此时通过 netstat -ano|grep 80 看到 80 端口未被监听。

通过 telnet IP:80 也无法登录。
此时可通过如下方法解决:
1) 编辑 /etc/sysconfig/network 文件
修改 NETWORKING_IPV6=no
2) 编辑 /etc/default/grub 文件, 在GRUB_CMDLINE_LINUX=“添加ipv6.disable=1 后面保存不变”,如下所示:
[root@xsky-node2 ~]# cat /etc/default/grubGRUB_TIMEOUT=5GRUB_DISTRIBUTOR="$(sed 's, release .*$,,g' /etc/system-release)"GRUB_DEFAULT=savedGRUB_DISABLE_SUBMENU=trueGRUB_TERMINAL_OUTPUT="console"GRUB_CMDLINE_LINUX="ipv6.disable=1 crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet transparent_hugepage=never"GRUB_DISABLE_RECOVERY="true"
3) 重启网卡和服务器
service network restartshutdown -r 0
如上操作后,正常情况可打开控制台页面。
文章待续......本周持续更新《我和 CQ 的故事(中)CloudQuery 数据连接查询使用》
作者墨天轮博客 ID :尚雷
