在虚拟机中使用maven编译signal server项目记录

前言

  1. 安装好 mvn
  2. Ubuntu 16.04

JDK

我是从 oracle jdk 11 lts download 网站,复制jdk-11.0.4_linux-x64_bin.tar.gz的链接

1
2
3
wget https://blog.forsre.com/java/jdk-11.0.4_linux-x64_bin.tar.gz
sudo mkdir /usr/lib/jvm
sudo tar zxvf ./jdk-11.0.4_linux-x64_bin.tar.gz -C /usr/lib/jvm

配置环境变量

1
vim ~/.bashrc

添加

1
2
export JAVA_HOME=/usr/lib/jvm/java-11-oracle
export PATH=${JAVA_HOME}/bin:$PATH
1
2
source ~/.bashrc
java -version

install redis-server

1
sudo apt-get install -y redis-server

启动redis

1
sudo systemctl start redis-server

install postgresql database

1
sudo apt-get install postgresql postgresql-contrib -y

Create postgres root user:

1
2
3
4
5
6
7
8
9
10
sudo -i -u postgres
createdb accountdb
createdb messagedb

createuser --interactive
# Enter name of role to add: Signal
psql
ALTER USER "Signal" WITH PASSWORD 'thepassword';
#quit
\q

让远程可以访问到 postgresql database的5432端口,

编辑/etc/postgresql/10*/main/postgresql.conf 文件

修改

1
listen_addresses='localhost'

改为

1
listen_addresses='*'

编辑/etc/postgresql/10*/main/pg_hba.conf

在文件末尾添加

1
host all all * md5

最后重启电脑或者重启你的DBMS

1
sudo invoke-rc.d postgresql restart

maven 安装

使用浏览器进入http://maven.apache.org/download.cgi 页面,

  1. 在文件(Files)的列表中Link列,找到 类似apache-maven-3.6.2-bin.zip的链接
  2. 右键,选择"复制链接地址",切换到Linux 终端 运行wget http://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.6.2/binaries/apache-maven-3.6.2-bin.zip 命令下载
  3. 解压 unzip apache-maven-3.6.2-bin.zip
  4. 移动文件
1
2
3
4
5
6
mkdir ~/env
cp -Rf apache-maven-3.6.2 ~/env/maven
cd ~/env/maven
# 输出当前完整的路径
wa@wa-VirtualBox:~/env/maven$ pwd
/home/wa/env/maven
  1. 设置环境变量 ,编辑 /etc/profile
1
sudo vim /etc/profile

在文件末尾添加

1
2
3
4
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export MAVEN_HOME=/home/wa/env/maven
export M2_HOME=/home/wa/env/maven
export PATH=${JAVA_HOME}/bin:${M2_HOME}/bin:${PATH}

重启电脑或者重新加载 /etc/profile的配置

1
source /etc/profile
1
2
3
4
5
6
7
8
9
10
wa@wa-VirtualBox:~/env/maven$ source --help
source: source 文件名 [参数]
在当前 shell 中执行一个文件中的命令。

在当前 shell 中读取并执行 FILENAME 文件中的命令。$PATH 变量中的
条目被用于寻找包含 FILENAME 文件的目录。如果提供了任何的 ARGUMENTS
参数,则它们将成为 FILENAME 文件执行时的位置参数。

退出状态:
返回 FILENAME 文件中最后一个命令的状态;如果 FILENAME 文件不可读则失败。

添加多一个文件apache-maven.sh,用于编译时使用

1
vim /etc/profile.d/apache-maven.sh

内容为:

1
2
3
4
export JAVA_HOME=/usr/lib/jvm/java-11-oracle
export MAVEN_HOME=/home/waka/env/maven
export M2_HOME=/home/waka/env/maven
export PATH=${JAVA_HOME}/bin:${M2_HOME}/bin:${PATH}

验证 maven 配置成功

1
2
3
4
5
6
wa@wa-VirtualBox:~/env/maven$ mvn -v
Apache Maven 3.6.2 (40f52333136460af0dc0d7232c0dc0bcf0d9e117; 2019-08-27T23:06:16+08:00)
Maven home: /home/wa/env/maven
Java version: 11.0.4, vendor: Ubuntu, runtime: /usr/lib/jvm/java-11-openjdk-amd64
Default locale: zh_CN, platform encoding: UTF-8
OS name: "linux", version: "4.15.0-64-generic", arch: "amd64", family: "unix"

设置 maven 阿里云镜像

编辑 maven 安装目录下的conf/settings.xml(或者当前用户目录 的 .m2 目录下的 setting.xml 文件)

mirrors节点中 添加

1
2
3
4
5
6
<mirror>
<id>alimaven</id>
<name>aliyun maven</name>
<url>http://maven.aliyun.com/nexus/content/groups/public/</url>
<mirrorOf>central</mirrorOf>
</mirror>

上面的准备的运行条件已准备好

这个主服务器的源码可以在https://github.com/signalapp/Signal-Server 找到

开始之前,先将源码拷贝到本地

1
git clone https://github.com/signalapp/Signal-Server

进入项目文件夹:

1
cd Signal-server

编译主要的服务器jar

1
2
# mvn install -DskipTests
source /etc/profile.d/apache-maven.sh && mvn install -DskipTests

运行最后会出现:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/waka/Signal-Server/service/target/TextSecureServer-2.55.jar with /home/waka/Signal-Server/service/target/service-2.55-shaded.jar
[INFO]
[INFO] --- maven-assembly-plugin:2.4:single (make-assembly) @ service ---
[INFO] Reading assembly descriptor: assembly.xml
[INFO] Building tar: /home/waka/Signal-Server/service/target/TextSecureServer-2.55-bin.tar.gz
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ service ---
[INFO] Installing /home/waka/Signal-Server/service/target/TextSecureServer-2.55.jar to /home/waka/.m2/repository/org/whispersystems/textsecure/service/2.55/service-2.55.jar
[INFO] Installing /home/waka/Signal-Server/service/dependency-reduced-pom.xml to /home/waka/.m2/repository/org/whispersystems/textsecure/service/2.55/service-2.55.pom
[INFO] Installing /home/waka/Signal-Server/service/target/TextSecureServer-2.55-bin.tar.gz to /home/waka/.m2/repository/org/whispersystems/textsecure/service/2.55/service-2.55-bin.tar.gz
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] TextSecureServer 1.0 ............................... SUCCESS [ 0.598 s]
[INFO] redis-dispatch 2.55 ................................ SUCCESS [ 3.041 s]
[INFO] websocket-resources 2.55 ........................... SUCCESS [ 0.370 s]
[INFO] service 2.55 ....................................... SUCCESS [ 56.760 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:01 min
[INFO] Finished at: 2019-10-14T16:23:22+08:00
[INFO] ------------------------------------------------------------------------

minio

1
2
3
4
5
6
7
sudo docker pull minio/minio

sudo docker run -p 9000:9000 --name minio1 \
-e "MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" \
-e "MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" \
-v /mnt/data:/data \
minio/minio server /data/minio

迁移数据:

1
2
3
4
java -jar service/target/TextSecureServer-2.55.jar  messagedb migrate service/config/Signal.yml
java -jar service/target/TextSecureServer-2.55.jar accountdb migrate service/config/Signal.yml

java -jar websocket-resources/target/websocket-resources-2.55.jar

一直出现以下问题:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
java.io.IOException: Bad Base64 input character '-' in array position 0
at org.whispersystems.textsecuregcm.util.Base64.decode(Base64.java:1221)
at org.whispersystems.textsecuregcm.util.Base64.decode(Base64.java:1287)
at org.whispersystems.textsecuregcm.util.Base64.decode(Base64.java:1244)
at org.whispersystems.textsecuregcm.util.Base64.decodeWithoutPadding(Base64.java:1255)
at org.whispersystems.textsecuregcm.util.ByteArrayAdapter$Deserializing.deserialize(ByteArrayAdapter.java:46)
at org.whispersystems.textsecuregcm.util.ByteArrayAdapter$Deserializing.deserialize(ByteArrayAdapter.java:41)
at com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:136)
at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:252)
at com.fasterxml.jackson.module.afterburner.deser.SuperSonicBeanDeserializer.deserialize(SuperSonicBeanDeserializer.java:155)
at com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:136)
at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:252)
at com.fasterxml.jackson.module.afterburner.deser.SuperSonicBeanDeserializer.deserialize(SuperSonicBeanDeserializer.java:155)
at com.fasterxml.jackson.databind.ObjectMapper._readValue(ObjectMapper.java:3984)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2276)
at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:127)
at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:89)
at io.dropwizard.cli.ConfiguredCommand.parseConfiguration(ConfiguredCommand.java:126)
at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:74)
at io.dropwizard.cli.Cli.run(Cli.java:78)
at io.dropwizard.Application.run(Application.java:93)
at org.whispersystems.textsecuregcm.WhisperServerService.main(WhisperServerService.java:296)

启动服务:

1
java -jar service/target/TextSecureServer-2.55.jar  server service/config/Signal.yml

生成证书


1
2
openssl genrsa -aes128 -out fd.key 2048
openssl rsa -in fd.key -pubout -out fd-public.key

我的Signal.yml 文件内容:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
twilio: # Twilio gateway configuration
accountId: ddd #fake
accountToken: aaa #fake
numbers: # Numbers allocated in Twilio
- "+121020222" #fake
messagingServicesId:
localDomain: # Domain Twilio can connect back to for calls. Should be domain of your service.

push:
queueSize: 200 # Size of push pending queue

#redphone:
# authKey: 12312321 # Deprecated

turn: # TURN server configuration
secret: 121654fjdfgdyesdfgfhgh # TURN server secret
uris:
- stun:yourdomain:80
- stun:yourdomain.com:443
- turn:yourdomain:443?transport=udp
- turn:etc.com:80?transport=udp

cache: # Redis server configuration for cache cluster
url: "redis://127.0.0.1:6379/1"
replicaUrls:
- "redis://redit:6379/2"

directory:
redis: # Redis server configuration for directory cluster
url: "redis://redit:6379/3"
replicaUrls:
- "redis://redit:6379/4"
client: # Configuration for interfacing with Contact Discovery Service cluster
userAuthenticationTokenSharedSecret: test # hex-encoded secret shared with CDS used to generate auth tokens for Signal users
userAuthenticationTokenUserIdSecret: test# hex-encoded secret shared among Signal-Servers to obscure user phone numbers from CDS
sqs:
accessKey: AKIAIOSFODNN7EXAMPLE # AWS SQS accessKey
accessSecret: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY # AWS SQS accessSecret
queueUrl: sqs://127.0.0.1 # AWS SQS queue url
server:
replicationUrl: http://127.0.0.2 # CDS replication endpoint base url
replicationPassword: 12321312 # CDS replication endpoint password
replicationCaCertificate: 5656 # CDS replication endpoint TLS certificate trust root

messageCache: # Redis server configuration for message store cache
redis:
url: "redis://127.0.0.1:6379/5"
replicaUrls:
- "redis://127.0.0.1:6379/6"

messageStore: # Postgresql database configuration for message store
driverClass: org.postgresql.Driver
user: Signal
password: Signal!!
url: "jdbc:postgresql://127.0.0.1:5432/messagedb"

attachments: # AWS S3 configuration
accessKey: AKIAIOSFODNN7EXAMPLE
accessSecret: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
bucket: signal
region: us-east-1

profiles: # AWS S3 configuration
accessKey: AKIAIOSFODNN7EXAMPLE
accessSecret: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
bucket: profile
region: us-east-1

database: # Postgresql database configuration
driverClass: org.postgresql.Driver
user: Signal
password: Signal!!
url: "jdbc:postgresql://127.0.0.1:5432/accountdb"
properties:
charSet: UTF-8

apn: # Apple Push Notifications configuration
bundleId: 1312312
pushCertificate: 31231
pushKey: 12321321

gcm: # GCM Configuration
senderId: 412918270132 #fake
apiKey: AIzaSyC8gPzceq2SPebZZWaD3I9OeqePyD9CUqk #fake

accountDatabaseCrawler:
chunkSize: 100
chunkIntervalMs: 8000

recaptcha:
secret: 666666

pushScheduler:
url: "redis://localhost:6379/7"
replicaUrls:
- "redis://localhost:6379/8"

后续:

  1. 了解到 twilio 好像不支持 给国内的手机发送SMS
  2. apn,gcm 的配置弄不到

最后放弃尝试了,好像配置文件Signal.yml改动了,都需要运行一次source /etc/profile.d/apache-maven.sh && mvn install -DskipTests


redis

1
mvn clean install -DskipTests

websocket

1
2
mvn clean install -DskipTests
mvn install:install-file -Dfile=./target/websocket-resources-2.55.jar -DgroupId=org.whispersystems -DartifactId=websocket-resources -Dversion=1.0 -Dpackaging=jar

命令草稿

1
2
3
4
5
6
7
8
9
10
sudo apt-get update
# install java
sudo apt-get install default-jdk
#删除为了满足其他软件包的依赖而安装的,但现在不再需要的软件包。
sudo apt autoremove
sudo apt-get install default-jre
java –version
sudo apt install openjdk-8-jdk
#如果需要使用其它jdk版本,可用这个进行切换
sudo update-alternatives --config java

在另外一台虚拟机Ubuntu 16.04,JDK 我切换到 oracle jdk11

1
2
3
4
5
6
7
8
9
10
# 卸载之前安装的jdk
sudo apt-get autoremove default-jdk
sudo apt-get autoremove default-jre
sudo apt-get autoremove openjdk-8-jdk

# 安装 jdk11
sudo add-apt-repository ppa:linuxuprising/java
sudo apt-get update
sudo apt-get install oracle-java11-installer-local #如果这一步遇到类似以下的问题,可以去其它网站下载响应的文件
sudo add-apt-repository -r ppa:linuxuprising/java

我是从 oracle jdk 11 lts download 网站,复制jdk-11.0.4_linux-x64_bin.tar.gz的链接

通过 ppa 网站 发现安装 java11,我在 10月25日尝试,发现版本由 java_11.0.4 改为 java_11.0.5,故安装失败了,我是直接解压 jdk的下载包,然后将 JAVA,Maven 配置到环境变量镜像进行使用的

命令:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
waka@ubuntus1:~/Signal-Server$ sudo apt-get remove oracle-java11-set-default-local
Reading package lists... Done
Building dependency tree
Reading state information... Done
Package 'oracle-java11-set-default-local' is not installed, so not removed
0 upgraded, 0 newly installed, 0 to remove and 133 not upgraded.
1 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Setting up oracle-java11-installer-local (11.0.4-1~linuxuprising1) ...
Before installing this package,
please download the Oracle JDK 11 .tar.gz file
with the same version as this package (version 11.0.4),
and place it in /var/cache/oracle-jdk11-installer-local,

E.g.:
sudo mkdir -p /var/cache/oracle-jdk11-installer-local
sudo cp jdk-11.0.4_linux-x64_bin.tar.gz /var/cache/oracle-jdk11-installer-local/
sha256sum mismatch jdk-11.0.4_linux-x64_bin.tar.gz
Oracle JDK 11 is NOT installed.
dpkg: error processing package oracle-java11-installer-local (--configure):
subprocess installed post-installation script returned error exit status 1
Errors were encountered while processing:
oracle-java11-installer-local
E: Sub-process /usr/bin/dpkg returned an error code (1)

如何 apt-get install 一直提示上面的错误信息,可以通过下面的命令进行卸载安装的oracle-java11-installer-local

1
sudo apt-get auto-remove oracle-java11-installer-local

安装jdk 11 命令:

1
2
3
4
5
cd /tmp
wget https://blog.forsre.com/java/jdk-11.0.4_linux-x64_bin.tar.gz
sudo mkdir -p /var/cache/oracle-jdk11-installer-local
sudo cp jdk-11.0.4_linux-x64_bin.tar.gz /var/cache/oracle-jdk11-installer-local/
sudo apt-get install oracle-java11-installer-local #进行安装

References

  1. Signal Server Installation Guide

  2. Oracle-Java8-Installer:没有安装候选者

  3. Ubuntu16.04 使用PPA安装JDK8

  4. Oracle-Java8-Installer: No installation candidate

  5. How to Install JAVA 8 on Ubuntu 18.04/16.04, Linux Mint 19/18

  6. apt-get指令的autoclean,clean,autoremove的区别

  7. maven更改镜像路径为阿里镜像,以便下载速度快

  8. SeksunNiampan/docker-Signal-Server 通过修改endpoint,可以使用MINIO这个服务

  9. MinIO Docker Quickstart Guide

  10. oracle jdk 11 lts download

  11. How to Install Oracle Java 11 in Ubuntu 18.04/18.10

  12. https学习笔记三----OpenSSL生成root CA及签发证书