RabbitMQ Cluster 2019(1)Cluster on 2 Nodes Version 3.7.15

RabbitMQ Cluster 2019(1)Cluster on 2 Nodes Version 3.7.15

Installation on Ubuntu
Download the Erlang source file
> wget http://erlang.org/download/otp_src_22.0.tar.gz

Unzip and prepare install
> tar zxvf otp_src_22.0.tar.gz
> export LANG=C

Run the configuration
> ./configure --prefix=/usr/erlang

Install the requirement again
> sudo apt-get install fop

Run config again
>./configure --prefix=/usr/erlang --without-wx

Add more dependencies
> sudo apt-get install automake autoconf libreadline-dev libncurses-dev
> sudo apt-get install libssl-dev libyaml-dev libxslt-dev libffi-dev libtool unixodbc-dev
> sudo apt-get install libwxgtk3.0-dev libgl1-mesa-dev  libglu1-mesa-dev libssh-dev xsltproc fop
> sudo apt-get install libxml2-utils

Config again with successful output
> ./configure --prefix=/usr/erlang
> make
> sudo make install

Link the bin to class path
> sudo ln -s /usr/erlang/bin/erl /usr/bin/erl

Verify the Erlang version
> erl -version
Erlang (SMP,ASYNC_THREADS,HIPE) (BEAM) emulator version 10.4

Find the latest version of rabbitMQ from here
https://www.rabbitmq.com/install-generic-unix.html
I get the file in the installation directory  rabbitmq-server-generic-unix-3.7.15.tar.xz

Unzip and install on my machine
> tar xvfJ rabbitmq-server-generic-unix-3.7.15.tar.xz
> mv rabbitmq_server-3.7.15 ~/tool/rabbitmq-3.7.15

Prepare the working directory
> sudo ln -s /home/carl/tool/rabbitmq-3.7.15 /opt/rabbitmq-3.7.15
> sudo ln -s /opt/rabbitmq-3.7.15 /opt/rabbitmq

Start the service on my ubuntu-master machine
> sudo sbin/rabbitmq-server

Check status
> sudo sbin/rabbitmqctl status

List users
> sudo sbin/rabbitmqctl list_users
Listing users ...
user tags
guest [administrator]

Add users
> sudo sbin/rabbitmqctl add_user carl test
> sudo sbin/rabbitmqctl set_user_tags carl administrator
Setting tags for user "carl" to [administrator] ...
> sudo sbin/rabbitmqctl set_permissions -p / carl ".*" ".*" ".*"
Setting permissions for user "carl" in vhost "/" ...

> sudo sbin/rabbitmqctl list_users
Listing users ...
user tags
carl [administrator]
guest [administrator]


Check the port numbers
> netstat -lntu
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State     
tcp        0      0 0.0.0.0:4369            0.0.0.0:*               LISTEN    
tcp        0      0 127.0.0.53:53           0.0.0.0:*               LISTEN    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN    
tcp        0      0 127.0.0.1:37795         0.0.0.0:*               LISTEN    
tcp        0      0 0.0.0.0:25672           0.0.0.0:*               LISTEN    
tcp        0      0 127.0.0.1:3306          0.0.0.0:*               LISTEN    
tcp6       0      0 :::4369                 :::*                    LISTEN    
tcp6       0      0 :::22                   :::*                    LISTEN    
tcp6       0      0 :::5672                 :::*                    LISTEN    
udp        0      0 127.0.0.53:53           0.0.0.0:*                         
udp        0      0 0.0.0.0:68              0.0.0.0:*   

It is said these ports are used
Default port is 5672
4369 Erlang clustering
5672 main port

Add to Path
export PATH="/opt/rabbitmq/sbin:$PATH"

> sudo chmod 777 ~/.erlang.cookie
> sudo chmod 400 ~/.erlang.cookie
> sudo chown -R carl ~/.erlang.cookie
> sudo chgrp -R carl ~/.erlang.cookie

Enable plugins
> sudo sbin/rabbitmq-plugins enable rabbitmq_management
Enabling plugins on node rabbit@ubuntu-master:
rabbitmq_management
The following plugins have been configured:
  rabbitmq_management
  rabbitmq_management_agent
  rabbitmq_web_dispatch
Applying plugin configuration to rabbit@ubuntu-master...
The following plugins have been enabled:
  rabbitmq_management
  rabbitmq_management_agent
  rabbitmq_web_dispatch
started 3 plugins.


Set Up Second Machine ubuntu-dev2
Add dependencies
> sudo apt-get install automake autoconf libreadline-dev libncurses-dev
> sudo apt-get install libssl-dev libyaml-dev libxslt-dev libffi-dev libtool unixodbc-dev
> sudo apt-get install libwxgtk3.0-dev libgl1-mesa-dev  libglu1-mesa-dev libssh-dev xsltproc fop
> sudo apt-get install libxml2-utils

Install erlang
Download the Erlang source file
> wget http://erlang.org/download/otp_src_22.0.tar.gz

Unzip and prepare install
> tar zxvf otp_src_22.0.tar.gz
> export LANG=C

Run the configuration
> ./configure --prefix=/usr/erlang
> make
> sudo make install

Link the bin to class path
> sudo ln -s /usr/erlang/bin/erl /usr/bin/erl

Verify the Erlang version
> erl -version
Erlang (SMP,ASYNC_THREADS,HIPE) (BEAM) emulator version 10.4

I get the file in the installation directory  rabbitmq-server-generic-unix-3.7.15.tar.xz

Unzip and install on my machine
> tar xvfJ rabbitmq-server-generic-unix-3.7.15.tar.xz
> mv rabbitmq_server-3.7.15 ~/tool/rabbitmq-3.7.15

Prepare the working directory
> sudo ln -s /home/carl/tool/rabbitmq-3.7.15 /opt/rabbitmq-3.7.15
> sudo ln -s /opt/rabbitmq-3.7.15 /opt/rabbitmq

Add to Path
export PATH="/opt/rabbitmq/sbin:$PATH"

Start the service once to generate the cookie
> sudo sbin/rabbitmq-server

> sudo chmod 777 ~/.erlang.cookie
> sudo chmod 400 ~/.erlang.cookie
> sudo chown -R carl ~/.erlang.cookie
> sudo chgrp -R carl ~/.erlang.cookie

Enable plugins
> sudo sbin/rabbitmq-plugins enable rabbitmq_management
Enabling plugins on node rabbit@ubuntu-master:
rabbitmq_management
The following plugins have been configured:
  rabbitmq_management
  rabbitmq_management_agent
  rabbitmq_web_dispatch
Applying plugin configuration to rabbit@ubuntu-master...
The following plugins have been enabled:
  rabbitmq_management
  rabbitmq_management_agent
  rabbitmq_web_dispatch
started 3 plugins.

Start on the ubuntu-master and ubuntu-dev2 machines
> sudo RABBITMQ_NODE_PORT=5672 RABBITMQ_SERVER_START_ARGS="-rabbitmq_management listener [{port,15672}]" RABBITMQ_NODENAME=rabbit1 sbin/rabbitmq-server -detached

> sudo RABBITMQ_NODE_PORT=5672 RABBITMQ_SERVER_START_ARGS="-rabbitmq_management listener [{port,15672}]" RABBITMQ_NODENAME=rabbit2 sbin/rabbitmq-server -detached

Check status on these machines
> rabbitmqctl -n rabbit1 cluster_status
Cluster status of node rabbit1@ubuntu-master ...
[{nodes,[{disc,['rabbit1@ubuntu-master']}]},
{running_nodes,['rabbit1@ubuntu-master']},
{cluster_name,<<"rabbit1@ubuntu-master">>},
{partitions,[]},
{alarms,[{'rabbit1@ubuntu-master',[]}]}]

> rabbitmqctl -n rabbit2 cluster_status
Cluster status of node rabbit2@ubuntu-dev2 ...
[{nodes,[{disc,['rabbit2@ubuntu-dev2']}]},
{running_nodes,['rabbit2@ubuntu-dev2']},
{cluster_name,<<"rabbit2@ubuntu-dev2">>},
{partitions,[]},
{alarms,[{'rabbit2@ubuntu-dev2',[]}]}]


Visit the consoles
http://ubuntu-master:15672/
http://ubuntu-dev2:15672/

The default username and password for console is guest/guest, but I can not login and prompt “User can only log in via localhost"
https://stackoverflow.com/questions/23669780/rabbitmq-3-3-1-can-not-login-with-guest-guest

List the users on both servers
> rabbitmqctl -n rabbit1 list_users

> rabbitmqctl -n rabbit2 list_users

Add users/tags/permissions on both services
> rabbitmqctl -n rabbit2 cluster_status
> rabbitmqctl -n rabbit2 list_users
> rabbitmqctl -n rabbit2 add_user carl test
> rabbitmqctl -n rabbit2 set_user_tags carl administrator
> rabbitmqctl -n rabbit2 set_permissions -p / carl ".*" ".*" ".*"

> rabbitmqctl -n rabbit1 list_users
> rabbitmqctl -n rabbit1 add_user carl test
> rabbitmqctl -n rabbit1 set_user_tags carl administrator
> rabbitmqctl -n rabbit1 set_permissions -p / carl ".*" ".*" ".*"

Then, I can use carl/test to login in both consoles.

Stop the second node and join the first cluster
> sudo sbin/rabbitmqctl -n rabbit2 stop_app

Ask the second node to join the first cluster
> sudo sbin/rabbitmqctl -n rabbit2 join_cluster rabbit1@ubuntu-master

I guess it is because of this
CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server)

Copy and put the cookie string from first cluster to the second one
> cat ~/.erlang.cookie
PSEZGZISxxxxxxxNS

> sudo sbin/rabbitmqctl -n rabbit2 join_cluster rabbit1@ubuntu-master
Clustering node rabbit2@ubuntu-dev2 with rabbit1@ubuntu-master

Start the application again
> sudo sbin/rabbitmqctl -n rabbit2 start_app

Check the cluster status
> sbin/rabbitmqctl -n rabbit1 cluster_status
Cluster status of node rabbit1@ubuntu-master ...
[{nodes,[{disc,['rabbit1@ubuntu-master','rabbit2@ubuntu-dev2']}]},
{running_nodes,['rabbit2@ubuntu-dev2','rabbit1@ubuntu-master']},
{cluster_name,<<"rabbit1@ubuntu-master">>},
{partitions,[]},
{alarms,[{'rabbit2@ubuntu-dev2',[]},{'rabbit1@ubuntu-master',[]}]}]

Cluster Solution
https://objcoding.com/2018/10/19/rabbitmq-cluster/
https://blog.csdn.net/WoogeYu/article/details/51119101
https://juejin.im/entry/5c0fb747e51d4505fe6c4b71
https://www.jianshu.com/p/6376936845ff


References:
https://www.rabbitmq.com/install-debian.html
https://sillycat.iteye.com/blog/1567052
https://www.erlang.org/
https://github.com/asdf-vm/asdf-erlang/issues/83