Concept
Each facility has a database server. For each site the facility library is the main library. The libraries from other facilities are replications. These replications are read-only. This means that every site is independent but still benefits from the work and libraries another facility is doing.
In Postgres terms:
A logical replication is the preferred way to go, since each facility can have their own database setup and also different version of Postgres without running into any issues.
That’s not possible Physical replication, since the Postgres version as well as the folder/file structure needs to be identical. With logical we have one Publisher and as many Subscribers as we like. The Subscribers will be the Postgres databases in the other facilities.
Requirements
In each facility you have a database server up and running with Postgres installed.
START STREAMING
This is for a streaming replication! We want to have a logical replication.
Create primary database server
This is the database server in our facility in e.g. Munich
initdb -D /var/lib/postgresql/daselement-munich
Configure primary server
change postgres.conf to enable networking
create a replication user
allow remote access in pg_hba.conf
change postgres.conf to enable networking
vim /var/lib/postgresql/daselement-munich/postgres.conf # uncomment and change the line: listen_addresses = '*' # and change the port to 5433 to avoid conflicts with production port 5432 port = 5433 # start the Postgres server pg_ctl -D /var/lib/postgresql/daselement-data start
create a replication user
# create replication user psql --port 5433 postgres [local]:5433 postgres=# create user repuser replication;
allow remote access in pg_hba.conf
add line to allow access for the replication user
vim /var/lib/postgresql/daselement-data/pg_hba.conf # TYPE DATABASE USER CIDR-ADDRESS METHOD # IPv4 local connections host all repuser localhost trust # restart the Postgres server pg_ctl -D /var/lib/postgresql/daselement-munich restart
The primary system is now ready. Let’s move on to the replica system!
Create replica database server
Now we are at a database server in a different facility. E.g. Vancouver
# create the replica Postgres server # this command pg_basebackup copies the files from the primary database pg_basebackup -h db-munich -U repuser --checkpoint=fast -D /var/lib/postgresql/daselement-munich-replica/ -R --slot=daselement_munich -C --port 5433
In the replica directory you will find these two files
standby.signal
this file defines that the database that it is a replica
postgresql.auto.conf
contains information to connect to the primary server
Now start the replica server
# start the Postgres server pg_ctl -D /var/lib/postgresql/daselement-munich-replica
END STREAMING
Monitoring
To monitor the databases you can for example use pgwatch2
Configure primary server
inistiate 2 new PostgresSQL database clusters
Configure Publisher server with “wal_level=logical“
Start the instance
Create a database and the tables
Configure Logical Replication
Create a publication on the Publish Server
Create a subscription on the Subscriber Server
Test the replication
Troubleshooting
initdb: command not found
The initdb is located in the installation directory of Postgres.
Fix for Ubuntu:
# create a symbolic link to initdb to access the command sudo ln -s /usr/lib/postgresql/14/bin/initdb /usr/local/bin # now you can run ... initdb