Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
233 views
in Technique[技术] by (71.8m points)

postgresql - postgres could not create replication slot

I'm trying to setup a simple replication scenario in using and . As you can see I'm using a postgres service for the master database (publisher) and one more for the replica (subscriber). wal_level = logical is configured in both services by using this method.

docker-compose.yml:

version: '3.3'

services:
  master:
    image: postgres:11
    env_file:
      - .env
    volumes:
      - ./postgres.conf:/etc/postgresql/postgresql.conf
      - ./master-init.sql:/docker-entrypoint-initdb.d/init.sql
    ports:
    - 5432:5432

  replica:
    image: postgres:11
    env_file:
      - .env
    volumes:
      - ./postgres.conf:/etc/postgresql/postgresql.conf
      - ./replica-init.sql:/docker-entrypoint-initdb.d/init.sql
    ports:
    - 6543:5432
    depends_on:
      - master

master-init.sql:

create table if not exists products
(
    product_id int
        constraint products_pk
            primary key,
    price      float not null,
    brand_id   int   not null
);

create table if not exists brand_avg
(
    brand_id  int unique not null,
    avg_price float      not null
);

create publication main_pub for all tables;

insert into products
    (product_id, price, brand_id)
values (1, 2.45, 1),
       (2, 4.21, 1),
       (3, 5.21, 1),
       (4, 6.34, 1),
       (5, 90.1, 2),
       (6, 87.1, 2),
       (7, 21, 3),
       (8, 23, 3),
       (9, 1, 4),
       (10, 2, 1),
       (11, 32, 3)
on conflict do nothing;

insert into brand_avg
    (brand_id, avg_price)
select brand_id, avg(price)
from products
group by brand_id
order by brand_id
on conflict do nothing;

replica-init.sql:

create table if not exists products
(
    product_id int
        constraint products_pk
            primary key,
    price      float not null,
    brand_id   int   not null
);

create table if not exists brand_avg
(
    brand_id  int unique not null,
    avg_price float      not null
);

create subscription main_sub connection 'dbname=random host=master user=sample password=1234asdf' publication main_pub;

postgres.conf:

listen_addresses = '*'
wal_level = logical

while I'm trying to start the services, I'm getting this error:

master_1   | 2021-02-04 19:02:07.549 UTC [90] ERROR:  logical decoding requires wal_level >= logical
replica_1  | psql:/docker-entrypoint-initdb.d/init.sql:16: ERROR:  could not create replication slot "main_sub": ERROR:  logical decoding requires wal_level >= logical
replica_1  | 2021-02-04 19:02:07.549 UTC [81] ERROR:  could not create replication slot "main_sub": ERROR:  logical decoding requires wal_level >= logical
replica_1  | 2021-02-04 19:02:07.549 UTC [81] STATEMENT:  create subscription main_sub connection 'dbname=random host=master user=sample password=1234asdf' publication main_pub;
db-rbr_replica_1 exited with code 3

Below you can find the whole standard output:

$ docker-compose up
Creating network "db-rbr_default" with the default driver
Creating db-rbr_master_1 ... done
Creating db-rbr_replica_1 ... done
Attaching to db-rbr_master_1, db-rbr_replica_1
master_1   | The files belonging to this database system will be owned by user "postgres".
master_1   | This user must also own the server process.
master_1   |
master_1   | The database cluster will be initialized with locale "en_US.utf8".
master_1   | The default database encoding has accordingly been set to "UTF8".
master_1   | The default text search configuration will be set to "english".
master_1   |
master_1   | Data page checksums are disabled.
master_1   |
master_1   | fixing permissions on existing directory /var/lib/postgresql/data ... ok
master_1   | creating subdirectories ... ok
master_1   | selecting default max_connections ... 100
master_1   | selecting default shared_buffers ... 128MB
master_1   | selecting default timezone ... Etc/UTC
master_1   | selecting dynamic shared memory implementation ... posix
master_1   | creating configuration files ... ok
master_1   | running bootstrap script ... ok
replica_1  | The files belonging to this database system will be owned by user "postgres".
replica_1  | This user must also own the server process.
replica_1  |
replica_1  | The database cluster will be initialized with locale "en_US.utf8".
replica_1  | The default database encoding has accordingly been set to "UTF8".
replica_1  | The default text search configuration will be set to "english".
replica_1  |
replica_1  | Data page checksums are disabled.
replica_1  |
replica_1  | fixing permissions on existing directory /var/lib/postgresql/data ... ok
replica_1  | creating subdirectories ... ok
replica_1  | selecting default max_connections ... 100
replica_1  | selecting default shared_buffers ... 128MB
replica_1  | selecting default timezone ... Etc/UTC
replica_1  | selecting dynamic shared memory implementation ... posix
replica_1  | creating configuration files ... ok
replica_1  | running bootstrap script ... ok
master_1   | performing post-bootstrap initialization ... ok
master_1   | syncing data to disk ... ok
master_1   |
master_1   | Success. You can now start the database server using:
master_1   |
master_1   |     pg_ctl -D /var/lib/postgresql/data -l logfile start
master_1   |
master_1   |
master_1   | WARNING: enabling "trust" authentication for local connections
master_1   | You can change this by editing pg_hba.conf or using the option -A, or
master_1   | --auth-local and --auth-host, the next time you run initdb.
master_1   | waiting for server to start....2021-02-04 19:02:06.696 UTC [46] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
master_1   | 2021-02-04 19:02:06.707 UTC [47] LOG:  database system was shut down at 2021-02-04 19:02:06 UTC
master_1   | 2021-02-04 19:02:06.710 UTC [46] LOG:  database system is ready to accept connections
master_1   |  done
master_1   | server started
replica_1  | performing post-bootstrap initialization ... ok
replica_1  | syncing data to disk ... ok
replica_1  |
replica_1  | Success. You can now start the database server using:
replica_1  |
replica_1  |     pg_ctl -D /var/lib/postgresql/data -l logfile start
replica_1  |
replica_1  |
replica_1  | WARNING: enabling "trust" authentication for local connections
replica_1  | You can change this by editing pg_hba.conf or using the option -A, or
replica_1  | --auth-local and --auth-host, the next time you run initdb.
replica_1  | waiting for server to start....2021-02-04 19:02:07.050 UTC [46] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
replica_1  | 2021-02-04 19:02:07.060 UTC [47] LOG:  database system was shut down at 2021-02-04 19:02:06 UTC
replica_1  | 2021-02-04 19:02:07.064 UTC [46] LOG:  database system is ready to accept connections
master_1   | CREATE DATABASE
master_1   |
master_1   |
master_1   | /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/init.sql
replica_1  |  done
replica_1  | server started
master_1   | CREATE TABLE
master_1   | CREATE TABLE
master_1   | CREATE PUBLICATION
master_1   | INSERT 0 11
master_1   | INSERT 0 4
master_1   |
master_1   |
master_1   | waiting for server to shut down...2021-02-04 19:02:07.165 UTC [46] LOG:  received fast shutdown request
master_1   | .2021-02-04 19:02:07.166 UTC [46] LOG:  aborting any active transactions
master_1   | 2021-02-04 19:02:07.167 UTC [46] LOG:  background worker "logical replication launcher" (PID 53) exited with exit code 1
master_1   | 2021-02-04 19:02:07.168 UTC [48] LOG:  shutting down
master_1   | 2021-02-04 19:02:07.180 UTC [46] LOG:  database system is shut down
master_1   |  done
master_1   | server stopped
master_1   |
master_1   | PostgreSQL init process complete; ready for start up.
master_1   |
master_1   | 2021-02-04 19:02:07.280 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
master_1   | 2021-02-04 19:02:07.280 UTC [1] LOG:  listening on IPv6 address "::", port 5432
master_1   | 2021-02-04 19:02:07.282 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
master_1   | 2021-02-04 19:02:07.301 UTC [83] LOG:  database system was shut down at 2021-02-04 19:02:07 UTC
master_1   | 2021-02-04 19:02:07.305 UTC [1] LOG:  database system is ready to accept connections
replica_1  | CREATE DATABASE
replica_1  |
replica_1  |
replica_1  | /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/init.sql
replica_1  | CREATE TABLE
replica_1  | CREATE TABLE
master_1   | 2021-02-04 19:02:07.549 UTC [90] ERROR:  logical decoding requires wal_level >= logical
replica_1  | psql:/docker-entrypoint-initdb.d/init.sql:16: ERROR:  could not create replication slot "main_sub": ERROR:  logical decoding requires wal_level >= logical
replica_1  | 2021-02-04 19:02:07.549 UTC [81] ERROR:  could not create replication slot "main_sub": ERROR:  logical decoding requires wal_level >= logical
replica_1  | 2021-02-04 19:02:07.549 UTC [81] STATEMENT:  create subscription main_sub connection 'dbname=random host=master user=sample password=1234asdf' publication main_pub;
db-rbr_replica_1 exited with code 3
question from:https://stackoverflow.com/questions/66052757/postgres-could-not-create-replication-slot

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)

You're not passing your custom config to PG.

The compose file should read like:

version: ...
services:
  master:
    ...
    command: ['-c', 'config_file=/etc/postgresql/postgresql.conf']
  
  replica:
    ...
    command: ['-c', 'config_file=/etc/postgresql/postgresql.conf']

so that PG picks it up.

See PG on docker hub "Database Configuration" section.


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...