Peerplays_Blockchain/peerplays_migrated
1
0
Fork 0
Code Issues 35 Pull requests 4 Projects Releases 20 Packages Wiki Activity Actions

Stopping two witness nodes doesnot result in rest of the active son nodes to take over #433

New issue
Closed
opened 2022-09-08 16:54:20 +00:00 by prandnum · 19 comments
prandnum commented 2022-09-08 16:54:20 +00:00 (Migrated from gitlab.com)
Copy link

Following were the active son nodes

unlocked >>> list_active_sons 
list_active_sons 
[[
    "sonaccount01",
    "1.33.0"
  ],[
    "sonaccount02",
    "1.33.1"
  ],[
    "sonaccount03",
    "1.33.2"
  ],[
    "sonaccount04",
    "1.33.3"
  ],[
    "sonaccount05",
    "1.33.4"
  ]
]
unlocked >>> get_son_
get_son_listener_log          get_son_network_status        get_son_wallet_by_time_point  get_son_wallets
unlocked >>> get_son_network_status 
get_son_network_status 
[[
    "1.33.0",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.1",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.2",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.3",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.4",
    "[OK, regular SON heartbeat for sidechain 5] "
  ]
]
unlocked >>>

Stopped peerplays02 and peerplays05 nodes

unlocked >>> list_active_sons 
list_active_sons 
[[
    "sonaccount01",
    "1.33.0"
  ],[
    "sonaccount02",
    "1.33.1"
  ],[
    "sonaccount03",
    "1.33.2"
  ],[
    "sonaccount04",
    "1.33.3"
  ],[
    "sonaccount05",
    "1.33.4"
  ]
]
unlocked >>> get_son_network_status 
get_son_network_status 
[[
    "1.33.0",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.1",
    "[NOT OK, irregular SON heartbeat, triggering SON down proposal for sidechain 5] "
  ],[
    "1.33.2",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.3",
    "[OK, regular SON heartbeat for sidechain 5] "
  ],[
    "1.33.4",
    "[NOT OK, irregular SON heartbeat, triggering SON down proposal for sidechain 5] "
  ]
]
unlocked >>> 

kiran@warpspeed:~$ docker ps -a
CONTAINER ID   IMAGE                    COMMAND                  CREATED        STATUS                    PORTS                                                                                                                                             NAMES
43f6e53d8a6b   peerplays02              "./witness_node -d .…"   11 hours ago   Exited (0) 10 hours ago                                                                                                                                                     peerplays-qa-environment_peerplays02_1
dbf2efa3c0e3   peerplays08              "./witness_node -d .…"   11 hours ago   Up 11 minutes             22/tcp, 0.0.0.0:8097->8090/tcp, :::8097->8090/tcp, 0.0.0.0:9784->9777/tcp, :::9784->9777/tcp                                                      peerplays-qa-environment_peerplays08_1
23d1f2ae4e10   peerplays09              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8098->8090/tcp, :::8098->8090/tcp, 0.0.0.0:9785->9777/tcp, :::9785->9777/tcp                                                      peerplays-qa-environment_peerplays09_1
893166d64ea7   peerplays07              "./witness_node -d .…"   11 hours ago   Up 42 minutes             22/tcp, 0.0.0.0:8096->8090/tcp, :::8096->8090/tcp, 0.0.0.0:9783->9777/tcp, :::9783->9777/tcp                                                      peerplays-qa-environment_peerplays07_1
743ec7328fce   peerplays03              "./witness_node -d .…"   11 hours ago   Up About an hour          22/tcp, 0.0.0.0:8092->8090/tcp, :::8092->8090/tcp, 0.0.0.0:9779->9777/tcp, :::9779->9777/tcp                                                      peerplays-qa-environment_peerplays03_1
c810429ad460   peerplays06              "./witness_node -d .…"   11 hours ago   Up 4 hours                22/tcp, 0.0.0.0:8095->8090/tcp, :::8095->8090/tcp, 0.0.0.0:9782->9777/tcp, :::9782->9777/tcp                                                      peerplays-qa-environment_peerplays06_1
d2be35177225   peerplays05              "./witness_node -d .…"   11 hours ago   Exited (0) 8 hours ago                                                                                                                                                      peerplays-qa-environment_peerplays05_1
56568dfeb67b   peerplays14              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8103->8090/tcp, :::8103->8090/tcp, 0.0.0.0:9790->9777/tcp, :::9790->9777/tcp                                                      peerplays-qa-environment_peerplays14_1
d85b45dfd819   peerplays16              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8105->8090/tcp, :::8105->8090/tcp, 0.0.0.0:9792->9777/tcp, :::9792->9777/tcp                                                      peerplays-qa-environment_peerplays16_1
15b17b8ff6a1   peerplays15              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8104->8090/tcp, :::8104->8090/tcp, 0.0.0.0:9791->9777/tcp, :::9791->9777/tcp                                                      peerplays-qa-environment_peerplays15_1
5792f71df7c6   peerplays10              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8099->8090/tcp, :::8099->8090/tcp, 0.0.0.0:9786->9777/tcp, :::9786->9777/tcp                                                      peerplays-qa-environment_peerplays10_1
2d76147bdc64   peerplays12              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8101->8090/tcp, :::8101->8090/tcp, 0.0.0.0:9788->9777/tcp, :::9788->9777/tcp                                                      peerplays-qa-environment_peerplays12_1
3493dfa60c6e   peerplays04              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8093->8090/tcp, :::8093->8090/tcp, 0.0.0.0:9780->9777/tcp, :::9780->9777/tcp                                                      peerplays-qa-environment_peerplays04_1
5b5662e5ace0   peerplays11              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8100->8090/tcp, :::8100->8090/tcp, 0.0.0.0:9787->9777/tcp, :::9787->9777/tcp                                                      peerplays-qa-environment_peerplays11_1
bffe09462208   peerplays13              "./witness_node -d .…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:8102->8090/tcp, :::8102->8090/tcp, 0.0.0.0:9789->9777/tcp, :::9789->9777/tcp                                                      peerplays-qa-environment_peerplays13_1
44fe148284bf   peerplays01              "./witness_node -d .…"   11 hours ago   Up 58 minutes             0.0.0.0:8090->8090/tcp, :::8090->8090/tcp, 22/tcp, 0.0.0.0:9777->9777/tcp, :::9777->9777/tcp                                                      peerplays-qa-environment_peerplays01_1
421701d212b2   peerplays-base           "bash"                   11 hours ago   Exited (0) 11 hours ago                                                                                                                                                     peerplays-qa-environment_peerplays-base_1
8a20f9ed1661   hive-for-peerplays       "./hived -d ./hived_…"   11 hours ago   Up 11 hours               22/tcp, 0.0.0.0:28090-28091->28090-28091/tcp, :::28090-28091->28090-28091/tcp                                                                     peerplays-qa-environment_hive-for-peerplays_1
973f1a24e8fd   ethereum-for-peerplays   "./geth --config ./n…"   11 hours ago   Up 11 hours               0.0.0.0:6060->6060/tcp, :::6060->6060/tcp, 0.0.0.0:8545->8545/tcp, :::8545->8545/tcp, 22/tcp, 0.0.0.0:30303->30303/tcp, :::30303->30303/tcp       peerplays-qa-environment_ethereum-for-peerplays_1
69abb927d854   bitcoin-for-peerplays    "./bitcoind -datadir…"   11 hours ago   Up 11 hours               0.0.0.0:8332->8332/tcp, :::8332->8332/tcp, 0.0.0.0:11111->11111/tcp, :::11111->11111/tcp, 22/tcp, 0.0.0.0:18444->18444/tcp, :::18444->18444/tcp   peerplays-qa-environment_bitcoin-for-peerplays_1
c5c6401a3bc5   ubuntu-for-peerplays     "bash"                   11 hours ago   Exited (0) 11 hours ago                                                                                                                                                     peerplays-qa-environment_ubuntu-for-peerplays_1
kiran@warpspeed:~$

It is seen that some of the witness nodes crashed (peerplays08, peerplays07, peerplays03, peerplays06, peerplays01)

Following were the active son nodes ``` unlocked >>> list_active_sons list_active_sons [[ "sonaccount01", "1.33.0" ],[ "sonaccount02", "1.33.1" ],[ "sonaccount03", "1.33.2" ],[ "sonaccount04", "1.33.3" ],[ "sonaccount05", "1.33.4" ] ] unlocked >>> get_son_ get_son_listener_log get_son_network_status get_son_wallet_by_time_point get_son_wallets unlocked >>> get_son_network_status get_son_network_status [[ "1.33.0", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.1", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.2", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.3", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.4", "[OK, regular SON heartbeat for sidechain 5] " ] ] unlocked >>> ``` Stopped peerplays02 and peerplays05 nodes ``` unlocked >>> list_active_sons list_active_sons [[ "sonaccount01", "1.33.0" ],[ "sonaccount02", "1.33.1" ],[ "sonaccount03", "1.33.2" ],[ "sonaccount04", "1.33.3" ],[ "sonaccount05", "1.33.4" ] ] unlocked >>> get_son_network_status get_son_network_status [[ "1.33.0", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.1", "[NOT OK, irregular SON heartbeat, triggering SON down proposal for sidechain 5] " ],[ "1.33.2", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.3", "[OK, regular SON heartbeat for sidechain 5] " ],[ "1.33.4", "[NOT OK, irregular SON heartbeat, triggering SON down proposal for sidechain 5] " ] ] unlocked >>> ``` ``` kiran@warpspeed:~$ docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 43f6e53d8a6b peerplays02 "./witness_node -d .…" 11 hours ago Exited (0) 10 hours ago peerplays-qa-environment_peerplays02_1 dbf2efa3c0e3 peerplays08 "./witness_node -d .…" 11 hours ago Up 11 minutes 22/tcp, 0.0.0.0:8097->8090/tcp, :::8097->8090/tcp, 0.0.0.0:9784->9777/tcp, :::9784->9777/tcp peerplays-qa-environment_peerplays08_1 23d1f2ae4e10 peerplays09 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8098->8090/tcp, :::8098->8090/tcp, 0.0.0.0:9785->9777/tcp, :::9785->9777/tcp peerplays-qa-environment_peerplays09_1 893166d64ea7 peerplays07 "./witness_node -d .…" 11 hours ago Up 42 minutes 22/tcp, 0.0.0.0:8096->8090/tcp, :::8096->8090/tcp, 0.0.0.0:9783->9777/tcp, :::9783->9777/tcp peerplays-qa-environment_peerplays07_1 743ec7328fce peerplays03 "./witness_node -d .…" 11 hours ago Up About an hour 22/tcp, 0.0.0.0:8092->8090/tcp, :::8092->8090/tcp, 0.0.0.0:9779->9777/tcp, :::9779->9777/tcp peerplays-qa-environment_peerplays03_1 c810429ad460 peerplays06 "./witness_node -d .…" 11 hours ago Up 4 hours 22/tcp, 0.0.0.0:8095->8090/tcp, :::8095->8090/tcp, 0.0.0.0:9782->9777/tcp, :::9782->9777/tcp peerplays-qa-environment_peerplays06_1 d2be35177225 peerplays05 "./witness_node -d .…" 11 hours ago Exited (0) 8 hours ago peerplays-qa-environment_peerplays05_1 56568dfeb67b peerplays14 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8103->8090/tcp, :::8103->8090/tcp, 0.0.0.0:9790->9777/tcp, :::9790->9777/tcp peerplays-qa-environment_peerplays14_1 d85b45dfd819 peerplays16 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8105->8090/tcp, :::8105->8090/tcp, 0.0.0.0:9792->9777/tcp, :::9792->9777/tcp peerplays-qa-environment_peerplays16_1 15b17b8ff6a1 peerplays15 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8104->8090/tcp, :::8104->8090/tcp, 0.0.0.0:9791->9777/tcp, :::9791->9777/tcp peerplays-qa-environment_peerplays15_1 5792f71df7c6 peerplays10 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8099->8090/tcp, :::8099->8090/tcp, 0.0.0.0:9786->9777/tcp, :::9786->9777/tcp peerplays-qa-environment_peerplays10_1 2d76147bdc64 peerplays12 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8101->8090/tcp, :::8101->8090/tcp, 0.0.0.0:9788->9777/tcp, :::9788->9777/tcp peerplays-qa-environment_peerplays12_1 3493dfa60c6e peerplays04 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8093->8090/tcp, :::8093->8090/tcp, 0.0.0.0:9780->9777/tcp, :::9780->9777/tcp peerplays-qa-environment_peerplays04_1 5b5662e5ace0 peerplays11 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8100->8090/tcp, :::8100->8090/tcp, 0.0.0.0:9787->9777/tcp, :::9787->9777/tcp peerplays-qa-environment_peerplays11_1 bffe09462208 peerplays13 "./witness_node -d .…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:8102->8090/tcp, :::8102->8090/tcp, 0.0.0.0:9789->9777/tcp, :::9789->9777/tcp peerplays-qa-environment_peerplays13_1 44fe148284bf peerplays01 "./witness_node -d .…" 11 hours ago Up 58 minutes 0.0.0.0:8090->8090/tcp, :::8090->8090/tcp, 22/tcp, 0.0.0.0:9777->9777/tcp, :::9777->9777/tcp peerplays-qa-environment_peerplays01_1 421701d212b2 peerplays-base "bash" 11 hours ago Exited (0) 11 hours ago peerplays-qa-environment_peerplays-base_1 8a20f9ed1661 hive-for-peerplays "./hived -d ./hived_…" 11 hours ago Up 11 hours 22/tcp, 0.0.0.0:28090-28091->28090-28091/tcp, :::28090-28091->28090-28091/tcp peerplays-qa-environment_hive-for-peerplays_1 973f1a24e8fd ethereum-for-peerplays "./geth --config ./n…" 11 hours ago Up 11 hours 0.0.0.0:6060->6060/tcp, :::6060->6060/tcp, 0.0.0.0:8545->8545/tcp, :::8545->8545/tcp, 22/tcp, 0.0.0.0:30303->30303/tcp, :::30303->30303/tcp peerplays-qa-environment_ethereum-for-peerplays_1 69abb927d854 bitcoin-for-peerplays "./bitcoind -datadir…" 11 hours ago Up 11 hours 0.0.0.0:8332->8332/tcp, :::8332->8332/tcp, 0.0.0.0:11111->11111/tcp, :::11111->11111/tcp, 22/tcp, 0.0.0.0:18444->18444/tcp, :::18444->18444/tcp peerplays-qa-environment_bitcoin-for-peerplays_1 c5c6401a3bc5 ubuntu-for-peerplays "bash" 11 hours ago Exited (0) 11 hours ago peerplays-qa-environment_ubuntu-for-peerplays_1 kiran@warpspeed:~$ ``` It is seen that some of the witness nodes crashed (peerplays08, peerplays07, peerplays03, peerplays06, peerplays01)
prandnum commented 2022-09-08 18:26:07 +00:00 (Migrated from gitlab.com)
Copy link

@bobinson @serkixenos

CC: @tai.sama

@bobinson @serkixenos CC: @tai.sama
serkixenos commented 2022-10-11 00:22:02 +00:00 (Migrated from gitlab.com)
Copy link

assigned to @mkhan17

assigned to @mkhan17
serkixenos commented 2022-10-14 18:46:05 +00:00 (Migrated from gitlab.com)
Copy link

assigned to @milo_peerplays

assigned to @milo_peerplays
milo_peerplays commented 2022-11-10 09:21:01 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in merge request !177

mentioned in merge request !177
milo_peerplays commented 2022-11-10 13:05:26 +00:00 (Migrated from gitlab.com)
Copy link

MR which fixes the issue is https://gitlab.com/PBSA/peerplays/-/merge_requests/177

MR which fixes the issue is https://gitlab.com/PBSA/peerplays/-/merge_requests/177
serkixenos commented 2022-11-10 13:30:38 +00:00 (Migrated from gitlab.com)
Copy link

assigned to @prandnum

assigned to @prandnum
serkixenos commented 2022-11-10 13:30:44 +00:00 (Migrated from gitlab.com)
Copy link

assigned to @wsalloum

assigned to @wsalloum
milo_peerplays commented 2022-11-15 22:33:05 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit 8853a76752

mentioned in commit 8853a767529c9b3839d2e7ff0203a11efcd8d86e
serkixenos commented 2022-11-15 22:33:05 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit a6da2a6413

mentioned in commit a6da2a64134108c7aff24294b9c66060fd0e4801
prandnum commented 2022-11-20 07:42:08 +00:00 (Migrated from gitlab.com)
Copy link

@serkixenos @milo_peerplays

The son takeover worked after stopping 1 witness nodes but when the second one was stopped, the witness nodes started crashing.

Stopped peerplays01 and then peerplays05 after that. logs available at https://gitlab.com/PBSA/documentation/working-documents/-/tree/develop/433/19112022

kiran@warpspeed:~/PBSA/11112022/peerplays-utils/peerplays-qa-environment$ docker ps -a
CONTAINER ID   IMAGE                            COMMAND                  CREATED        STATUS                    PORTS                                                                                                                                                   NAMES
8eeeaaa9d5e3   peerplays02                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8091->8090/tcp, :::8091->8090/tcp, 0.0.0.0:9778->9777/tcp, :::9778->9777/tcp                                                            peerplays-qa-environment_peerplays02_1
543efa889079   peerplays01                      "./witness_node -d .…"   37 hours ago   Exited (0) 13 hours ago                                                                                                                                                           peerplays-qa-environment_peerplays01_1
118fab6b6b20   peerplays15                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8104->8090/tcp, :::8104->8090/tcp, 0.0.0.0:9791->9777/tcp, :::9791->9777/tcp                                                            peerplays-qa-environment_peerplays15_1
75e793c7d09d   peerplays10                      "./witness_node -d .…"   37 hours ago   Up 13 seconds             22/tcp, 0.0.0.0:8099->8090/tcp, :::8099->8090/tcp, 0.0.0.0:9786->9777/tcp, :::9786->9777/tcp                                                            peerplays-qa-environment_peerplays10_1
10836ea92e60   peerplays04                      "./witness_node -d .…"   37 hours ago   Up About a minute         22/tcp, 0.0.0.0:8093->8090/tcp, :::8093->8090/tcp, 0.0.0.0:9780->9777/tcp, :::9780->9777/tcp                                                            peerplays-qa-environment_peerplays04_1
d6fcdece1ff6   peerplays13                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8102->8090/tcp, :::8102->8090/tcp, 0.0.0.0:9789->9777/tcp, :::9789->9777/tcp                                                            peerplays-qa-environment_peerplays13_1
11bb9c45f9fa   peerplays03                      "./witness_node -d .…"   37 hours ago   Up 5 minutes              22/tcp, 0.0.0.0:8092->8090/tcp, :::8092->8090/tcp, 0.0.0.0:9779->9777/tcp, :::9779->9777/tcp                                                            peerplays-qa-environment_peerplays03_1
0b411fccd809   peerplays14                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8103->8090/tcp, :::8103->8090/tcp, 0.0.0.0:9790->9777/tcp, :::9790->9777/tcp                                                            peerplays-qa-environment_peerplays14_1
1934f9fbe314   peerplays06                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8095->8090/tcp, :::8095->8090/tcp, 0.0.0.0:9782->9777/tcp, :::9782->9777/tcp                                                            peerplays-qa-environment_peerplays06_1
8814d2dc64c5   peerplays12                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8101->8090/tcp, :::8101->8090/tcp, 0.0.0.0:9788->9777/tcp, :::9788->9777/tcp                                                            peerplays-qa-environment_peerplays12_1
a81e32a006aa   peerplays08                      "./witness_node -d .…"   37 hours ago   Up 3 hours                22/tcp, 0.0.0.0:8097->8090/tcp, :::8097->8090/tcp, 0.0.0.0:9784->9777/tcp, :::9784->9777/tcp                                                            peerplays-qa-environment_peerplays08_1
318d71547347   peerplays09                      "./witness_node -d .…"   37 hours ago   Up 12 hours               22/tcp, 0.0.0.0:8098->8090/tcp, :::8098->8090/tcp, 0.0.0.0:9785->9777/tcp, :::9785->9777/tcp                                                            peerplays-qa-environment_peerplays09_1
08c732995bd9   peerplays07                      "./witness_node -d .…"   37 hours ago   Up About an hour          22/tcp, 0.0.0.0:8096->8090/tcp, :::8096->8090/tcp, 0.0.0.0:9783->9777/tcp, :::9783->9777/tcp                                                            peerplays-qa-environment_peerplays07_1
9b9602e19a1d   peerplays16                      "./witness_node -d .…"   37 hours ago   Up 37 hours               22/tcp, 0.0.0.0:8105->8090/tcp, :::8105->8090/tcp, 0.0.0.0:9792->9777/tcp, :::9792->9777/tcp                                                            peerplays-qa-environment_peerplays16_1
ab89b859edc0   peerplays11                      "./witness_node -d .…"   37 hours ago   Up 18 seconds             22/tcp, 0.0.0.0:8100->8090/tcp, :::8100->8090/tcp, 0.0.0.0:9787->9777/tcp, :::9787->9777/tcp                                                            peerplays-qa-environment_peerplays11_1
53ed1b48520f   peerplays05                      "./witness_node -d .…"   37 hours ago   Exited (0) 13 hours ago                                                                                                                                                           peerplays-qa-environment_peerplays05_1
978f39479007   peerplays-base                   "bash"                   37 hours ago   Exited (0) 37 hours ago                                                                                                                                                           peerplays-qa-environment_peerplays-base_1
ea14add435e3   hive-for-peerplays               "./hived -d ./hived_…"   38 hours ago   Up 38 hours               22/tcp, 0.0.0.0:28090-28091->28090-28091/tcp, :::28090-28091->28090-28091/tcp                                                                           peerplays-qa-environment_hive-for-peerplays_1
a2bc0338b9c0   ethereum-for-peerplays           "./geth --config ./n…"   38 hours ago   Up 38 hours               0.0.0.0:6060->6060/tcp, :::6060->6060/tcp, 22/tcp, 0.0.0.0:8545->8545/tcp, :::8545->8545/tcp, 8546/tcp, 0.0.0.0:30303->30303/tcp, :::30303->30303/tcp   peerplays-qa-environment_ethereum-for-peerplays_1
86fcdcde35f2   libbitcoinserver-for-peerplays   "/bin/sh runserver.sh"   38 hours ago   Up 38 hours               0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 22/tcp, 0.0.0.0:9093->9093/tcp, :::9093->9093/tcp                                                            peerplays-qa-environment_libbitcoinserver-for-peerplays_1
93d88917f317   bitcoin-for-peerplays            "./bitcoind -datadir…"   38 hours ago   Up 38 hours               0.0.0.0:8332->8332/tcp, :::8332->8332/tcp, 0.0.0.0:11111->11111/tcp, :::11111->11111/tcp, 22/tcp, 0.0.0.0:18444->18444/tcp, :::18444->18444/tcp         peerplays-qa-environment_bitcoin-for-peerplays_1
fe850805bfed   ubuntu-for-peerplays             "bash"                   38 hours ago   Exited (0) 37 hours ago                                                                                                                                                           peerplays-qa-environment_ubuntu-for-peerplays_1
kiran@warpspeed:~/PBSA/11112022/peerplays-utils/peerplays-qa-environment$
@serkixenos @milo_peerplays The son takeover worked after stopping 1 witness nodes but when the second one was stopped, the witness nodes started crashing. Stopped peerplays01 and then peerplays05 after that. logs available at https://gitlab.com/PBSA/documentation/working-documents/-/tree/develop/433/19112022 ``` kiran@warpspeed:~/PBSA/11112022/peerplays-utils/peerplays-qa-environment$ docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 8eeeaaa9d5e3 peerplays02 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8091->8090/tcp, :::8091->8090/tcp, 0.0.0.0:9778->9777/tcp, :::9778->9777/tcp peerplays-qa-environment_peerplays02_1 543efa889079 peerplays01 "./witness_node -d .…" 37 hours ago Exited (0) 13 hours ago peerplays-qa-environment_peerplays01_1 118fab6b6b20 peerplays15 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8104->8090/tcp, :::8104->8090/tcp, 0.0.0.0:9791->9777/tcp, :::9791->9777/tcp peerplays-qa-environment_peerplays15_1 75e793c7d09d peerplays10 "./witness_node -d .…" 37 hours ago Up 13 seconds 22/tcp, 0.0.0.0:8099->8090/tcp, :::8099->8090/tcp, 0.0.0.0:9786->9777/tcp, :::9786->9777/tcp peerplays-qa-environment_peerplays10_1 10836ea92e60 peerplays04 "./witness_node -d .…" 37 hours ago Up About a minute 22/tcp, 0.0.0.0:8093->8090/tcp, :::8093->8090/tcp, 0.0.0.0:9780->9777/tcp, :::9780->9777/tcp peerplays-qa-environment_peerplays04_1 d6fcdece1ff6 peerplays13 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8102->8090/tcp, :::8102->8090/tcp, 0.0.0.0:9789->9777/tcp, :::9789->9777/tcp peerplays-qa-environment_peerplays13_1 11bb9c45f9fa peerplays03 "./witness_node -d .…" 37 hours ago Up 5 minutes 22/tcp, 0.0.0.0:8092->8090/tcp, :::8092->8090/tcp, 0.0.0.0:9779->9777/tcp, :::9779->9777/tcp peerplays-qa-environment_peerplays03_1 0b411fccd809 peerplays14 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8103->8090/tcp, :::8103->8090/tcp, 0.0.0.0:9790->9777/tcp, :::9790->9777/tcp peerplays-qa-environment_peerplays14_1 1934f9fbe314 peerplays06 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8095->8090/tcp, :::8095->8090/tcp, 0.0.0.0:9782->9777/tcp, :::9782->9777/tcp peerplays-qa-environment_peerplays06_1 8814d2dc64c5 peerplays12 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8101->8090/tcp, :::8101->8090/tcp, 0.0.0.0:9788->9777/tcp, :::9788->9777/tcp peerplays-qa-environment_peerplays12_1 a81e32a006aa peerplays08 "./witness_node -d .…" 37 hours ago Up 3 hours 22/tcp, 0.0.0.0:8097->8090/tcp, :::8097->8090/tcp, 0.0.0.0:9784->9777/tcp, :::9784->9777/tcp peerplays-qa-environment_peerplays08_1 318d71547347 peerplays09 "./witness_node -d .…" 37 hours ago Up 12 hours 22/tcp, 0.0.0.0:8098->8090/tcp, :::8098->8090/tcp, 0.0.0.0:9785->9777/tcp, :::9785->9777/tcp peerplays-qa-environment_peerplays09_1 08c732995bd9 peerplays07 "./witness_node -d .…" 37 hours ago Up About an hour 22/tcp, 0.0.0.0:8096->8090/tcp, :::8096->8090/tcp, 0.0.0.0:9783->9777/tcp, :::9783->9777/tcp peerplays-qa-environment_peerplays07_1 9b9602e19a1d peerplays16 "./witness_node -d .…" 37 hours ago Up 37 hours 22/tcp, 0.0.0.0:8105->8090/tcp, :::8105->8090/tcp, 0.0.0.0:9792->9777/tcp, :::9792->9777/tcp peerplays-qa-environment_peerplays16_1 ab89b859edc0 peerplays11 "./witness_node -d .…" 37 hours ago Up 18 seconds 22/tcp, 0.0.0.0:8100->8090/tcp, :::8100->8090/tcp, 0.0.0.0:9787->9777/tcp, :::9787->9777/tcp peerplays-qa-environment_peerplays11_1 53ed1b48520f peerplays05 "./witness_node -d .…" 37 hours ago Exited (0) 13 hours ago peerplays-qa-environment_peerplays05_1 978f39479007 peerplays-base "bash" 37 hours ago Exited (0) 37 hours ago peerplays-qa-environment_peerplays-base_1 ea14add435e3 hive-for-peerplays "./hived -d ./hived_…" 38 hours ago Up 38 hours 22/tcp, 0.0.0.0:28090-28091->28090-28091/tcp, :::28090-28091->28090-28091/tcp peerplays-qa-environment_hive-for-peerplays_1 a2bc0338b9c0 ethereum-for-peerplays "./geth --config ./n…" 38 hours ago Up 38 hours 0.0.0.0:6060->6060/tcp, :::6060->6060/tcp, 22/tcp, 0.0.0.0:8545->8545/tcp, :::8545->8545/tcp, 8546/tcp, 0.0.0.0:30303->30303/tcp, :::30303->30303/tcp peerplays-qa-environment_ethereum-for-peerplays_1 86fcdcde35f2 libbitcoinserver-for-peerplays "/bin/sh runserver.sh" 38 hours ago Up 38 hours 0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 22/tcp, 0.0.0.0:9093->9093/tcp, :::9093->9093/tcp peerplays-qa-environment_libbitcoinserver-for-peerplays_1 93d88917f317 bitcoin-for-peerplays "./bitcoind -datadir…" 38 hours ago Up 38 hours 0.0.0.0:8332->8332/tcp, :::8332->8332/tcp, 0.0.0.0:11111->11111/tcp, :::11111->11111/tcp, 22/tcp, 0.0.0.0:18444->18444/tcp, :::18444->18444/tcp peerplays-qa-environment_bitcoin-for-peerplays_1 fe850805bfed ubuntu-for-peerplays "bash" 38 hours ago Exited (0) 37 hours ago peerplays-qa-environment_ubuntu-for-peerplays_1 kiran@warpspeed:~/PBSA/11112022/peerplays-utils/peerplays-qa-environment$ ```
milo_peerplays commented 2022-11-21 01:45:48 +00:00 (Migrated from gitlab.com)
Copy link

Hey @prandnum, I did test myself before creating the MR and I saw no issues. I have stopped 2 docker nodes (peerplays02 and peerplays03) which were running 2 active SONs and they were successfully substituted with 2 new active SONs. I will test again, this time with stopping peerplays01 as node that was used to initialize the network.

It could also happen that the crashes of other nodes are unrelated to shutting down 2 nodes.

Hey @prandnum, I did test myself before creating the MR and I saw no issues. I have stopped 2 docker nodes (peerplays02 and peerplays03) which were running 2 active SONs and they were successfully substituted with 2 new active SONs. I will test again, this time with stopping peerplays01 as node that was used to initialize the network. It could also happen that the crashes of other nodes are unrelated to shutting down 2 nodes.
prandnum commented 2022-11-23 14:41:32 +00:00 (Migrated from gitlab.com)
Copy link

@milo_peerplays rebuild the env and with the same steps was able to reproduce the crash. so the issue is reproducible

@milo_peerplays rebuild the env and with the same steps was able to reproduce the crash. so the issue is reproducible
prandnum commented 2022-11-23 14:57:34 +00:00 (Migrated from gitlab.com)
Copy link

From one of the coredumps

kiran@warpspeed:/home$ sudo coredumpctl debug 1377951
           PID: 1377951 (witness_node)
           UID: 0 (root)
           GID: 0 (root)
        Signal: 11 (SEGV)
     Timestamp: Wed 2022-11-23 20:02:24 IST (23min ago)
  Command Line: ./witness_node -d ./witness_node_data_dir --replay-blockchain
    Executable: /home/peerplays/src/peerplays/build/programs/witness_node/witness_node
 Control Group: /docker/a4629ec81abb079e60ac722d24d682f7cbe239fa246a31d88e9e5672cfa0ff5d
         Slice: -.slice
       Boot ID: b60118b60c134979b8f3b67eb595db7b
    Machine ID: a388625228614d18b5373ad1be39a93f
      Hostname: warpspeed
       Storage: /var/lib/systemd/coredump/core.witness_node.0.b60118b60c134979b8f3b67eb595db7b.1377951.1669213944000000000000.lz4
       Message: Process 1377951 (witness_node) of user 0 dumped core.
                
                Stack trace of thread 15:
                #0  0x00007f0b495c6941 __GI_abort (libc.so.6 + 0x22941)
                #1  0x00007f0b495c6729 __assert_fail_base (libc.so.6 + 0x22729)
                #2  0x00007f0b495d7fd6 __GI___assert_fail (libc.so.6 + 0x33fd6)
                #3  0x0000563bf1e3435c n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x576735c)
                #4  0x0000563bf1e518e7 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x57848e7)
                #5  0x0000563bf1f9ef92 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58d1f92)
                #6  0x0000563bf1fa5a87 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58d8a87)
                #7  0x0000563bf1fa539d n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58d839d)
                #8  0x0000563bf1faad7a n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58ddd7a)
                #9  0x0000563bf330028a n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c3328a)
                #10 0x0000563bf3300206 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c33206)
                #11 0x0000563bf32f1db4 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c24db4)
                #12 0x0000563bf32f2163 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c25163)
                #13 0x0000563bf32f1733 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c24733)
                #14 0x0000563bf3566c4f n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6e99c4f)

GNU gdb (Ubuntu 9.2-0ubuntu1~20.04.1) 9.2
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /home/peerplays/src/peerplays/build/programs/witness_node/witness_node...
[New LWP 15]
[New LWP 8]
[New LWP 14]
[New LWP 9]
[New LWP 16]
[New LWP 1]
[New LWP 10]
[New LWP 7]
[New LWP 17]
[New LWP 12]
[New LWP 11]
[New LWP 18]
[New LWP 13]
[New LWP 19]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `./witness_node -d ./witness_node_data_dir --replay-blockchain'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  __GI_abort () at abort.c:107
107	abort.c: No such file or directory.
[Current thread is 1 (Thread 0x7f0b207fd700 (LWP 15))]
(gdb) backtrace
#0  __GI_abort () at abort.c:107
#1  0x00007f0b495c6729 in __assert_fail_base (fmt=0x7f0b4975c588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x563bf39fd198 "_closing_connections.find(peer_to_delete) == _closing_connections.end()", file=0x563bf39fb728 "/home/peerplays/src/peerplays/libraries/net/node.cpp", line=1654, 
    function=<optimized out>) at assert.c:92
#2  0x00007f0b495d7fd6 in __GI___assert_fail (assertion=0x563bf39fd198 "_closing_connections.find(peer_to_delete) == _closing_connections.end()", file=0x563bf39fb728 "/home/peerplays/src/peerplays/libraries/net/node.cpp", line=1654, 
    function=0x563bf39fd0a0 "void graphene::net::detail::node_impl::schedule_peer_for_deletion(const peer_connection_ptr&)") at assert.c:101
#3  0x0000563bf1e3435c in graphene::net::detail::node_impl::schedule_peer_for_deletion (this=0x563bf6ae1a30, peer_to_delete=std::shared_ptr<class graphene::net::peer_connection> (use count 5, weak count 2) = {...}) at /home/peerplays/src/peerplays/libraries/net/node.cpp:1654
#4  0x0000563bf1e518e7 in graphene::net::detail::node_impl::on_connection_closed (this=0x563bf6ae1a30, originating_peer=0x7f0b18318a00) at /home/peerplays/src/peerplays/libraries/net/node.cpp:3106
#5  0x0000563bf1f9ef92 in graphene::net::peer_connection::on_connection_closed (this=0x7f0b18318a00, originating_connection=0x7f0b18318a30) at /home/peerplays/src/peerplays/libraries/net/peer_connection.cpp:283
#6  0x0000563bf1fa5a87 in graphene::net::detail::message_oriented_connection_impl::read_loop (this=0x563bf5be68a0) at /home/peerplays/src/peerplays/libraries/net/message_oriented_connection.cpp:241
#7  0x0000563bf1fa539d in graphene::net::detail::message_oriented_connection_impl::<lambda()>::operator()(void) const (__closure=0x7f0b183188f8) at /home/peerplays/src/peerplays/libraries/net/message_oriented_connection.cpp:134
#8  0x0000563bf1faad7a in fc::detail::void_functor_run<graphene::net::detail::message_oriented_connection_impl::connect_to(const fc::ip::endpoint&)::<lambda()> >::run(void *, void *) (functor=0x7f0b183188f8, prom=0x7f0b183188f0) at /home/peerplays/src/peerplays/libraries/fc/include/fc/thread/task.hpp:83
#9  0x0000563bf330028a in fc::task_base::run_impl (this=0x7f0b18318900) at /home/peerplays/src/peerplays/libraries/fc/src/thread/task.cpp:43
#10 0x0000563bf3300206 in fc::task_base::run (this=0x7f0b18318900) at /home/peerplays/src/peerplays/libraries/fc/src/thread/task.cpp:32
#11 0x0000563bf32f1db4 in fc::thread_d::run_next_task (this=0x7f0b18000b60) at /home/peerplays/src/peerplays/libraries/fc/src/thread/thread_d.hpp:520
#12 0x0000563bf32f2163 in fc::thread_d::process_tasks (this=0x7f0b18000b60) at /home/peerplays/src/peerplays/libraries/fc/src/thread/thread_d.hpp:568
#13 0x0000563bf32f1733 in fc::thread_d::start_process_tasks (my=...) at /home/peerplays/src/peerplays/libraries/fc/src/thread/thread_d.hpp:499
#14 0x0000563bf3566c4f in make_fcontext ()
#15 0x0000000000000000 in ?? ()
(gdb)
From one of the coredumps ``` kiran@warpspeed:/home$ sudo coredumpctl debug 1377951 PID: 1377951 (witness_node) UID: 0 (root) GID: 0 (root) Signal: 11 (SEGV) Timestamp: Wed 2022-11-23 20:02:24 IST (23min ago) Command Line: ./witness_node -d ./witness_node_data_dir --replay-blockchain Executable: /home/peerplays/src/peerplays/build/programs/witness_node/witness_node Control Group: /docker/a4629ec81abb079e60ac722d24d682f7cbe239fa246a31d88e9e5672cfa0ff5d Slice: -.slice Boot ID: b60118b60c134979b8f3b67eb595db7b Machine ID: a388625228614d18b5373ad1be39a93f Hostname: warpspeed Storage: /var/lib/systemd/coredump/core.witness_node.0.b60118b60c134979b8f3b67eb595db7b.1377951.1669213944000000000000.lz4 Message: Process 1377951 (witness_node) of user 0 dumped core. Stack trace of thread 15: #0 0x00007f0b495c6941 __GI_abort (libc.so.6 + 0x22941) #1 0x00007f0b495c6729 __assert_fail_base (libc.so.6 + 0x22729) #2 0x00007f0b495d7fd6 __GI___assert_fail (libc.so.6 + 0x33fd6) #3 0x0000563bf1e3435c n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x576735c) #4 0x0000563bf1e518e7 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x57848e7) #5 0x0000563bf1f9ef92 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58d1f92) #6 0x0000563bf1fa5a87 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58d8a87) #7 0x0000563bf1fa539d n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58d839d) #8 0x0000563bf1faad7a n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x58ddd7a) #9 0x0000563bf330028a n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c3328a) #10 0x0000563bf3300206 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c33206) #11 0x0000563bf32f1db4 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c24db4) #12 0x0000563bf32f2163 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c25163) #13 0x0000563bf32f1733 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6c24733) #14 0x0000563bf3566c4f n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x6e99c4f) GNU gdb (Ubuntu 9.2-0ubuntu1~20.04.1) 9.2 Copyright (C) 2020 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /home/peerplays/src/peerplays/build/programs/witness_node/witness_node... [New LWP 15] [New LWP 8] [New LWP 14] [New LWP 9] [New LWP 16] [New LWP 1] [New LWP 10] [New LWP 7] [New LWP 17] [New LWP 12] [New LWP 11] [New LWP 18] [New LWP 13] [New LWP 19] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `./witness_node -d ./witness_node_data_dir --replay-blockchain'. Program terminated with signal SIGSEGV, Segmentation fault. #0 __GI_abort () at abort.c:107 107 abort.c: No such file or directory. [Current thread is 1 (Thread 0x7f0b207fd700 (LWP 15))] (gdb) backtrace #0 __GI_abort () at abort.c:107 #1 0x00007f0b495c6729 in __assert_fail_base (fmt=0x7f0b4975c588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x563bf39fd198 "_closing_connections.find(peer_to_delete) == _closing_connections.end()", file=0x563bf39fb728 "/home/peerplays/src/peerplays/libraries/net/node.cpp", line=1654, function=<optimized out>) at assert.c:92 #2 0x00007f0b495d7fd6 in __GI___assert_fail (assertion=0x563bf39fd198 "_closing_connections.find(peer_to_delete) == _closing_connections.end()", file=0x563bf39fb728 "/home/peerplays/src/peerplays/libraries/net/node.cpp", line=1654, function=0x563bf39fd0a0 "void graphene::net::detail::node_impl::schedule_peer_for_deletion(const peer_connection_ptr&)") at assert.c:101 #3 0x0000563bf1e3435c in graphene::net::detail::node_impl::schedule_peer_for_deletion (this=0x563bf6ae1a30, peer_to_delete=std::shared_ptr<class graphene::net::peer_connection> (use count 5, weak count 2) = {...}) at /home/peerplays/src/peerplays/libraries/net/node.cpp:1654 #4 0x0000563bf1e518e7 in graphene::net::detail::node_impl::on_connection_closed (this=0x563bf6ae1a30, originating_peer=0x7f0b18318a00) at /home/peerplays/src/peerplays/libraries/net/node.cpp:3106 #5 0x0000563bf1f9ef92 in graphene::net::peer_connection::on_connection_closed (this=0x7f0b18318a00, originating_connection=0x7f0b18318a30) at /home/peerplays/src/peerplays/libraries/net/peer_connection.cpp:283 #6 0x0000563bf1fa5a87 in graphene::net::detail::message_oriented_connection_impl::read_loop (this=0x563bf5be68a0) at /home/peerplays/src/peerplays/libraries/net/message_oriented_connection.cpp:241 #7 0x0000563bf1fa539d in graphene::net::detail::message_oriented_connection_impl::<lambda()>::operator()(void) const (__closure=0x7f0b183188f8) at /home/peerplays/src/peerplays/libraries/net/message_oriented_connection.cpp:134 #8 0x0000563bf1faad7a in fc::detail::void_functor_run<graphene::net::detail::message_oriented_connection_impl::connect_to(const fc::ip::endpoint&)::<lambda()> >::run(void *, void *) (functor=0x7f0b183188f8, prom=0x7f0b183188f0) at /home/peerplays/src/peerplays/libraries/fc/include/fc/thread/task.hpp:83 #9 0x0000563bf330028a in fc::task_base::run_impl (this=0x7f0b18318900) at /home/peerplays/src/peerplays/libraries/fc/src/thread/task.cpp:43 #10 0x0000563bf3300206 in fc::task_base::run (this=0x7f0b18318900) at /home/peerplays/src/peerplays/libraries/fc/src/thread/task.cpp:32 #11 0x0000563bf32f1db4 in fc::thread_d::run_next_task (this=0x7f0b18000b60) at /home/peerplays/src/peerplays/libraries/fc/src/thread/thread_d.hpp:520 #12 0x0000563bf32f2163 in fc::thread_d::process_tasks (this=0x7f0b18000b60) at /home/peerplays/src/peerplays/libraries/fc/src/thread/thread_d.hpp:568 #13 0x0000563bf32f1733 in fc::thread_d::start_process_tasks (my=...) at /home/peerplays/src/peerplays/libraries/fc/src/thread/thread_d.hpp:499 #14 0x0000563bf3566c4f in make_fcontext () #15 0x0000000000000000 in ?? () (gdb) ```
prandnum commented 2022-12-23 09:54:12 +00:00 (Migrated from gitlab.com)
Copy link

@milo_peerplays is this still being worked on? should we change the label back to pending?

@milo_peerplays is this still being worked on? should we change the label back to pending?
milo_peerplays commented 2022-12-23 17:07:58 +00:00 (Migrated from gitlab.com)
Copy link

I am currently focusing on "Invalid SON number" issue. I will come back to this topic as soon as the first one is solved.

I am currently focusing on "Invalid SON number" issue. I will come back to this topic as soon as the first one is solved.
serkixenos commented 2023-02-10 17:57:22 +00:00 (Migrated from gitlab.com)
Copy link

unassigned @prandnum and @wsalloum

unassigned @prandnum and @wsalloum
serkixenos commented 2023-02-10 17:57:46 +00:00 (Migrated from gitlab.com)
Copy link

cc: @milo_peerplays

cc: @milo_peerplays
vampik commented 2023-03-14 12:34:58 +00:00 (Migrated from gitlab.com)
Copy link

assigned to @vampik

assigned to @vampik
vampik commented 2023-03-20 11:46:30 +00:00 (Migrated from gitlab.com)
Copy link

The son takeover is working. The same issue with crashed is in new ticket: https://gitlab.com/PBSA/peerplays/-/issues/501

The son takeover is working. The same issue with crashed is in new ticket: https://gitlab.com/PBSA/peerplays/-/issues/501
vampik (Migrated from gitlab.com) closed this issue 2023-03-20 11:47:08 +00:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
feature/579-enable-hardfork-check
develop
beatrice
feature/577-sidechain-plugin
hotfix/bookie2024
feature/568-static-libbitcoin
567-update-dockerfile
docs/readme-build-subdirectory
local_dev_subscribe_address
feature/release-automation-changelogs
feature/remove-image-e2e-tests
feature/installer-script
local_dev_manual_zmq_socet
local_test_block_events
develop-clang17-wip
feature/python-e2e-tests
bug/501-on_connection_closed
bug/513-num_son_init
bug/513-num_son_extension
docker-build-fix
libbitcoin-build-dependencies-cicd
feature/cicd-deployments-and-upgrades
feature/limit-NFT-objs-returned
sonarcloud-coverage
bug/api-doc-generation-hotfix
test/hot-fix-hardfork-changed
mint-testnet-sidechain-address-fix
hotfix/sidechain-address
feature/limits-for-nft_get_all_tokens
debug-transaction-signing
feature/libbitcoin-son
revert-1a160275
revert-f7aab6a8
peerup-clang14-new
feature/son-for-ethereum
peerup-clang14
feature/420-ethereum-unit-tests
bug/issue416_corrected
bug/issue-416
cicd-test
test/enable_disconnect_non_compatible_witness_nodes
395-verify-delayed_node-plugin
431-verify-debug_witness-plugin
461-handle-boost-system-system_error-exception
local_enable_logs_for_irona
merge-develop-to-beatrice-2022-06
bug/378/fix_for_restarting_node_without_replay_option
feature/368/implement_the_witness_capability_to_overwrite_last_hardfork
bug/issue317
issue317-traces
dapp-support
feature/274/redirect_transaction_fees_to_dividends
bug/issue34
bug/issue229
bug-235-update-2
Feature-Enable-parallel-build-testnet-mainnet-cmake
231-docker-with-artifacts
325-refactor-importing-btc-addresses-into-son-wallet
bug/235-stop_corrupts_chain_file-1
bug/empty-json-parsing-failure-2
bug/failure-on-son-related-test-1
bug/issue50
230-docker-image-from-ci-should-be-pushed-to-gitlab-registry-2
bug/issue-50-4
bug/issue50-trace-tid
bug/issue-50-2
bug/issue-50-3
bug/94-docker-build
bug/issue-50
bug/empty-json-parsing-failure
bug/rpc-client-crashes-on-empty-response
bug_fix_warnings
feature/all-in-one-build
feature/cli-activate-deregistered-son
hotfix/fix-sidechain-address-generation
revert-b875f0b8
hotfix/fix-memo-field-encryption
issue/son-for-hive-rpc-connection
hotfix/fix-plugin-cli-option
bug/35-blockchain_replay
merge-beatrice-to-master-2021-11
feature/son-for-hive
feature/son-for-hive-https-support
revert-b806eb85
feature/rel-mainnet-jul21
feature/mainnet-release-jul21
feature/reserve-tokens
feature/beatrice-changes-to-develop
feature/testnet-release-jun2021
feature/add-cliwallet-version
feature/son-wrong-weights
support/sonarcloud
feature/add-get-blocks
feature/sidechain-throttling
63-doc-son-docker-mainnet
issue/dex-crash
feature/port-dex-fixes
feature/hf-btc-flags-change
hotfix/build-warnings-210210
hotfix/master-son-vb-checks
hotfix/check-vesting-balances-for-son
feature/nft_lottery
hotfix/master-hotfixes
hotfix/gitlab
support/ci
hotfix/fix-get-full-accounts
feature/flush-db-during-replay
feature/cli-change-account-keys
feature/gpos-vesting-performance-decay-test
bugfix/374
hotfix/fix-witness-sons-multiple-ids-reading
feature/es-improvements
hotfix/cli-buy-sell-fix
merge_beatrice_to_develop_202012
merge_beatrice_to_master_202012
merge/master-to-beatrice-20201203
tests/code-coverage
feature/build-optimizations
hotfix/build-executables
merge/beatrice2develop
feature/sync-fc-OCT
hotfix/remove_fc_smart_ref
hotfix/remove_smart_ref
hotfix/remove_fc_smart_ref_develop
feature/api_limit_error_msg
hotfix/beatrice_compilation
feature/rl-editline
hotfix/release_build_fix_develop
hotfix/release_build_fix
feature/editline
hotfix/son_maxcount_fix
hotfix/son_fixes
hotfix/son_chain_params
merge/develop2beatrice
feature/SONs-base
feature/bts-210
feature/account_roles
issue375/public_key_type_fix
ws-updates
feature/rng
feature/beatrice_nft_merge
feature/marketplace
issue/mainnet_chain_halt_5050
issue/gpos_rolling_period_issue
issue/beatrice_chain_halt_gpos
feature/nft_market_rbac
feature/nft
feature/rbac
feature/GRPH-45
lottery_crash_reproduction
master_chain_halt_issue
son_deposit_address_enhancements
bitcoin_networktype_fix
SON-314
SON-363
SON-359
fix_tests
hotfix-rawtransaction
feature/SON-135
SON-215_SigningFix
issue_a_gitlab
SON-315
feature/SON-349
SON-BTCPxPlex-Tryouts
feature/SON-347
feature/SON-354
feature/SON-349_SON-350
feature/SON-353
beatrice_master_mar19
feature/SON-134-v4
feature/SON-333-gladcow
feature/beatrice_winner_id
feature/nh5050_winner_id
SON-337
SON-333-v2-sk
feature/SON-333-v2
feature/SON-348
feature/SON-346
feature/SON-344
feature/SON-341
feature/SON-325
feature/SON-320
feature/SON-322_SON-324
SON-291
SON-339
feature/SON-333
feature/SON-305
SON-297_SON-336
feature/SON-307
SON-313
feature/SON-134-alternate
son_account_fix_SON329
feature/SON-332
gitlab_test_clean_build
feature/SON-321_SON-323
feature/SON-288-update
feature/SON-271
feature/SON-311
SON-318_SON-319
feature/SON-312
feature/SON-304
feature/SON-295
SON-122
revert-312-sons_gpos_merge_mar19
SON-24
feature/SON-134
sons_gpos_merge_mar19
sons_gpos_merge_mar18
sons_gpos_merge_mar2
SON127
release/1.5.02
feature/SON-49
SON276
SON275
sync_fc_beatrice
plugins_enable_fix1
SON202_Update
SON118_Add_tx_metrics
feature/SON-270
SON269
SON200_Fix
es_update1
GRPH-160/fix
sync_fc_dev
feature/SON-264
SON261
feature/SON-260
feature/SON-242
unit_test_fixes
feature/SON-209-add
feature/SON-209
feature/SON-238
feature/snapshot
feature/GRPH-155
feature/GRPH-163
updates_from_mainnet
SON131
issue_github_277
2020_1_sync_fix
mainnet-sync-fix
mainet-sync
feature/SON-231
feature/SON-202-fix
SON214
feature/SON-98
SON233
SON232
SON165
SON206_Plugin_CrashFix_Reorg
GPOS-66
feature/SON-214
SON199-TestFailureFix
pbattu123-patch-1
feature/SON-202
feature/GRPH-205
support/gitlab-SONs-base
SON217
SON212_SON213_BuildError
SON212
SON206
SON194
sync-develop
hf-update
feature/SON-208
GPOS-1
beatrice_hf_1.4.1
SON207
feature/SON-203
GRPH-170
feature/GRPH-166
feature/SON-205
feature/BLOCKBACK-186-Bug-Fix
feature/GRPH-169
SON193
BLOCKBACK-186
feature/GRPH-152
BLOCKBACK-183
BLOCKCBACK-187
BLOCKBACK-187
feature/GRPH-168
feature/GRPH-167
feature/SON-196
203
feature/SON-195
feature/SON-158
GRPH-46
feature/GRPH-92
feature/GRPH-162
GRPH-159
feature/GRPH-160
update-submodule
BLOCKBACK-181
feature/BLOCKBACK-182
feature/GRPH-49-test-case
support/gitlab-develop
BLOCKBACK-177
GRPH-81
SON130
feature/GRPH-150
feature/SON-167
feature/SON-150
fc-commit-update
GRPH134
feature/GRPH-99
GRPH134_#198-HighCPU_Usage
qa_gpos_18.04
feature/BLOCKBACK-162
son_165
feature/SON-113-fix
feature/SON-160-fix
son_168
BLOCKBACK-155
feature/SON-142
BLOCKBACK-174
fix_flag
feature/BLOCKBACK-166
BLOCKBACK_164
feature/BLOCKBACK-165
SON126
feature/SON-113
BLOCKBACK-164
BLOCKBACK--164
oxarbitrage-patch-1
feature/SON-17
son_vesting
feature/GRPH-131
support/docker
SON118
feature/SON-115
son_wallet_clean
feature/GRPH-126
feature/GRPH-127
son_objects_operations
feature/SON-109
feature/SON-108
feature/SON-110
feature/SON-operations
feature/SON-137-GitModule-Update
feature/SON-83
feature/SON-107
feature/GRPH-2-GitModule-Update
jira-163-fix
153/fix-add-on
feature/GRPH-2-Git-Module-Update
feature/GRPH-79-Bug-Fix
feature/GRPH-3
feature/GRPH-117
gpos-testfix
feature/GRPH-90
feature/SON-84
feature/GRPH-114
feature/GRPH-95
118
feature/GRPH-112
issue/154-fix
GRPH-50-network_broadcast_api-fix-v2
BLOCKBACK-153
BLOCKBACK-154
feature/GRPH-94
feature/GRPH-111
feature/GRPH-83
feature/SON-5
feature/GRPH-93-v2
feature/GRPH-106
feature/GRPH-64
feature/GRPH-86
SON11
graphene-release1
GRPH-75
feature/GRPH-79
GRPH-73-fix-block-id-forks
feature/GRPH-88
pbsa-github-patch-1
feature/GRPH-80
feature/GRPH-93
feature/GRPH-87
feature/test-grph-3
feature/SON-83-plugins-option
GRPH-89
feature/SON-83-SON-plugin
support/gitlab-master
feature/SONs-base-build-1804
support/gitlab-beatrice
GRPH-4-update-submodule
feature/tweakes-README
GRPH-56-implement-tx-size-check-18.04
GRPH-56-implement-tx-size-check-master
github-issue-template1
support/gitlab
review-fixes
hardfork-50/50
cli_wallet_tests
rng_api
feature/GRPH-76
feature/GRPH-78
GRPH-59-Proposal-failure-handling
GRPH-71
feature/GRPH-61
feature/GRPH-77
issue-154
feature/GRPH-63
GRPH-3-cli-tests-18.04
GRPH-63-Authorize-Tx-Bug-18.04
GRPH-70
GRPH-51
pp_travis
WASM-49
GRPH-4
GRPH-53
feature/GRPH-54
GRPH-60
feature/GRPH-48
GRPH-48-Object-Database-18.04
GRPH-66
qa_gpos_18.04_gcc7_fix
GRPH-60-ProposalNestedRecursionGuard
GRPH-64-Variable-fix-18.04
GRPH-57-CompilerWarningFixesDBTests
GRPH-54-sign-transaction-fix-master
GRPH-54-sign-transaction-fix-18.04
qa_gpos_18.04_docker_img
GRPH-50-network_broadcast_api-fix
beatrice-5050-merge
Issue23-check-transaction-size
issue23-check-transaction-size
feature/5050
hotfix/readme
hotfix/readme-branch-from-gitlab
hotfix/docker
hotfix/docker-branch-from-gitlab
hotfix/unit-tests
hotfix/unit-tests-branch-from-gitlab
feature/manager-for-sports-and-underlying
feature-sidechain
1.6.1
1.6.0
1.5.25-beta
1.5.24-beta
1.5.23-beta
1.5.22-alpha
1.5.21-alpha
1.5.20-alpha
1.5.19
1.5.18
1.5.17
1.5.16
1.5.15
1.5.14
1.5.13
1.5.12
test-1.5.5
test-1.5.4
test-1.5.3
1.5.11
1.5.10
test-1.5.2
test-1.5.1
test-1.5.0
test-1.4.5
1.4.4
1.4.3
test-1.4.4
1.5.05
1.5.04
1.5.03
1.5.02
test-1.4.3
SON0.0.1
1.5.01
1.4.2
test-1.4.2
1.4.2-alpha
test-1.4.1
1.4.1-alpha
test-1.4.0
1.3.1
Ignore
1.3.0
1.2.0
1.1.0
1.0.0
Labels
Clear labels   
confirmed

   
DevOps

   
documentation

   
enhancement

   
incident

Denotes a disruption to IT services and the associated issues require immediate attention

  
Medium

   
priority::Critical

(optional) Issues that are marked as critical priority. Should be taken care of ASAP.

  
priority::High

(optional) Issues that are marked as high priority.

  
priority::Low

(optional) Issues that are marked as low priority.

  
priority::Medium

(optional) Issues that are marked as medium priority.

  
QA-TestCases::Done

QA-Labels

  
QA-TestCases::InProgress

QA-Labels

  
RNG

   
security

(optional) Issues that relate to the security of the project.

  
severity:: Critical

   
severity:: High

   
severity:: Low

   
severity:: Medium

   
state:: Accepted

Issues that are newly created and have been accepted after review.

  
state:: Blocked

Issues that cannot be worked on due to other factors linked to it.

  
state:: Done

Issues that are closed with a working solution.

  
state:: in progress

Issues that are currently being worked on.

  
state:: in review

Issues that require a proposed solution to be reviewed.

  
state:: on hold

Issues that were at least accepted, that should not be worked on at the moment.

  
state:: Pending

Issues that are newly created and haven't been reviewed.

  
state:: Pushed to Prod

Tickets are verified in the stage infra and needs to be deployed in the production

  
state:: Revision Needed

Issues that need to be revised before being accepted.

  
state::out-of-scope

Task and issues which are out of scope due to change in requirements

  
suggestion

   
support

   
To Do

   
type :: Discussion

   
type :: Duplicate

(optional) Issues that are duplicates of existing issues in the same project.

  
type:: interaction-design

   
type:: New Feature

Issues that bring new functionality to the project.

  
type::bug

BUG

  
type::documentation

Issues that relate to the documentation of the project.

  
type::incident

severe issues that require immediate response

  
type::maintenance

Issues that require maintenance on the project.

  
type::question

Issues that are questions related to the project.

  
type::recurring-tasks

This label is used to track recurring tasks which may repeat daily, weekly or monthly.

  
vulnerability
No labels
confirmed
DevOps
documentation
enhancement
incident
Medium
priority::Critical
priority::High
priority::Low
priority::Medium
QA-TestCases::Done
QA-TestCases::InProgress
RNG
security
severity:: Critical
severity:: High
severity:: Low
severity:: Medium
state:: Accepted
state:: Blocked
state:: Done
state:: in progress
state:: in review
state:: on hold
state:: Pending
state:: Pushed to Prod
state:: Revision Needed
state::out-of-scope
suggestion
support
To Do
type :: Discussion
type :: Duplicate
type:: interaction-design
type:: New Feature
type::bug
type::documentation
type::incident
type::maintenance
type::question
type::recurring-tasks
vulnerability
Milestone
Clear milestone
No items
No milestone
Peerplays Improvements and Bugfixes 2023-03
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Peerplays_Blockchain/peerplays_migrated#433
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?