witness node crashed with "No route to host" error #465

Closed
opened 2022-10-19 18:42:22 +00:00 by prandnum · 4 comments
prandnum commented 2022-10-19 18:42:22 +00:00 (Migrated from gitlab.com)

Using "peerplays-utils" master branch and peerplays "feature/libbitcoin-son-final" branch. Also edited the config files to set
ethereum-wallet-contract-address: 0x572eA65762bFFf521C11Ce5334FfaaF4bDD4974e

Steps:

  1. docker-compose build
  2. docker-compose up bitcoin-for-peerplays
  3. docker exec -it peerplays-qa-environment_bitcoin-for-peerplays_1 /bin/bash
  4. ./init-network.sh
  5. docker-compose up libbitcoinserver-for-peerplays
  6. docker-compose up hive-for-peerplays
  7. ./init-network.sh
  8. docker-compose up peerplays-all-in-one

Issue Seen:
When peerplays-all-in-one is started it fails with no route to host error

kiran@warpspeed:/home$ sudo coredumpctl debug 334240
           PID: 334240 (witness_node)
           UID: 0 (root)
           GID: 0 (root)
        Signal: 11 (SEGV)
     Timestamp: Wed 2022-10-19 23:54:05 IST (5min ago)
  Command Line: ./witness_node -d ./witness_node_data_dir --replay-blockchain
    Executable: /home/peerplays/src/peerplays/build/programs/witness_node/witness_node
 Control Group: /docker/9250c506a8ff5bd844f6853a69a8170d67f4d98f5277605e492c3dbf412d9a6e
         Slice: -.slice
       Boot ID: 8b7e83aa7f3f46889775d32abce9a3c8
    Machine ID: a388625228614d18b5373ad1be39a93f
      Hostname: warpspeed
       Storage: /var/lib/systemd/coredump/core.witness_node.0.8b7e83aa7f3f46889775d32abce9a3c8.334240.1666203845000000000000.lz4
       Message: Process 334240 (witness_node) of user 0 dumped core.
                
                Stack trace of thread 1:
                #0  0x00007f48a0da3941 __GI_abort (libc.so.6 + 0x22941)
                #1  0x00007f48a117b911 n/a (libstdc++.so.6 + 0x9e911)
                #2  0x00007f48a118738c n/a (libstdc++.so.6 + 0xaa38c)
                #3  0x00007f48a11873f7 _ZSt9terminatev (libstdc++.so.6 + 0xaa3f7)
                #4  0x00007f48a11876a9 __cxa_throw (libstdc++.so.6 + 0xaa6a9)
                #5  0x00005644269fdbaa n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55e9baa)
                #6  0x00005644269edd8b n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d9d8b)
                #7  0x00005644269edbb4 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d9bb4)
                #8  0x0000564426a065fa n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55f25fa)
                #9  0x0000564426a013dd n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55ed3dd)
                #10 0x00005644269ebd3a n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d7d3a)
                #11 0x00005644269eac67 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d6c67)
                #12 0x00005644262db746 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4ec7746)
                #13 0x00005644262dba85 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4ec7a85)
                #14 0x00005644262dd654 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4ec9654)
                #15 0x00005644262598fb n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4e458fb)
                #16 0x000056442621da4e n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4e09a4e)
                #17 0x0000564426227115 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4e13115)
                #18 0x0000564425cab685 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4897685)
                #19 0x0000564425c7ca63 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4868a63)
                #20 0x00007f48a0da5083 __libc_start_main (libc.so.6 + 0x24083)
                #21 0x0000564425c7b55e n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x486755e)

GNU gdb (Ubuntu 9.2-0ubuntu1~20.04.1) 9.2
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /home/peerplays/src/peerplays/build/programs/witness_node/witness_node...
[New LWP 1]
[New LWP 7]
[New LWP 12]
[New LWP 10]
[New LWP 8]
[New LWP 14]
[New LWP 11]
[New LWP 15]
[New LWP 17]
[New LWP 16]
[New LWP 13]
[New LWP 18]
[New LWP 19]
[New LWP 9]
[New LWP 20]

warning: Could not load shared library symbols for 11 libraries, e.g. /usr/local/lib/libbitcoin-system.so.0.
Use the "info sharedlibrary" command to see the complete listing.
Do you need "set solib-search-path" or "set sysroot"?
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `./witness_node -d ./witness_node_data_dir --replay-blockchain'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  __GI_abort () at abort.c:107
107	abort.c: No such file or directory.
[Current thread is 1 (Thread 0x7f489d5bf0c0 (LWP 1))]
(gdb) bt
#0  __GI_abort () at abort.c:107
#1  0x00007f48a117b911 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#2  0x00007f48a118738c in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#3  0x00007f48a11873f7 in std::terminate() () from /lib/x86_64-linux-gnu/libstdc++.so.6
#4  0x00007f48a11876a9 in __cxa_throw () from /lib/x86_64-linux-gnu/libstdc++.so.6
#5  0x00005644269fdbaa in boost::throw_exception<boost::system::system_error> (e=...) at /usr/local/include/boost/throw_exception.hpp:70
#6  0x00005644269edd8b in boost::asio::detail::do_throw_error (err=..., location=0x5644286f43cc "connect") at /usr/local/include/boost/asio/detail/impl/throw_error.ipp:38
#7  0x00005644269edbb4 in boost::asio::detail::throw_error (err=..., location=0x5644286f43cc "connect") at /usr/local/include/boost/asio/detail/throw_error.hpp:42
#8  0x0000564426a065fa in boost::asio::connect<boost::asio::ip::tcp, boost::asio::executor, boost::asio::ip::basic_resolver_results<boost::asio::ip::tcp> > (s=..., 
    endpoints=...) at /usr/local/include/boost/asio/impl/connect.hpp:113
#9  0x0000564426a013dd in boost::beast::basic_stream<boost::asio::ip::tcp, boost::asio::executor, boost::beast::unlimited_rate_policy>::connect<boost::asio::ip::basic_resolver_results<boost::asio::ip::tcp>, void> (this=0x7ffdfd56bdc0, endpoints=...) at /usr/local/include/boost/beast/core/basic_stream.hpp:596
#10 0x00005644269ebd3a in graphene::peerplays_sidechain::rpc_client::send_post_request (this=0x564429dc0600, 
    body="{ \"jsonrpc\": \"2.0\", \"id\": 1, \"method\": \"net_version\" }", show_log=false)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/common/rpc_client.cpp:166
#11 0x00005644269eac67 in graphene::peerplays_sidechain::rpc_client::send_post_request (this=0x564429dc0600, method="net_version", params="", show_log=false)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/common/rpc_client.cpp:121
#12 0x00005644262db746 in graphene::peerplays_sidechain::ethereum_rpc_client::net_version[abi:cxx11]() (this=0x564429dc0600)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_ethereum.cpp:47
#13 0x00005644262dba85 in graphene::peerplays_sidechain::ethereum_rpc_client::get_chain_id[abi:cxx11]() (this=0x564429dc0600)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_ethereum.cpp:59
#14 0x00005644262dd654 in graphene::peerplays_sidechain::sidechain_net_handler_ethereum::sidechain_net_handler_ethereum (this=0x564429dbea80, _plugin=..., options=...)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_ethereum.cpp:141
#15 0x00005644262598fb in graphene::peerplays_sidechain::sidechain_net_handler_factory::create_handler (this=0x7ffdfd56cd28, 
    sidechain=graphene::chain::sidechain_type::ethereum, options=...)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_factory.cpp:23
#16 0x000056442621da4e in graphene::peerplays_sidechain::detail::peerplays_sidechain_plugin_impl::plugin_startup (this=0x564429d45360)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/peerplays_sidechain_plugin.cpp:312
#17 0x0000564426227115 in graphene::peerplays_sidechain::peerplays_sidechain_plugin::plugin_startup (this=0x564429d44f10)
    at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/peerplays_sidechain_plugin.cpp:876
#18 0x0000564425cab685 in graphene::app::application::startup_plugins (this=0x564429d07c90) at /home/peerplays/src/peerplays/libraries/app/application.cpp:1015
#19 0x0000564425c7ca63 in main (argc=4, argv=0x7ffdfd56d628) at /home/peerplays/src/peerplays/programs/witness_node/main.cpp:159
(gdb) 

config files attached.
peerplays-utils.zip

Using "peerplays-utils" master branch and peerplays "feature/libbitcoin-son-final" branch. Also edited the config files to set ethereum-wallet-contract-address: 0x572eA65762bFFf521C11Ce5334FfaaF4bDD4974e Steps: 1. docker-compose build 2. docker-compose up bitcoin-for-peerplays 3. docker exec -it peerplays-qa-environment_bitcoin-for-peerplays_1 /bin/bash 3. ./init-network.sh 3. docker-compose up libbitcoinserver-for-peerplays 4. docker-compose up hive-for-peerplays 5. ./init-network.sh 6. docker-compose up peerplays-all-in-one Issue Seen: When peerplays-all-in-one is started it fails with no route to host error ``` kiran@warpspeed:/home$ sudo coredumpctl debug 334240 PID: 334240 (witness_node) UID: 0 (root) GID: 0 (root) Signal: 11 (SEGV) Timestamp: Wed 2022-10-19 23:54:05 IST (5min ago) Command Line: ./witness_node -d ./witness_node_data_dir --replay-blockchain Executable: /home/peerplays/src/peerplays/build/programs/witness_node/witness_node Control Group: /docker/9250c506a8ff5bd844f6853a69a8170d67f4d98f5277605e492c3dbf412d9a6e Slice: -.slice Boot ID: 8b7e83aa7f3f46889775d32abce9a3c8 Machine ID: a388625228614d18b5373ad1be39a93f Hostname: warpspeed Storage: /var/lib/systemd/coredump/core.witness_node.0.8b7e83aa7f3f46889775d32abce9a3c8.334240.1666203845000000000000.lz4 Message: Process 334240 (witness_node) of user 0 dumped core. Stack trace of thread 1: #0 0x00007f48a0da3941 __GI_abort (libc.so.6 + 0x22941) #1 0x00007f48a117b911 n/a (libstdc++.so.6 + 0x9e911) #2 0x00007f48a118738c n/a (libstdc++.so.6 + 0xaa38c) #3 0x00007f48a11873f7 _ZSt9terminatev (libstdc++.so.6 + 0xaa3f7) #4 0x00007f48a11876a9 __cxa_throw (libstdc++.so.6 + 0xaa6a9) #5 0x00005644269fdbaa n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55e9baa) #6 0x00005644269edd8b n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d9d8b) #7 0x00005644269edbb4 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d9bb4) #8 0x0000564426a065fa n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55f25fa) #9 0x0000564426a013dd n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55ed3dd) #10 0x00005644269ebd3a n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d7d3a) #11 0x00005644269eac67 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x55d6c67) #12 0x00005644262db746 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4ec7746) #13 0x00005644262dba85 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4ec7a85) #14 0x00005644262dd654 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4ec9654) #15 0x00005644262598fb n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4e458fb) #16 0x000056442621da4e n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4e09a4e) #17 0x0000564426227115 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4e13115) #18 0x0000564425cab685 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4897685) #19 0x0000564425c7ca63 n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x4868a63) #20 0x00007f48a0da5083 __libc_start_main (libc.so.6 + 0x24083) #21 0x0000564425c7b55e n/a (/home/peerplays/src/peerplays/build/programs/witness_node/witness_node + 0x486755e) GNU gdb (Ubuntu 9.2-0ubuntu1~20.04.1) 9.2 Copyright (C) 2020 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /home/peerplays/src/peerplays/build/programs/witness_node/witness_node... [New LWP 1] [New LWP 7] [New LWP 12] [New LWP 10] [New LWP 8] [New LWP 14] [New LWP 11] [New LWP 15] [New LWP 17] [New LWP 16] [New LWP 13] [New LWP 18] [New LWP 19] [New LWP 9] [New LWP 20] warning: Could not load shared library symbols for 11 libraries, e.g. /usr/local/lib/libbitcoin-system.so.0. Use the "info sharedlibrary" command to see the complete listing. Do you need "set solib-search-path" or "set sysroot"? [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `./witness_node -d ./witness_node_data_dir --replay-blockchain'. Program terminated with signal SIGSEGV, Segmentation fault. #0 __GI_abort () at abort.c:107 107 abort.c: No such file or directory. [Current thread is 1 (Thread 0x7f489d5bf0c0 (LWP 1))] (gdb) bt #0 __GI_abort () at abort.c:107 #1 0x00007f48a117b911 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #2 0x00007f48a118738c in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #3 0x00007f48a11873f7 in std::terminate() () from /lib/x86_64-linux-gnu/libstdc++.so.6 #4 0x00007f48a11876a9 in __cxa_throw () from /lib/x86_64-linux-gnu/libstdc++.so.6 #5 0x00005644269fdbaa in boost::throw_exception<boost::system::system_error> (e=...) at /usr/local/include/boost/throw_exception.hpp:70 #6 0x00005644269edd8b in boost::asio::detail::do_throw_error (err=..., location=0x5644286f43cc "connect") at /usr/local/include/boost/asio/detail/impl/throw_error.ipp:38 #7 0x00005644269edbb4 in boost::asio::detail::throw_error (err=..., location=0x5644286f43cc "connect") at /usr/local/include/boost/asio/detail/throw_error.hpp:42 #8 0x0000564426a065fa in boost::asio::connect<boost::asio::ip::tcp, boost::asio::executor, boost::asio::ip::basic_resolver_results<boost::asio::ip::tcp> > (s=..., endpoints=...) at /usr/local/include/boost/asio/impl/connect.hpp:113 #9 0x0000564426a013dd in boost::beast::basic_stream<boost::asio::ip::tcp, boost::asio::executor, boost::beast::unlimited_rate_policy>::connect<boost::asio::ip::basic_resolver_results<boost::asio::ip::tcp>, void> (this=0x7ffdfd56bdc0, endpoints=...) at /usr/local/include/boost/beast/core/basic_stream.hpp:596 #10 0x00005644269ebd3a in graphene::peerplays_sidechain::rpc_client::send_post_request (this=0x564429dc0600, body="{ \"jsonrpc\": \"2.0\", \"id\": 1, \"method\": \"net_version\" }", show_log=false) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/common/rpc_client.cpp:166 #11 0x00005644269eac67 in graphene::peerplays_sidechain::rpc_client::send_post_request (this=0x564429dc0600, method="net_version", params="", show_log=false) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/common/rpc_client.cpp:121 #12 0x00005644262db746 in graphene::peerplays_sidechain::ethereum_rpc_client::net_version[abi:cxx11]() (this=0x564429dc0600) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_ethereum.cpp:47 #13 0x00005644262dba85 in graphene::peerplays_sidechain::ethereum_rpc_client::get_chain_id[abi:cxx11]() (this=0x564429dc0600) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_ethereum.cpp:59 #14 0x00005644262dd654 in graphene::peerplays_sidechain::sidechain_net_handler_ethereum::sidechain_net_handler_ethereum (this=0x564429dbea80, _plugin=..., options=...) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_ethereum.cpp:141 #15 0x00005644262598fb in graphene::peerplays_sidechain::sidechain_net_handler_factory::create_handler (this=0x7ffdfd56cd28, sidechain=graphene::chain::sidechain_type::ethereum, options=...) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/sidechain_net_handler_factory.cpp:23 #16 0x000056442621da4e in graphene::peerplays_sidechain::detail::peerplays_sidechain_plugin_impl::plugin_startup (this=0x564429d45360) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/peerplays_sidechain_plugin.cpp:312 #17 0x0000564426227115 in graphene::peerplays_sidechain::peerplays_sidechain_plugin::plugin_startup (this=0x564429d44f10) at /home/peerplays/src/peerplays/libraries/plugins/peerplays_sidechain/peerplays_sidechain_plugin.cpp:876 #18 0x0000564425cab685 in graphene::app::application::startup_plugins (this=0x564429d07c90) at /home/peerplays/src/peerplays/libraries/app/application.cpp:1015 #19 0x0000564425c7ca63 in main (argc=4, argv=0x7ffdfd56d628) at /home/peerplays/src/peerplays/programs/witness_node/main.cpp:159 (gdb) ``` config files attached. [peerplays-utils.zip](/uploads/7fa0e07a447ad3b85e25a7952d0a6150/peerplays-utils.zip)
prandnum commented 2022-10-19 18:42:43 +00:00 (Migrated from gitlab.com)

@serkixenos @bobinson
CC: @tai.sama

@serkixenos @bobinson CC: @tai.sama
prandnum commented 2022-10-19 18:54:43 +00:00 (Migrated from gitlab.com)

mentioned in issue #464

mentioned in issue #464
serkixenos commented 2022-10-19 20:53:42 +00:00 (Migrated from gitlab.com)

@prandnum Is this a duplicate of https://gitlab.com/PBSA/peerplays/-/issues/461

@prandnum Is this a duplicate of https://gitlab.com/PBSA/peerplays/-/issues/461
prandnum commented 2022-10-20 15:17:57 +00:00 (Migrated from gitlab.com)

@serkixenos yes it is. Closing this.

@serkixenos yes it is. Closing this.
prandnum (Migrated from gitlab.com) closed this issue 2022-10-20 15:17:59 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Peerplays_Blockchain/peerplays_migrated#465
No description provided.