peerplays_migrated/libraries/egenesis/embed_genesis.cpp
gladcow 499e318199 [SON-107] Merge develop branch to SONs-base (#166)
* fix rng and get_winner_numbers implemented

* coipied code for bitshares fixing 429 and 433 isuues

* ticket_purchase_operation implemented. added lottery_options to asset

* lottery end implemented

* minor logic changes. added db_api and cli_wallet methods

* fix reindex on peerplays network

* fix some tests. add gitlab-ci.yml

* add pull to gitlab-ci

* fix

* fix and comment some tests

* added owner to lottery_asset_options. commented async call in on_applied_block callback

* added get_account_lotteries method to db_api and cli, lottery end_date and ticket_price verification

* merge get_account_lotteries branch. fix create_witness test

* fix test genesis and end_date verification

* fixed indices sorting and lottery end checking by date

* update db_version for replay and removed duplicate include files

* Added ntp and upgraded boost version

* Revert "GPOS protocol"

* need to remove backup files

* virtual-op-fix for deterministic virtual_op number

* Merged beatrice into 5050

* Updated gitmodules, changes to allow voting on lottery fee

* Removed submodule libraries/fc

* Added libraries/fc

* added missing , in types.hpp

* Added sweeps parameters to parameter_extension

* added missing comma in operations.hpp, small changes to config.hpp

* fixed returntype in chain_parameters.hpp

* removed sweeps_parameter_extensions

* Changed fc library

* fixed asset_object

* Changed peerplays-fc submodule

* Changed fc submodule to ubuntu 18.04 upgrade

* Removed submodule libraries/fc

* Added fc library back

* fix casting in overloaded function

* Removed blind_sign and unblind_signature functions

* Added new lottery_asset_create_operation

* Changed sweeps hardfork time

* Removed redundant if from asset_evaluator and fixed db_notify

* fixed duplicate code in fee_tests

* removed redundant tgenesis file

* Enable building on Ubuntu 18.04 using GCC 7 compiler

* fix: is_benefactor_reward had the default value of true when not set

* Docker file for Ubuntu 18.04

Base image updated to Unbuntu 18.04
Prerequisite list updated
Basic configuration updated

* Quick fix: Added missing package pkg-config

* Docker file updates

* 5050 fee update and compilation error fix

* Dockerfile, set system locale

Prevents locale::facet::_S_create_c_locale name error

* Update README.md

Fix typo

* Update README.md

* Changed hardfork time for SWEEPS and Core-429

* revert master changes that were brought in previous commit

* Fixed error when account_history_object with id 0 doesnt exist

* Fixed error while loading object database

* test for zero id object in account history

* Reorder operations in Dockerfile, to make image creation faster

- Reorder prevents unnecessary building of Boost libraries

* Fix for irrelevant signature included issue

* fix copyrigth messages order

* remove double empty lines

* Backport fix for `get_account_history` from https://github.com/bitshares/bitshares-core/pull/628 and add additional account history test case

* NTP client back

* GRPH-53-Log_format_error

* Merge pull request #1036 from jmjatlanta/issue_730

Add fail_reason to proposal_object

* Unit test case fixes and prepared SONs base

* Use offsetof instead of custom macro

* Hide some compiler warnings

* Make all the tests compile

* Add nullptr check in api.cpp for easier testing

* Add test case for broadcast_trx_with_callback API

* Unit test case fixes and prepared SONs base

* Merge pull request #714 from pmconrad/json_fix

JSON fix

* Increase max depth for trx confirmation callback

* Adapt to variant API with `max_depth` argument

* Update fc submodule

* Created unit test for #325

* remove needless find()

* GRPH-4-CliWallet_crash_ctrlD

* fix copyright message

* Make all the tests compile

* increase delay for node connection

* Increase block creation timeout to 2500ms

* remove cache from cli get_account

* add cli tests framework

* Adjust newly merged code to new API

* Improved resilience of block database against corruption

* Merged changes from Bitshares PR 1036

* GRPH-76 - Short-cut long sequences of missed blocks

Fixes database::update_global_dynamic_data to speed up counting missed blocks.
(This also fixes a minor issue with counting - the previous algorithm would skip missed blocks for the witness who signed the first block after the gap.)

* Moved reindex logic into database / chain_database, make use of additional blocks in block_database

Fixed tests wrt db.open

* Enable undo + fork database for final blocks in a replay

Dont remove blocks from block db when popping blocks, handle edge case in replay wrt fork_db, adapted unit tests

* Log starting block number of replay

* Prevent unsigned integer underflow

* Fixed lock detection

* Dont leave _data_dir empty if db is locked

* Writing the object_database is now almost atomic

* Improved consistency check for block_log

* Cut back block_log index file if inconsistent

* Fixed undo_database

* Added test case for broken merge on empty undo_db

* Merge pull request #938 from bitshares/fix-block-storing

Store correct block ID when switching forks

* exclude second undo_db.enable() call in some cases

* Add missing change

* change bitshares to core in message

* Fixed integer overflow issue

* Fix for for history ID mismatch ( Bitshares PR #875 )

* Update the FC submodule with the changes for GRPH-4

* Fix #436 object_database created outside of witness data directory

* supplement more comments on database::_opened variable

* prevent segfault when destructing application obj

* Fixed duplicate ops returned from get_account_history

* minor performance improvement

* Added comment

* Merged Bitshares PR #1462 and compilation fixes

* Support/gitlab (#123)

* Updated gitlab process

* Fix undefined references in cli test

* Fixed test failures and compilation issue

* Fixed account_history_pagination test

* Fix compilation in debug mode

* Removed unrelated comment

* Skip auth check when pushing self-generated blocks

* Extract public keys before pushing a transaction

* Dereference chain_database shared_ptr

* Updated transaction::signees to mutable

and
* updated get_signature_keys() to return a const reference,
* get_signature_keys() will update signees on first call,
* modified test cases and wallet.cpp accordingly,
* no longer construct a new signed_transaction object before pushing

* Added get_asset_count API

* Allow sufficient space for new undo_session

* Throw for deep nesting

* No longer extract public keys before pushing a trx

and removed unused new added constructor and _get_signature_keys() function from signed_transaction struct

* Added cli_test to CI

* use random port numbers in app_test (#154)

* proposal fail_reason bug fixed (#157)

* Added Sonarcloud code_quality to CI (#159)

* Added sonarcloud analysis (#158)

* fix for lottery end

* fix declarations

* fix declarations

* fix boost integer

* fix compilation

* fix chain tests

* fix app_test

* try to fix cli test

* fix incorrect max_depth param

* working cli test

* correct fc version
2019-10-08 06:55:03 +05:30

297 lines
11 KiB
C++

/*
* Copyright (c) 2015 Cryptonomex, Inc., and contributors.
*
* The MIT License
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
* in the Software without restriction, including without limitation the rights
* to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
* copies of the Software, and to permit persons to whom the Software is
* furnished to do so, subject to the following conditions:
*
* The above copyright notice and this permission notice shall be included in
* all copies or substantial portions of the Software.
*
* THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
* IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
* FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
* AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
* LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
* OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
* THE SOFTWARE.
*/
#include <cstdlib>
#include <iostream>
#include <string>
#include <boost/filesystem.hpp>
#include <boost/program_options.hpp>
#include <boost/algorithm/string.hpp>
#include <fc/filesystem.hpp>
#include <fc/smart_ref_impl.hpp> // required for gcc in release mode
#include <fc/string.hpp>
#include <fc/io/fstream.hpp>
#include <fc/io/json.hpp>
#include <graphene/chain/genesis_state.hpp>
#include <graphene/chain/protocol/types.hpp>
// we need to include the world in order to serialize fee_parameters
#include <graphene/chain/protocol/fee_schedule.hpp>
using namespace graphene::chain;
static const char generated_file_banner[] =
"// _ _ __ _ _ //\n"
"// | | | | / _(_) | //\n"
"// __ _ ___ _ __ ___ _ __ __ _| |_ ___ __| | | |_ _| | ___ //\n"
"// / _` |/ _ \\ '_ \\ / _ \\ '__/ _` | __/ _ \\/ _` | | _| | |/ _ \\ //\n"
"// | (_| | __/ | | | __/ | | (_| | || __/ (_| | | | | | | __/ //\n"
"// \\__, |\\___|_| |_|\\___|_| \\__,_|\\__\\___|\\__,_| |_| |_|_|\\___| //\n"
"// __/ | //\n"
"// |___/ //\n"
"// //\n"
"// Generated by: libraries/chain_id/identify_chain.cpp //\n"
"// //\n"
"// Warning: This is a generated file, any changes made here will be //\n"
"// overwritten by the build process. If you need to change what //\n"
"// is generated here, you should use the CMake variable //\n"
"// GRAPHENE_EGENESIS_JSON to specify an embedded genesis state. //\n"
"// //\n"
;
// hack: import create_example_genesis() even though it's a way, way
// specific internal detail
namespace graphene { namespace app { namespace detail {
genesis_state_type create_example_genesis();
} } } // graphene::app::detail
fc::path get_path(
const boost::program_options::variables_map& options,
const std::string& name )
{
fc::path result = options[name].as<boost::filesystem::path>();
if( result.is_relative() )
result = fc::current_path() / result;
return result;
}
void convert_to_c_array(
const std::string& src,
std::string& dest,
int width = 40 )
{
dest.reserve( src.length() * 6 / 5 );
bool needs_comma = false;
int row = 0;
for( std::string::size_type i=0; i<src.length(); i+=width )
{
std::string::size_type j = std::min( i+width, src.length() );
if( needs_comma )
dest.append(",\n");
dest.append("\"");
for( std::string::size_type k=i; k<j; k++ )
{
char c = src[k];
switch(c)
{
// use most short escape sequences
case '\"': dest.append("\\\""); break;
case '\?': dest.append("\\\?"); break;
case '\\': dest.append("\\\\"); break;
case '\a': dest.append( "\\a"); break;
case '\b': dest.append( "\\b"); break;
case '\f': dest.append( "\\f"); break;
case '\n': dest.append( "\\n"); break;
case '\r': dest.append( "\\r"); break;
case '\t': dest.append( "\\t"); break;
case '\v': dest.append( "\\v"); break;
// single quote and misc. ASCII is OK
case '\'':
case ' ': case '!': case '#': case '$': case '%': case '&': case '(': case ')':
case '*': case '+': case ',': case '-': case '.': case '/':
case '0': case '1': case '2': case '3': case '4': case '5': case '6': case '7': case '8': case '9':
case ':': case ';': case '<': case '=': case '>': case '@':
case 'A': case 'B': case 'C': case 'D': case 'E': case 'F': case 'G': case 'H': case 'I': case 'J':
case 'K': case 'L': case 'M': case 'N': case 'O': case 'P': case 'Q': case 'R': case 'S': case 'T':
case 'U': case 'V': case 'W': case 'X': case 'Y': case 'Z':
case '[': case ']': case '^': case '_': case '`':
case 'a': case 'b': case 'c': case 'd': case 'e': case 'f': case 'g': case 'h': case 'i': case 'j':
case 'k': case 'l': case 'm': case 'n': case 'o': case 'p': case 'q': case 'r': case 's': case 't':
case 'u': case 'v': case 'w': case 'x': case 'y': case 'z':
case '{': case '|': case '}': case '~':
dest.append(&c, 1);
break;
// use shortest octal escape for everything else
default:
dest.append("\\");
char dg[3];
dg[0] = '0' + ((c >> 6) & 3);
dg[1] = '0' + ((c >> 3) & 7);
dg[2] = '0' + ((c ) & 7);
int start = (dg[0] == '0' ? (dg[1] == '0' ? 2 : 1) : 0);
dest.append( dg+start, 3-start );
}
}
dest.append("\"");
needs_comma = true;
row++;
}
std::cerr << "\n";
return;
}
struct egenesis_info
{
fc::optional< genesis_state_type > genesis;
fc::optional< chain_id_type > chain_id;
fc::optional< std::string > genesis_json;
fc::optional< fc::sha256 > genesis_json_hash;
fc::optional< std::string > genesis_json_array;
int genesis_json_array_width,
genesis_json_array_height;
void fillin()
{
// must specify either genesis_json or genesis
if( genesis.valid() )
{
if( !genesis_json.valid() )
// If genesis_json not exist, generate from genesis
genesis_json = fc::json::to_string( *genesis );
}
else if( genesis_json.valid() )
{
// If genesis not exist, generate from genesis_json
try
{
genesis = fc::json::from_string( *genesis_json ).as< genesis_state_type >( 20 );
}
catch (const fc::exception& e)
{
edump((e));
throw;
}
}
else
{
// Neither genesis nor genesis_json exists, crippled
std::cerr << "embed_genesis: Need genesis or genesis_json\n";
exit(1);
}
// init genesis_json_hash from genesis_json
if( !genesis_json_hash.valid() )
genesis_json_hash = fc::sha256::hash( *genesis_json );
// init chain_id from genesis_json_hash
if( !chain_id.valid() )
chain_id = genesis_json_hash;
// init genesis_json_array from genesis_json
if( !genesis_json_array.valid() )
{
genesis_json_array = std::string();
// TODO: gzip
int width = 40;
convert_to_c_array( *genesis_json, *genesis_json_array, width );
int height = (genesis_json->length() + width-1) / width;
genesis_json_array_width = width;
genesis_json_array_height = height;
}
}
};
void load_genesis(
const boost::program_options::variables_map& options,
egenesis_info& info
)
{
if( options.count("genesis-json") )
{
fc::path genesis_json_filename = get_path( options, "genesis-json" );
std::cerr << "embed_genesis: Reading genesis from file " << genesis_json_filename.preferred_string() << "\n";
info.genesis_json = std::string();
read_file_contents( genesis_json_filename, *info.genesis_json );
}
else
info.genesis = graphene::app::detail::create_example_genesis();
if( options.count("chain-id") )
{
std::string chain_id_str = options["chain-id"].as<std::string>();
std::cerr << "embed_genesis: Genesis ID from argument is " << chain_id_str << "\n";
info.chain_id = chain_id_str;
}
}
int main( int argc, char** argv )
{
int main_return = 0;
boost::program_options::options_description cli_options("Graphene Chain Identifier");
cli_options.add_options()
("help,h", "Print this help message and exit.")
("genesis-json,g", boost::program_options::value<boost::filesystem::path>(), "File to read genesis state from")
("tmplsub,t", boost::program_options::value<std::vector< std::string > >()->composing(),
"Given argument of form src.cpp.tmpl---dest.cpp, write dest.cpp expanding template invocations in src")
;
boost::program_options::variables_map options;
try
{
boost::program_options::store( boost::program_options::parse_command_line(argc, argv, cli_options), options );
}
catch (const boost::program_options::error& e)
{
std::cerr << "embed_genesis: error parsing command line: " << e.what() << "\n";
return 1;
}
if( options.count("help") )
{
std::cout << cli_options << "\n";
return 0;
}
egenesis_info info;
load_genesis( options, info );
info.fillin();
fc::mutable_variant_object template_context = fc::mutable_variant_object()
( "generated_file_banner", generated_file_banner )
( "chain_id", (*info.chain_id).str() )
;
if( info.genesis_json.valid() )
{
template_context["genesis_json_length"] = info.genesis_json->length();
template_context["genesis_json_array"] = (*info.genesis_json_array);
template_context["genesis_json_hash"] = (*info.genesis_json_hash).str();
template_context["genesis_json_array_width"] = info.genesis_json_array_width;
template_context["genesis_json_array_height"] = info.genesis_json_array_height;
}
for( const std::string& src_dest : options["tmplsub"].as< std::vector< std::string > >() )
{
std::cerr << "embed_genesis: parsing tmplsub parameter \"" << src_dest << "\"\n";
size_t pos = src_dest.find( "---" );
if( pos == std::string::npos )
{
std::cerr << "embed_genesis: could not parse tmplsub parameter: '---' not found\n";
main_return = 1;
continue;
}
std::string src = src_dest.substr( 0, pos );
std::string dest = src_dest.substr( pos+3 );
std::string tmpl;
read_file_contents( fc::path( src ), tmpl );
std::string out_str = fc::format_string( tmpl, template_context );
fc::path dest_filename = fc::path( dest );
fc::ofstream outfile( dest_filename );
outfile.write( out_str.c_str(), out_str.size() );
outfile.close();
}
return main_return;
}