Packaging cleanups ("syslibs")

Adds options to build using system LevelDB, libsecp256k1, and UniValue libraries, and/or without protobuf (see ./configure --help for usage).

Please note this may be dangerous and make theft from you possible if used with versions of the LevelDB or libsecp256k1 libraries which have not been audited to meet the bug-for-bug compatibility required by Bitcoin's consensus protocol. These options are disabled by default for this reason.

It also adds options to disable building bitcoin-cli or bitcoin-tx individually, and fixes minor bugs that affect building only.

See also:

• Support for building against system LevelDB
• configure: Add unsupported --with-system-libsecp256k1 configure flag
• configure: BITCOIN_SUBDIR_TO_INCLUDE: Improve compatibility with paths including space and multiline cpp output
• crypto/sha256: Use pragmas to enforce necessary intrinsics for GCC and Clang
• test: Support -cli tests using external bitcoin-cli
• build: Add missed definition for `AM_OBJCXXFLAGS`
• Bugfix: Move common/url to libbitcoin_util.a for now

Fixes

• rpc: Don't FlushStateToDisk when pruneblockchain(0)
• Escape rather than remove any printable characters in UAs
• Try to use posix_fadvise with CBufferedFile
• http: Fail initialization when any bind fails
• Bugfix: GUI: Remove broken ability to edit the address field in the sending address book
• Bugfix? Restore linking to libmingwthrd
• Bugfix: devtools/symbol-check: Check PE libraries case-insensitively
• Fix release tarball generated by gitian
• Bugfix: Only use git for build info if the repository is actually the right one
• wallet: let Listwalletdir do not iterate through our blocksdata
• util/system: Close non-std fds when execing slave processes
• Bugfix: Skip tests for tools not being built
• Bugfix: util: Correctly handle Number value types in GetArg/GetBoolArg
• rpc: getblock/getrawtransaction/decode*/gettxout fixups
• Blocking arguments -nohelp, -noh, and -no?
• CLI: Only one Request Handler can be specified
• fuzz: call lookup functions before calling `Ban`
• exclude ipc scheme from port check
• Fix issues in ZMQ error handling
• Bugfix: net_processing: Restore "Already requested" error for FetchBlock
• Bugfix: Package relay / bytespersigop checks
• fuzz: coinselection, improve `min_viable_change`/`change_output_size`
• test, bench: Initialize and terminate use of Winsock properly
• bugfix: throw an error if an invalid parameter is passed to getnetworkhashps RPC
• build: Update `qt` package up to 5.15.11
• test: Make existing functional tests compatible with --v2transport
• test: fix node index bug when comparing peerinfo
• Change petertodd seeds to petertodd.net
• wallet, rpc: add anti-fee-sniping to `send` and `sendall`
• init: don't delete PID file if it was not generated
• wallet: Fix migration of blank wallets
• Make bitcoin-tx replaceable value optional
• sqlite: Disallow writing from multiple `SQLiteBatch`s
• Bugfix: RPC: Check for blank rpcauth on a per-param basis
• rpc: validate fee estimation mode case insensitive
• build: Fix check whether `-latomic` needed
• RPC/Blockchain: scanblocks: Accept named param for filter_false_positives
• depends: Allow PATH with spaces in directory names
• wallet: Reset chain notifications handler if AttachChain fails
• depends: add NM output to gen_id
• wallet: guard against dangling to-be-reverted db transactions
• rpc: Fix race in loadtxoutset
• wallet: clarify replaced_by_txid and replaces_txid in help output
• util: check for errors after close and read in AutoFile
• rpc: Fixed signed integer overflow for large feerates
• ci: Avoid CI failures from temp env file reuse
• Drop log category in `SeedStartup`
• subtree: update crc32c subtree
• wallet: default wallet migration, modify inconvenient backup filename
• BufferedFile: fclose at destruction
• Bugfix: GUI: Help messages already have a trailing newline, so don't add an extra one
• Bugfix: Correct first-run free space checks
• Initialise DBus notifications in another thread
• Bugfix: Allow the user to start anyway when loading a wallet errors
• QRImageWidget: Sizing and font fixups
• Avoid unclean exit due to permissions issues when setting start on system startup
• Translate unit names & fix external signer error
• Fix shortcut ambiguities
• Intro: Never change the prune checkbox after the user has touched it
• Fix transaction view/table
• Bugfix: Address broken things around Peers detail view
• Improve 'Requested Payments History' Multiselect
• Exit and show error if unrecognized command line args are present
• Modify command line help to show support for BIP21 URIs
• Update Node window title with the chain type
• Check for private keys disabled before attempting unlock
• Fix: Ensure 'Transaction View' remains disabled if no wallet is selected
• debugwindow: update session ID tooltip
• test: Recognize dialog object by name
• Fix nullptr clientModel access during shutdown
• RPC: Support specifying different types for param aliases
• Wallet: Hacky fix for getbalance bugs
• Bugfix: GUI/Addressbook: Drop confusing message about signed messages
• RPC/Net: Allow addconnection on non-regtest networks
• Add workaround for Boost bugs
• Allow acceptstalefeeestimates on all networks
• RPC: Keep .cookie if it was replaced after being generated
• Bugfix: doc: Correct default for -upnp following removal of configure flag
• RPC/Blockchain: Demote loadtxoutset to hidden/debug-only for now (not supported on mainnet)

Functional and policy enhancements

• Parse URIs with non-BTC amounts
• -acceptnonstdtxn option to skip "non-standard transaction" checks
• Support for Tonal Bitcoin units (ᵇTBC, ˢTBC, and TBC)
• Restore ability to display addresses in GUI
• [Qt] support for persisted rpc console history
• Qt: Add network port input box to GUI settings
• Make RBF policies optional
• Render icons from SVG
• Read/write bitcoin_rw.conf for exposing shared Daemon/GUI options in the GUI
• RPC: sendrawtransaction: Allow the user to ignore/override specific rejections
• Add mempool statistics collector
• [Qt] Add interactive mempool graph
• RPC: Add parameter to addmultisigaddress / createmultisig to sort public keys
• Wallet/RPC: sweepprivkeys method to scan UTXO set and send to local wallet
• Drop IO priority to idle while reading blocks for peer requests and startup verification
• [RPC] dumpmasterprivkey command
• If -spkreuse=0, ensure transactions in mempool always have unique scriptPubKeys
• Expire bitcoind & bitcoin-qt 7-8 years after its last change
• Added support for MSG_FILTERED_WITNESS_BLOCK messages
• ZMQ: add publishers for wallet transactions
• Relax punishment for peers relaying invalid blocks and headers
• RPC: Allow rpcauth configs to specify a 4th parameter naming a specific wallet
• Add new bitcoin_rw.conf file that is used for settings modified by this software itself
• Multiselect in coincontrol treewidget and display selected count
• [REST] add a rest endpoint for estimatesmartfee, docs, and test
• Bugfix: RPC/Wallet: Include HD key metadata in dumpwallet
• Wallet: Support disabling implicit Segwit operation
• Add RPC call setscriptthreadsenabled: allow to temp. throttle CPU usage
• Add POWER8 ASM for 4-way SHA256
• gui: Add Windows taskbar progress
• rpc: Add min_conf option to fund transaction calls
• validation: sync chainstate to disk after syncing to tip
• torcontrol: Launch a private Tor instance when not already running
• GUI: Add Pairing tab with Tor onion address as copyable text and QR code
• Add feerate histogram to getmempoolinfo
• Restore warning for individual unknown version bits, as well as unknown version schemas
• qt: Add -guisettingsdir option
• gui: Shortcut to close RPC Console
• rpc: query general daemon information via RPC
• lib: Optimizing siphash implementation
• Add new filter type v0 for segwit only Scripts to blockfilterindex
• RPC: Show fee in results for signrawtransaction* for segwit inputs
• net: Add blockfilters white{bind,list} permission flag
• cli, test, doc: bitcoin-cli -getinfo multiwallet balances follow-ups
• cli: display multiwallet total balance in -getinfo
• RPC: Add getrpcwhitelist method
• Add -uaappend option to append a literal string to user agent
• Prune locks
• Flush dbcache early if system is under memory pressure
• wallet: introduce setfeerate (an improved settxfee, in sat/vB)
• rpc: Support -rpcauthfile argument
• RPC/Net: Allow changing the connection_type for addnode onetry
• rpc: Add getblocklocations call
• During IBD, prune as much as possible until we get close to where we will eventually keep blocks
• wallet: indicate whether a transaction is in the mempool
• RPC/Blockchain: Optimise getblock for simple disk->hex case
• - Add maxmempool RPC
• wallet: allow toggling external_signer flag
• rpc: add period_start to version bits statistics
• Add reindex=auto flag to automatically reindex corrupt data
• build: Add --with-append-cxxflags option
• Support multiple -*notify commands
• build: Use guix within gitian
• RPC/Wallet: Add "use_txids" to output of getaddressinfo
• util: Add "importfromcoldcard" command to bitcoin-wallet tool
• add support to save fee estimates without having to shut down the node
• rpc: add require_checksum flag to deriveaddresses
• rpc: allow dumptxoutset to dump human-readable data
• RPC/Wallet: Convert walletprocesspsbt to use options parameter
• rpc: Filter inputs by type during CoinSelection
• validation, zmq: pass block in UpdatedBlockTip to avoid duplicate read
• rpc, p2p: allow `disconnectnode` with subnet
• cli: improve error message on multiwallet and add validation to cli-side commands
• rpc: make importaddress compatible with descriptors wallet
• p2p: Allow whitelisting manual connections
• wallet: Add wallet method to detect if a key is "active"
• wallet: add `seeds` argument to `importdescriptors`
• Allow configuring target block time for a signet
• net: Add new permission `forceinbound` to evict a random unprotected connection if all slots are otherwise full
• Introduce 'getblockfileinfo' RPC command
• init: Add option for rpccookie permissions (replace 26088)
• datacarriersize: Match more datacarrying
• fix: unnecessary continuation after finding mutation
• p2p: Increase tx relay rate
• RPC: add new `listmempooltransactions`
• net, cli: use v2transport for manual/addrfetch connections, add to -netinfo
• wallettool: Always be able to dump a wallet's database
• rpc: Make v2transport default for addnode RPC when enabled
• Add a `-permitbarepubkey` option
• net: enable v2transport by default
• rpc/net: Adds misbehaving_score to getpeerinfo
• contrib: list other binaries in manpage output
• refactor: Reserve memory for ToLower/ToUpper conversions
• Update manpage descriptions
• cli: improve bitcoin-cli error when not connected
• guix: build GCC with --enable-standard-branch-protection
• Intro: Have user choose assumevalid
• Support backup to new text-based database dump format
• Network Graph layout - debug window improvement
• Make row color alternating in the Peers tab optional
• Peers window: Show direction in a new column, with clearer icon
• Network Watch tool
• Enable a non-linear network traffic option (click to toggle between linear and non-linear)
• Show ToolTip on Network Traffic graph
• Enable users to configure their monospace font specifically
• Point out position of invalid characters in Bech32 addresses
• Warn when sending to already-used Bitcoin addresses
• Showing Local Addresses in Node Window
• Remove embedded libminisketch (not used at all in 26.x)
• txdb: Increase max dbcache size to 1 TB
• GUI: Alt-P shortcut key for paste button in Open URI dialog
• RPC/rawtransaction: Convert descriptorprocesspsbt to use options parameter
• GUI: Enable customisation of QR Code font
• contrib/guix: Attempt to use `guix shell` before the deprecated `guix environment`
• utilioprio: Add Windows support as ioprio_set_file_idle
• crypto/sha256: Use pragmas to enforce necessary intrinsics for GCC and Clang (POWER8)
• RPC: Backward compatibility with Knots 0.19-0.21.0 validateaddress (address_type param and error_index output)
• RPC: getrpcwhitelist: Return a list of wallets as a JSON Object
• wallettool: Warn about dump commands not fully dumping/restoring BDB wallets
• Revert "Remove -feefilter option"
• GUI: Convert payment request to show in QTextEdit
• RPC: add transaction hash to mempool entry output
• wallet: Support %w in -walletnotify script, on Windows
• Restore blockmaxsize option, allowing to limit mined blocks by byte size
• Policy: Restore support for mining based on coin-age priority
• GUI/Wallet: Strip ".dat" from end of wallet display names
• GUI: Restore "request payment" button text
• GUI: Peers: When sorting by address, sort by network first
• GUI/Peers: Drop redundant Network column
• RPC/blockchain: Restore ability for pruned nodes to getblockfrompeer future blocks
• RPC/blockchain: Allow using getblockfrompeer without already having the block header
• Wallet: Remove deprecation warning for newly created legacy wallets
• wallet: Preserve unsupported key origin flags
• net_permissions: Include "addr" permission on implicit whitelist entries
• RPC/blockchain: Add getblockfrompeer nodeid alias for backward compatibility
• GUI: Make Peers table column/splitter size keys uniquely named for Knots 23.0
• Wallet: Increase default confirmation target to 144
• Restore original bytespersigop as bytespersigopstrict
• Add dustdynamic option supporting fee estimator or kvB into mempool
• Add -datacarriercost option to adjust policy vsize of datacarrier bytes
• Policy: Add acceptnonstddatacarrier option to reject non-standard datacarrier regardless of size
• Revert "Disable bloom filtering by default."
• Wallet: Avoid using change types newer than user's preferred address type
• Add maxscriptsize policy option
• Enforce checkpoints at their specific block height
• Update checkpoints and chain params, adding a new checkpoint at block 832,080
• Make most policy options configurable in GUI Options, and add "corepolicy" option to use Bitcoin Core defaults
• Build DMG disk image for macOS targets
• Include Tonal digits and BTC symbol in bundled font