ION
The Identity Overlay Network (ION) is an open source DID method implementation developed by the Decentralized Identity Foundation.
In other words, ION is a software tool that can be used to perform DID operations, such as creating and publishing new DIDs and DID documents, and resolving existing ones. It does this by reading and writing data to the Bitcoin blockchain and to the IPFS distributed file system. As such, every ION instance is a node on these two peer-to-peer networks.
Trustchain delegates the execution of DID operations to an ION node. Therefore to use Trustchain you must first install and run ION, either on the same machine or a connected one.
ION resource requirements
An ION installation includes a full node on the Bitcoin network, which must download and store the entire Bitcoin blockchain. This is a large amount of data that typically takes several hours, or even days, to download.
The recommended system requirements for an ION installation are:
- 6GB of RAM
- 1TB of storage (or 256GB for Testnet).
Note, however, that Trustchain makes no assumptions about the trustworthiness of the ION system and the Trustchain security model does not rely on the correct functioning of the ION software. Trustchain independently verifies all of the data it receives from ION, so a faulty or compromised ION node would not represent a security vulnerability in Trustchain (although it could cause a loss of service).
This page explains how to install and run ION.
Preliminaries
Before beginning the installation, a few decisions must be made that will determine exactly what steps should be taken.
Docker Container vs. Full Installation
The simplest way to run ION is using Docker, and it can be a useful way to experiment with the system before performing a full installation. However, this method provides a read-only ION node. This means that it provides access to existing DIDs, but cannot be used to create and publish new ones.
If you would like to be able to use Trustchain to create and publish your own DIDs, follow the full installation instructions below (and ignore the ION with Docker section).
If you want to run ION using Docker, you can skip most of this page and just follow the instructions in the ION with Docker section.
Bitcoin Mainnet vs. Testnet
The Bitcoin client wrapped inside an ION node can be configured either for Mainnet (the main Bitcoin network) or Testnet (an alternative blockchain designed for testing and software development).
Mainnet should be used for a production deployment of Trustchain because DID operations published on the Bitcoin blockchain have extremely strong immutability, persistence and discoverability properties. When testing Trustchain, however, it is sensible to configure the ION Bitcoin client for Testnet, since coins on the test network have no monetary value and therefore "test" DID operations can be executed at zero cost.
Testnet coins can be requested from a Testnet "faucet", such as this one.
In this guide, commands and configuration settings may depend on which network is in use. In those cases, choose the appropriate tab (Mainnet or Testnet) for your setup.
Local vs. Remote Installation
You can install ION on your local machine or a remote one, e.g. a virtual machine in the Cloud. If you are using a remote machine, connect to it using SSH and follow the instructions below.
Once installed, follow the port forwarding instructions in the SSH config section to produce a setup that is indistinguishable from running an ION node locally.
ION Installation Guide
These instructions are based on the official ION Install Guide but contain additional details, several minor corrections and a workaround to support the latest versions of Bitcoin Core.
Both Linux and macOS are supported and tested. For Linux, our instructions assume a Debian-based distribution, such as Ubuntu. Some minor changes will be needed for other distributions. Instructions for installing on Windows are given in the official ION guide.
In all cases, administrator privileges are required.
Prerequisites
Run the following commands to set up your environment.
Update the package lists on your machine:
and install essential build tools: Install Snap ... (assumes Debian-based Linux distro): Add the Snap binaries to thePATH environment variable:
Install Node.js version 14:
Install Xcode command line tools:
Install the Homebrew package manager:Install IPFS
IPFS is the InterPlanetary File System, a peer-to-peer protocol and network used by ION for storing and sharing data.
Follow the official IPFS installation instructions for Linux.
Install MongoDB
Open the MongoDB Community Server Download page and download the package for your platform.
Then following these instructions to install MongoDB on Linux
Install Bitcoin Core
Trustchain has been tested with Bitcoin Core v24.0.1 and therefore the instructions below assume that version. More recent versions of Bitcoin Core are available and can be used, but will require some minor changes to the commands in the following steps.
Begin by downloading the Bitcoin Core release for your system:
- Download link for Linux with x86-64 processor.
- Download link for Linux with ARM processor.
Verify the download by comparing the published hash with the result of this command:
Unzip the archive: TODO: UNZIP COMMAND IS SPECIFIC TO ARCHITECTURE.
and install Bitcoin Core: The installation includes an executable file namedbitcoind which we will run to start Bitcoin Core.
Begin by downloading the Bitcoin Core release for your system:
- Download link for Mac with x86-64 processor.
- Download link for Mac with Apple M1 processor.
Verify the download by comparing the published hash with the result of this command:
Unzip the archive: TODO: UNZIP COMMAND IS SPECIFIC TO ARCHITECTURE.
and move the contents to the/Applications folder:
The download contains an executable file named bitcoind which we will run to start Bitcoin Core.
Sign the Bitcoin Core executable files
Newer macOS systems will refuse to run an executable file unless it is signed. Run the following command to check whether this is a requirement on your machine:
$ codesign -d -vvv --entitlements :- /Applications/bitcoin-24.0.1/bin/bitcoind
> /Applications/bitcoin-24.0.1/bin/bitcoind: code object is not signed at all
Configure Bitcoin Core
We shall need to specify a folder to store the Bitcoin blockchain data.
Bitcoin data storage requirements
The Bitcoin data folder will store the entire Bitcoin blockchain, which is >580GB for Mainnet and >75GB for Testnet.
For convenience, we create an environment variable for the Bitcoin data folder.
Create the BITCOIN_DATA environment variable
Our convention is to use the folder ~/.bitcoin for Bitcoin Core data. If you want to use a different folder, just change the path in the following command:
Having defined the BITCOIN_DATA environment variable, use it to create the data folder itself:
Bitcoin configuration parameters will be stored in a file named bitcoin.conf inside the $BITCOIN_DATA folder.
The following command creates that file with the required parameters and user permissions:
$ echo "server=1\ndaemon=1\ntxindex=1\ndatadir=$BITCOIN_DATA\n" > $BITCOIN_DATA/bitcoin.conf && chmod 640 $BITCOIN_DATA/bitcoin.conf
To confirm these changes were made correctly, check the first three lines in the bitcoin.conf file by running:
Bitcoin configuration parameters will be stored in a file named bitcoin.conf inside the $BITCOIN_DATA folder.
The following command creates that file with the required parameters and user permissions:
$ echo "testnet=1\nserver=1\ndaemon=1\ntxindex=1\ndatadir=$BITCOIN_DATA\n" > $BITCOIN_DATA/bitcoin.conf && chmod 640 $BITCOIN_DATA/bitcoin.conf
To confirm these changes were made correctly, check the first three lines in the bitcoin.conf file by running:
Note: Do not use the ~ shorthand in the datadir parameter
The directory path in the datadir parameter must not contain the ~ character as a shorthand for the user's home directory.
The example given in the official ION install guide does use this shorthand, which causes an error, so beware of this issue if you are following that guide and/or editing the bitcoin.conf file manually.
When we start Bitcoin Core we will need to make sure it uses the correct configuration file that was created above. To make this more convenient, let's create an alias in our SHELL_CONFIG file:
$ echo 'alias bitcoind="/usr/local/bin/bitcoind -conf=$BITCOIN_DATA/bitcoin.conf"' >> $SHELL_CONFIG; source $SHELL_CONFIG
Now we can use the following simple command to start Bitcoin Core:
$ echo 'alias bitcoind="/Applications/bitcoin-24.0.1/bin/bitcoind -conf=$BITCOIN_DATA/bitcoin.conf"' >> $SHELL_CONFIG; source $SHELL_CONFIG
Now we can use the following simple command to start Bitcoin Core:
The first time your run this command, you will see the following pop-up message:
You need to tell macOS that this is not malicious software. To do this, open the "Security & Privacy" settings in System Preferences, choose the "General" tab, and click the button on the right-hand side that says "Allow Anyway":
Now re-run the command to start Bitcoin Core:
Another pop-up message will appear, similar to the first one, but this time there will be an option to allow the program to run by clicking the "Open" button.You should now see the message "Bitcoin Core starting" in the Terminal.
Bitcoin synchronisation
When Bitcoin Core starts for the first time, it will begin synchronising with the rest of the Bitcoin network. This means downloading all of the blocks in the Bitcoin blockchain, which is a large data structure containing every Bitcoion transaction that has ever been processed.
The synchronisation process may take several hours, or even days, to complete. You can continue with the installation steps below while it is in progress, but you will not be able to use Trustchain until your Bitcoin node has finished synchronising.
Bitcoin CLI
Now that your Bitcoin Core node is up and running, you will want to be able to communicate with it. Bitcoin Core provides a command line interface (CLI) for this purpose.
Run the following command to create an alias, making to easy to access the CLI:
Bitcoin RPC username and password
Before you can make use of the CLI you will need to add a username and password to the Bitcoin configuration file. These same parameters will also be used for authentication when ION interacts with Bitcoin Core. In both cases, the interaction is possible because Bitcoin Core provides access via a Remote Procedure Call (RPC) interface.
We shall use admin for the RPC username. To set up the RPC password, copy and paste the following command into the Terminal and then change <password> to something of your choice before hitting the Enter key:
bitcoin.conf file:
$ sed -i '' "1s|^|rpcuser=admin\nrpcpassword=$RPC_PASSWORD\n|" /Applications/bitcoin-24.0.1/bitcoin.conf
bitcoin.conf file by running:
You should see these lines printed to the Terminal (with your chosen password):
Now, whenever Bitcoin Core is running, you can invoke the Bitcoin CLI with commands beginning bitcoin-cli. A full list of commands available via the Bitcoin CLI can be found here.
One useful example is the following -getinfo command. It reports information about the state of your Bitcoin node, including whether it is fully synchronised:
Create a Bitcoin wallet for ION
Before using ION you must create a Bitcoin wallet by running the following CLI command:
Configure ION
Choose a directory in which you want to store the ION software and change to that directory using the command $ cd <DIRECTORY_NAME>. For instance, to change to your home directory run the cd command without any arguments:
ion subfolder:
Create the ION_REPO environment variable
Since we will need to refer to this folder in future, let's create an environment variable containing its file path:
We will need a folder for storing ION configuration files. For convenience, we'll also create an environment variable for that folder.
Create the ION_CONFIG environment variable
Our convention is to use the folder ~/.ion for ION configuration files. If you want to use a different folder, just change the path in the following command:
Having defined the ION_CONFIG environment variable (above), use it to create the folder itself:
Next, copy the template ION configuration files to your ION_CONFIG directory:
$ cp $ION_REPO/config/mainnet-bitcoin-config.json $ION_REPO/config/mainnet-bitcoin-versioning.json $ION_REPO/config/mainnet-core-config.json $ION_REPO/config/mainnet-core-versioning.json $ION_CONFIG
$ chmod 640 $ION_CONFIG/mainnet-bitcoin-config.json $ION_CONFIG/mainnet-bitcoin-versioning.json $ION_CONFIG/mainnet-core-config.json $ION_CONFIG/mainnet-core-versioning.json
The following commands will edit some of the configuration parameters inside the file named mainnet-bitcoin-config.json.
Set the bitcoinDataDirectory parameter (skip this step if your BITCOIN_DATA directory is on a network drive):
$ sed -i '' 's|"bitcoinDataDirectory": ".*"|"bitcoinDataDirectory": "'$BITCOIN_DATA'"|g' $ION_CONFIG/mainnet-bitcoin-config.json
Set the bitcoinRpcUsername and bitcoinRpcPassword parameters. These must match the username and password chosen in the Bitcoin CLI section above.
We chose admin for the RPC username. The following command sets this same value inside the ION config file:
$ sed -i '' 's|"bitcoinRpcUsername": ".*"|"bitcoinRpcUsername": "admin"|g' $ION_CONFIG/mainnet-bitcoin-config.json
For the RPC password, copy and paste the following command into the Terminal and then change <password> to the same password you chose when setting up the Bitcoin CLI:
Then run this command to update the bitcoinRpcPassword parameter in the ION config file:
$ sed -i '' 's|"bitcoinRpcPassword": ".*"|"bitcoinRpcPassword": "'$RPC_PASSWORD'"|g' $ION_CONFIG/mainnet-bitcoin-config.json
Set the bitcoinWalletImportString parameter. This must be a mainnet-compatible key in wallet import format (WIF). If you intend to use Trustchain to write your own DID operations, this parameter must be populated with your private key in the appropriate format. Otherwise, you can use this tool to generate a WIF string without any bitcoin.
Copy and paste the following command into the Terminal and then change <wif> to your WIF string:
Then run this command to update the bitcoinWalletImportString parameter in the ION config file:
Next, copy the template ION configuration files to your ION_CONFIG directory:
$ cp $ION_REPO/config/testnet-bitcoin-config.json $ION_REPO/config/testnet-bitcoin-versioning.json $ION_REPO/config/testnet-core-config.json $ION_REPO/config/testnet-core-versioning.json $ION_CONFIG
$ chmod 640 $ION_CONFIG/testnet-bitcoin-config.json $ION_CONFIG/testnet-bitcoin-versioning.json $ION_CONFIG/testnet-core-config.json $ION_CONFIG/testnet-core-versioning.json
The following commands will edit some of the configuration parameters inside the file named testnet-bitcoin-config.json.
Set the bitcoinDataDirectory parameter (skip this step if your BITCOIN_DATA directory is on a network drive):
$ sed -i '' 's|"bitcoinDataDirectory": ".*"|"bitcoinDataDirectory": "'$BITCOIN_DATA'testnet3/"|g' $ION_CONFIG/testnet-bitcoin-config.json
Set the bitcoinRpcUsername and bitcoinRpcPassword parameters. These must match the username and password chosen in the Bitcoin CLI section above.
We chose admin for the RPC username. The following command sets this same value inside the ION config file:
$ sed -i '' 's|"bitcoinRpcUsername": ".*"|"bitcoinRpcUsername": "admin"|g' $ION_CONFIG/testnet-bitcoin-config.json
For the RPC password, copy and paste the following command into the Terminal and then change <password> to the same password you chose when setting up the Bitcoin CLI:
Then run this command to update the bitcoinRpcPassword parameter in the ION config file:
Build ION
Change directory into the ION repository:
Now install the ION dependencies: make sure Typescript is installed: and then build the ION package:Note: Rebuild ION whenever a configuration file is modified
You must rerun the command npm run build if changes are made to the JSON configuration files in the ION_CONFIG folder.
Test ION
Before running ION for the first time, make sure that you have started IPFS, MongoDB and Bitcoin Core (by following the instructions above). Also make sure that Bitcoin Core is fully synchronised by running:
You should see output similar to the following. Bitcoin Core is synchronised if the number of Blocks is equal to the number of Headers:
Blocks: 852429
Headers: 852429
Verification progress: ▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒ 100%
Difficulty: 79.620365071432086
Network: in 0, out 10, total 10
Version: 240001
Time offset (s): 0
Proxies: n/a
Min tx relay fee rate (BTC/kvB): 0.00001000
Warnings: (none)
In a new Terminal, start the ION Bitcoin microservice with:
Chain: test
Blocks: 2868427
Headers: 2868427
Verification progress: ▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒ 100%
Difficulty: 3.620365071432086
Network: in 0, out 10, total 10
Version: 240001
Time offset (s): 0
Proxies: n/a
Min tx relay fee rate (BTC/kvB): 0.00001000
Warnings: (none)
In a new Terminal, start the ION Bitcoin microservice with:
When running this command for the first time, expect the error:
Non-base58 character
Is bitcoinWalletImportString valid? Consider using <testnet> key generated below:
<wif>:
Then run this command to update the bitcoinWalletImportString parameter in the ION config file:
$ sed -i '' 's|"bitcoinWalletImportString": ".*"|"bitcoinWalletImportString": "'$WIF'"|g' $ION_CONFIG/testnet-bitcoin-config.json
Now repeat the attempt to start the ION Bitcoin microservice:
Troubleshooting Tip
- If you see an
ECONNREFUSEDerror message when starting the ION Bitcoin microservice, this indicates that it has failed to communicate with Bitcoin Core. In this case, make sure that Bitcoin Core started successfully.
ION synchronisation
When the ION Bitcoin microservice starts for the first time, it will begin scanning the Bitcoin blockchain for ION DID operations, by making calls to the Bitcoin Core RPC interface.
The synchronisation process may take >1 hour to complete. Wait until it has finished before running the ION Core microservice in the following step.
In another new Terminal, start the ION Core microservice with:
Troubleshooting Tip
If you see an ECONNREFUSED error message when starting the ION Core microservice, this indicates that it has failed to communicate with the ION Bitcoin microservice. In this case, make sure that the ION Bitcoin microservice started successfully.
Finally, to confirm that ION is working properly, open yet another new Terminal and resolve a sample DID:
If ION is working properly, the command above will return a JSON data structure containing the resolved DID document and document metadata for the sample DID.
Congratulations! Your ION installation is now complete.
Running ION
The following commands must be run each time you start your ION node, e.g. after restarting your computer. Some of them will keep control of the Terminal, so you will need to open a new Terminal window to continue.
Tip: Use tmux
A convenient way to start all of the following processes is to use tmux (the terminal multiplexer). Once installed, open a tmux session with the command:
and hit Ctrl+B followed by C each time you need to open a new window.When all of the processes are started, detach the tmux session with Ctrl+B followed by D. To reattach the session later, run:
Follow these steps to start your ION node:
1. Start IPFS
2. Start MongoDB
3. Start Bitcoin Core
Other Bitcoin Core commands
Check status:
Stop Bitcoin Core:
Print the log file to the Terminal (hit Ctrl+C to exit):
Reindex the chain (may take >1 hour):
Check which port bitcoind is listening on (should be 8333 for Mainnet):
Check status:
Stop Bitcoin Core:
Print the log file to the Terminal (hit Ctrl+C to exit):
Reindex the chain (may take >1 hour):
Check which port bitcoind is listening on (should be 18333 for Testnet):
4. Start the ION bitcoin service.
5. Start the ION core service.
6. Test ION. To confirm that ION is working properly, resolve a sample DID:
This command should print the contents of the resolved DID document and document metadata to the Terminal. If it does not, see the Troubleshoot tips above.
Funding your Bitcoin wallet
ION can be used to resolve existing DIDs and to publish new ones. New DIDs are published by writing the DID document content to IPFS and inserting an identifier for that content inside a Bitcoin transaction. This has the effect of timestamping the DID document and also making it easily discoverable (by scanning the Bitcoin blockchain).
Every Bitcoin transaction must include a processing fee, and therefore some funds must be available in your ION Bitcoin wallet before it can be used to publish any new DIDs. No funds are needed to resolve existing DIDs.
First check that sidetreeDefaultWallet, that was created earlier, is loaded. You should see the following output when running this command:
To fund your wallet, send Bitcoins to the first receive address in this list.
Purchase BTC on a Bitcoin exchange
If you do not already own any bitcoins, they can be purchased on a Bitcoin exchange. Make sure that you acquire genuine bitcoins, which are identified by the ticker symbol BTC. When withdrawing your coins from the exchange, enter the receive address obtained in the preceding step to send them to your ION wallet.
After sending bitcoins to your wallet, you will need to wait for the transaction to be confirmed by the Bitcoin network. This should take around 10 minutes on average, but may take longer depending on the size of the transaction fee paid. To check the status of your transaction, paste the transaction ID into a Bitcoin blockchain explorer such as blockstream.info.
Request tBTC from a Testnet faucet
Testnet bitcoins are identified by the ticker symbol tBTC, to distinguish them from the Mainnet bitcoins which have the symbol BTC.
Since coins on the Bitcoin Testnet have no monetary value they can be obtained free of charge from a "faucet", which is an automated service that will dispense a small quantity of tBTC on request.
Visit a Bitcoin Testnet faucet, such as coinfaucet.eu, and enter the recieve address obtained in the preceding step to send them to your ION wallet.
After sending bitcoins to your wallet, you will need to wait for the transaction to be confirmed by the Bitcoin network. To check the status of your transaction, paste the transaction ID into a Bitcoin Testnet explorer such as blockstream.info.
When the transaction is confirmed, check your wallet balance with:
The output should look something like this, with a non-zero balance for thewatchonly wallet:
{
"mine": {
"trusted": 0.00000000,
"untrusted_pending": 0.00000000,
"immature": 0.00000000
},
"watchonly": {
"trusted": 0.00017612,
"untrusted_pending": 0.00000000,
"immature": 0.00000000
}
}
SSH config
When running a remote ION node, it can be convenient to open an SSH connection (with port forwarding) from your local machine. This produces a setup that is indistinguishable from running ION locally.
Allow incoming connections on the remote machine
The remote machine must be configured to accept incoming connections on all of the ports listed below. If you are using a Virtual Machine from a cloud provider, this can be done from the Network Settings page in the management portal.
We recommend adding the following lines to your SSH configuration file at ~/.ssh/config:
where <IP_ADDRESS> is the public IP address of the remote machine, <USERNAME> is the login username, and <KEY_FILE> is the name of the SSH key file used for key pair authentication.
The port forwarding rules in the above configuration assume that the default ports are used for the following processes. These ports are shown in the following table. If you wish, you can change any of these ports by editing the ION configuration files as described earlier.
| Port | Process |
|---|---|
| 3000 | ION |
| 5001 | IPFS |
| 8332 | Bitcoin |
| 27017 | MongoDB |
| Port | Process |
|---|---|
| 3000 | ION |
| 5001 | IPFS |
| 18332 | Bitcoin |
| 27017 | MongoDB |
With this configuration in place, connect to the remote machine with the following command:
As long as this connection is active, data sent to the ports specified in the SSH configuration (above) will be relayed to the same ports on the remote machine, producing a setup equivalent to running ION and its related processes locally.
ION using Docker
ION using Docker is read-only
The simplest way to run ION is using Docker, and it can be a useful way to experiment with the system before performing a full installation. However, this method provides a read-only ION node. This means that it provides access to existing DIDs, but cannot be used to create and publish new ones.
These instructions are based on the guide available on the ION GitHub repository.
Step 1: Install Docker
Install Docker:
sudo apt-get update
sudo apt-get install -y apt-transport-https ca-certificates curl software-properties-common
curl -fsSL --max-time 10 --retry 3 --retry-delay 3 --retry-max-time 60 https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable"
sudo apt-get install -y docker-ce
sudo systemctl enable docker
Install Docker Compose:
Install Docker Desktop.
Step 2: Run the ION Docker container
To obtain the required docker-compose.* files, clone the ION repository and enter the docker directory:
Now run the ION container. This command depends on whether you wish to run a Mainnet or a Testnet ION node.
Bitcoin and ION synchronisation
When the ION container starts for the first time, it will begin synchronising with the Bitcoin network. This means downloading all of the blocks in the Bitcoin blockchain, which is a large data structure containing every Bitcoion transaction that has ever been processed. Once this has finished, ION itself will then scan the entire blockchain for ION DID operations, which is also a lengthy process.
In total, the synchronisation process may take several hours, or even days, to complete. You will not be able to use Trustchain until your ION node has finished synchronising.
When the synchronisation process has finished, confirm that ION is working properly by running the following command to resolve a sample DID:
If ION is working properly, the command above will return a JSON data structure containing the resolved DID document and document metadata for the sample DID.