We’d like to know more about how Perspectives notaries are performing and what they need to keep up with demand. To learn this we’re proposing a new option for network notaries: tracking performance metrics.
What is a ‘metric’?
A “metric” is a specific piece of information that is measured or counted to help you understand how software behaves. In our case metrics will be used to better understand how well a notary is performing – whether it is healthy and keeping up with demand or having difficulty. Notaries that enable performance metrics will track certain specific events to help their operators keep them online.
Our ‘Ground Rules’ for metrics:
- Metrics should have a purpose.
When taking any measurement it is important to decide what you want to know and what you will do with the information before you consider what to track. Don’t track information simply because “it might be interesting later” – that wastes time measuring the wrong thing and can negatively influence people’s behaviour. Track things with a purpose.
- User privacy is of paramount importance.
We don’t want to track anything that could be abused or that would reveal sensitive information. (If you spot something that has the potential for abuse please let us know!)
Proposed notary metrics:
With our rules in mind, we want to know:
- What kind of demand a notary receives every day, and at what time(s) of day, so we can keep servers up and running.
- Counting how many requests a notary receives
- Noting which sites are requested most often
This data gives us a target when testing to ensure notaries can handle real-life demand. It also helps us gauge what kind of resources (e.g. cache size) are required to run a notary – useful both for planning ahead and so anyone considering running a notary knows what they’ll need.
- How quickly new services are added.
We’ll count each time a site is requested that has never been seen.
- How long it takes to scan all known sites
Notaries scan their list of sites each day to update their key data. Knowing how long the scans run helps us gauge what kind of resources are needed to run a notary server.
- Failures from scanning websites.
If some sites are no longer working they could be removed from the scan list to save time and resources.
We believe that counting these few, specific pieces of data will help us keep the Perspectives notaries running smoothly. We’ll be able to take action when there is a problem, but more importantly we’ll be able to better gauge what a notary needs and prevent problems before they happen.
Logging statistics on these performance metrics should not endanger nor alter your privacy. We remain committed to providing a secure, transparent, and trustworthy service. If you have any feedback on these proposed metrics or other related ideas we would love to hear them! Feel free to leave a comment or ping us on the mailing list.