Highlights
This is a preview release of (1) Conduit, the new modular plugin system for accessing data from the chain and (2) a version of the Indexer that uses Conduit.
Conduit is composed of importer, processor, and exporter plugins. This preview introduces the framework and includes some initial plugins created by Algorand (conduit: Initial conduit pipeline tool. by winder · Pull Request #1326 · algorand/indexer · GitHub). Please see the blog post for more information.
- Conduit is backwards compatible with the preexisting Indexer service, and current Indexer runners should see no impact
- We are publishing this release as a preview to best ensure current Indexer runners have time to review the new system, test it, and later adopt it with little to no impact
- We are asking the community to preview Conduit, experiment with the plugins, and try creating their own
- We are seeking feedback related to bugs, usability, features, and documentation (to do so, join the newly created Discord channel #conduit-preview, which will stay open for a few weeks)
NOTE: this is a preview release and is subject to change so experiment but this is not yet ready for production. We will communicate when we are closer to the release date.
Changes
New Features
- New Feature: Add Retry Variables by @AlgoStephenAkiki in https://github.com/algorand/indexer/pull/1370
- Conduit: Adds strict unmarshalling by @AlgoStephenAkiki in Conduit: Adds strict unmarshalling by AlgoStephenAkiki · Pull Request #1379 · algorand/indexer · GitHub
Enhancements
- Adding a link to the data directory documentation by @fabrice102 in Adding a link to the data directory documentation by fabrice102 · Pull Request #1287 · algorand/indexer · GitHub
- conduit: Initial conduit pipeline tool. by @winder in conduit: Initial conduit pipeline tool. by winder · Pull Request #1326 · algorand/indexer · GitHub
- metrics: Configurable conduit metrics prefix. by @winder in metrics: Configurable conduit metrics prefix. by winder · Pull Request #1353 · algorand/indexer · GitHub
- conduit: Pass data dir to plugin config. by @winder in conduit: Pass data dir to plugin config. by winder · Pull Request #1357 · algorand/indexer · GitHub
- conduit: Default to plugin data directory when possible. by @winder in conduit: Default to plugin data directory when possible. by winder · Pull Request #1366 · algorand/indexer · GitHub
- conduit: Add version flag to conduit root command. by @winder in conduit: Add version flag to conduit root command. by winder · Pull Request #1377 · algorand/indexer · GitHub
- conduit: Add Conduit startup banner and fix default log level. by @winder in conduit: Add Conduit startup banner and fix default log level. by winder · Pull Request #1372 · algorand/indexer · GitHub
Bugfixes
- Tests: Fix e2e tests by @Eric-Warehime in Tests: Fix e2e tests by Eric-Warehime · Pull Request #1354 · algorand/indexer · GitHub
- Bug-Fix: pass failing
nightly_test_indexer_vs_algodby @tzaffi in https://github.com/algorand/indexer/pull/1364 - tech debt: Indexer initialization improvements by @winder in tech debt: Indexer initialization improvements by winder · Pull Request #1352 · algorand/indexer · GitHub
- conduit: Added retry variables for daemon run by @AlgoStephenAkiki in conduit: Added retry variables for daemon run by AlgoStephenAkiki · Pull Request #1380 · algorand/indexer · GitHub
- Indexer: set starting round for indexer daemon @shiqizng Indexer: set starting round for indexer daemon by shiqizng · Pull Request #1381 · algorand/indexer · GitHub
New Contributors
- @fabrice102 made their first contribution in Adding a link to the data directory documentation by fabrice102 · Pull Request #1287 · algorand/indexer · GitHub
Full Changelog: Comparing 2.15.0...2.16.0-pre2 · algorand/indexer · GitHub