Algorand Indexer Sync Limit

[abaschkim]

Hi Algorand Community.
I am currently working on a data pipeline around the Algorand blockchain. To retrieve the data from the blockchain, I was looking into the Indexer REST API. However, the indexer populates a Postgres with a large amount of data. Is there some way to limit the Indexer to a certain date in the past and sync the data from there on?

As I am writing new transactions found on the blockchain to a Kafka stream, would it also be possible to retrieve the latest transactions from the Algod REST API?

Thanks for your advice!

[fabrice]

@abaschkim

Is there some way to limit the Indexer to a certain date in the past and sync the data from there on?

Not out of the box

@abaschkim

As I am writing new transactions found on the blockchain to a Kafka stream, would it also be possible to retrieve the latest transactions from the Algod REST API?

If you only need the basic transaction without the extra information the indexer provide, you can just directly query blocks to the algod REST API.

[abaschkim]

@fabrice Thanks for the clarification!