The blockchain always store raw data (that is raw 32-byte string).
Base64 is just for display/API output.
To my knowledge, the official indexer does not support this either.
So you would most likely need to either query the indexer DB directly (most likely adding the right index) or use conduit (https://github.com/algorand/indexer/blob/develop/docs/Conduit.md).