Pulsar SQL cannot get the latest message

[DGBStarSky]

Describe the bug
Pulsar SQL cannot get the latest message of topic.

To Reproduce
Steps to reproduce the behavior:
I use pulsar sql query messages, but cannot get the latest message of topic.I have configured the parameters in broker.conf, but no effect.

Screenshots

Desktop (please complete the following information):
ubuntu 18.04

Additional context
chart deployment
2.5.1

[opera33]

Tested this in 2.5.2 as well in Standalone mode, not getting latest data from Pulsar SQL

Previously opened this #6884

[wen-qiang001]

I set up bookkeeperExplicitLacIntervalInMills in broker.conf and standalone.conf, but still couldn't get the latest news。

[bleacha870721]

@sijie May I know the current progress of this issue? I still couldn't get the latest messages in 2.6.0

[sijie]

@bleacha870721 the setting requires some configuration changes in the bookies' side (e.g. bump journal version). We need to update the documentation about the full process.

[ErikJansenIRefact]

@sijie Any idea when the documentation is updated. We are in the middle of testing Presto with Pulsar.

[bleacha870721]

@bleacha870721 the setting requires some configuration changes in the bookies' side (e.g. bump journal version). We need to update the documentation about the full process.

Any idea when the documentation is updated？

[rec7y33]

bump

[robfromboulder]

@sijie I'd pay a cash bounty for a solution -- doesn't need to be full documentation, but just pointing us in the right direction. We've been trying to figure this out and would really appreciate your help! And we'd be happy to contribute this back as a pull request to the docs as well.

Anybody else on this thread -- same offer applies, happy to pay you for your time if you can share the answer on this!

[sijie]

@RobDickinson I replied in the email.

for ExplicitLac to work, you need to configure the following settings in bookies:

journalFormatVersionToWrite=6
fileInfoFormatVersionToWrite=1

and then turn on the explicit lac interval on broker.

bookkeeperExplicitLacIntervalInMills=1000