This maintenance release removes fastjson 1.x from the distribution (fastjson2 upgraded to 2.0.63 and DLedger bumped to 0.3.3.4), introduces a native RocksDB CqCompactionFilter with a cross-platform JNI shim, deprecates the legacy Broker DLedger mode, and delivers extensive stability and performance fixes across tiered storage, Lite Mode, Proxy, and the store layer.

Security & Dependencies

• [ISSUE #7703] Upgrade fastjson2 to 2.0.63 for security fixes by @lizhimins in #10715
• [ISSUE #10651] bump DLedger to 0.3.3.4 (maintenance line) by @RongtongJin in #10958
• [ISSUE #10641] Deprecate legacy Broker DLedger mode by @RongtongJin in #10642

New Feature (Native RocksDB Compaction Filter)

Introduced a native ConsumeQueue compaction filter backed by a cross-platform JNI shim, replacing the previous pure-Java filter and the shaded rocketmq-rocksdb dependency with the official rocksdbjni artifact.

• [ISSUE #10334] Support native CqCompactionFilter with cross-platform JNI shim by @lizhimins in #10335
• [ISSUE #10334] Make native CqCompactionFilter shim self-contained without rocksdbjni dependency by @lizhimins in #10371

What's Changed

Tiered Storage

• [ISSUE #10462] Add memory backpressure to dispatch by @lizhimins in #10470
• [ISSUE #10462] Fix concurrency bugs in tiered storage by @lizhimins in #10471
• [ISSUE #10462] Optimize thread pool sizes for commit and fetch executors by @lizhimins in #10472
• [ISSUE #10462] Improve error handling in tiered storage by @lizhimins in #10473
• [ISSUE #10462] Standardize log format across tiered storage module by @lizhimins in #10474
• [ISSUE #10462] Fix resource leaks and lifecycle issues in tiered storage by @lizhimins in #10476
• [ISSUE #10572] Add dual TTL policy for tiered storage read-ahead cache by @Houlong66 in #10573

Lite Mode

• [ISSUE #10253] Fix stale wildcardGroupMap entries caused by incorrect parsing during LiteTopic wildcard unregistration by @Kris20030907 in #10254
• [ISSUE #10345] fix: preserve lite topic for auto-renew receipt handles by @Kris20030907 in #10346
• [ISSUE #10384] Enforce Lite exclusive subscription eviction via server-side tombstones by @f1amingo in #10386
• [ISSUE #10387] Support runtime hot-reload of maxClientEventCount in LiteEventDispatcher.ClientEventSet by @f1amingo in #10388
• [ISSUE #10423] Optimize LiteConsumerLagCalculator.getLagCountTopK by deferring getStoreTimestamp to topK results only by @f1amingo in #10424
• [ISSUE #10450] Selective double-write in CombineConsumeQueueStore by @imzs in #10452
• [ISSUE #10453] Fix unexpected decrement of lmq counter by @imzs in #10454
• [ISSUE #10549] Fix lite topic reset offset: memory leak, FIFO block bypass, and offset-0 reset failure by @f1amingo in #10550
• [ISSUE #10560] Remove enableLiteEventMode config switch by @f1amingo in #10561
• [ISSUE #10569] Support Lite Simple Consumer on server side by @f1amingo in #10570
• [ISSUE #10615] Fix missing long-polling notification under CombineConsumeQueue selective double-write by @imzs in #10616
• [ISSUE #10622] Resolve ConsumerOffsetManager dynamically in LiteEventDispatcher by @f1amingo in #10623
• [ISSUE #10644] Add LMQ number gauge metric to Broker observability by @f1amingo in #10645
• [ISSUE #10722] Lite Topic may not be cleaned up when message store timestamp is unavailable by @f1amingo in #10723

Store & RocksDB

• [ISSUE #10344] Parameterize RocksDB CQ size amplification by @RongtongJin in #10344
• [ISSUE #10270] Make Pop RocksDB BlockCache size configurable via MessageStoreConfig by @lizhimins in #10271
• [ISSUE #10421] Fix Timer message rocksdb use wrong cache key by @echooymxq in #10422
• [ISSUE #10417] Fix stale minOffset after consumeQueue truncation by @chenxu80 in #10418
• [ISSUE #10521] Use madvise(MADV_RANDOM) to disable kernel read-ahead during correctMinOffset binary search by @lizhimins in #10523
• [ISSUE #10639] Reuse a per-thread scratch buffer in CommitLog.checkMessageAndReturnSize by @wang-jiahua in #10640
• [ISSUE #10813] Reduce temporary allocations in the LMQ append path by @ai-yang in #10814
• [ISSUE #10819] Correct misleading CommitLog buffer comment by @fuyou001 in #10820
• [ISSUE #10953] Clamp shifted message count range to queue bounds by @qianye1001 in #10954
• [ISSUE #10959] Fix RocksDBConsumeQueue.iterateFrom should reject offset below min offset by @ymwneu in #10960
• [ISSUE #9654] Optimize the bufferLocal size of the TimerMessageStore by @ymwneu in #9655
• [ISSUE #10713] Optimize ConsumerFilterManager register CPU consumption by @ymwneu in #10714
• [ISSUE #10515] Fix TransactionMetricsFlushService busy spin bug by @wang-jiahua in #10517
• [ISSUE #10375] Fix race condition between deleteTopic and FlushConsumeQueueService by removing getLifeCycle indirection by @f1amingo in #10376
• [ISSUE #10543] resolve data race in ServiceThread wakeup mechanism by @ShadowySpirits in #10544

Broker & HA/Controller

• [ISSUE #10578] Fix master election maxOffset comparator overflow by @Aias00 in #10578
• [ISSUE #10604] Fix TopicConfig DataVersion not persisted in split registration by @imzs in #10605
• [ISSUE #10446] Support batch deletion of topics and subscription groups in broker by @wang-jiahua in #10448
• [ISSUE #10435] Fix shared ClientChannelInfo preventing inactive channel expiry by @chuanxo in #10437
• [ISSUE #10438] Fix buildTopicConfigSerializeWrapper exposing live topicConfigTable reference by @chuanxo in #10439
• [ISSUE #10284] Fix consumerOffset deserialization error and add test by @ChineseTony in #10287
• [ISSUE #10457] Fix RocketmqColdCtr logger level by @brucelwl in #10447
• [ISSUE-10546] Add default implementation for rejectRequest() in NettyRequestProcessor by @f1amingo in #10547
• fix(common): compare message queue ids safely by @yuluo-yx in #10884
• fix(controller): compare partial broker identities safely by @yuluo-yx in #10886
• fix(controller): detect inactive raft masters by @yuluo-yx in #10885
• Improve ACL 2.0 authorization context handling by @dingshuangxi888 in #10925

Proxy & gRPC

• [ISSUE #10260] Reject delayed transactional messages in gRPC send path by @yx9o in #10261
• [ISSUE #10274] Fix ForwardMessageToDeadLetterQueue request mapping descriptor by @Kris20030907 in #10275
• [ISSUE #10276] Fix PopConsumerService changeInvisibilityDuration losing CK record when visibilityTimeout collision by @qianye1001 in #10277
• [ISSUE #10280] Restore opaque when proxy remoting forward fails by @yx9o in #10281
• [ISSUE #10297] Set brokerName for messages returned by proxy local POP path by @yx9o in #10298
• [ISSUE #10285] Fix preserve popTime when rebuilding AckResult by @yx9o in #10286
• [ISSUE #10510] Add gRPC server permit keepalive configuration by @RockteMQ-AI in #10516
• [ISSUE #10661] Unregister all producer topics on gRPC client termination by @yx9o in #10662
• [ISSUE #10827] fix(broker): spin for the lock on same-attemptId pop orderly retry to avoid empty response by @lizhimins in #10828
• [Fix #10460]: Pre-size ProxyContext map to avoid HashMap resize on request path by @HarshMehta112 in #10461

Client & Remoting

• [ISSUE #10613] Fix async request-reply RequestCallback firing multiple times by @wang-jiahua in #10614
• [ISSUE #10906] Prevent duplicate MQClientInstance creation by @qianye1001 in #10907
• [ISSUE #10025] Treat blank local serve address as unset by @Aias00 in #10663
• [ISSUE #10522] Reduce Remoting header encoding allocation via F...

This version introduces Lite Mode, a lightweight subscription mechanism designed for AI scenarios, alongside enhancements across Broker, Proxy, and client components.

New Feature (Lite Mode)

Introduced a lightweight subscription mode (Lite Mode) that delivers more efficient messaging with reduced resource consumption. This mode provides complete lifecycle management, event dispatching, subscription registration, message processing, and metrics monitoring. With the newly added Lite message processor, long-polling service, control handler, and corresponding protocol support, it establishes an efficient lightweight message subscription mechanism tailored for AI scenarios.

• [RIP-83] Lite Topic: A New Message Model by @f1amingo in #9800

What's Changed

• [ISSUE #9780] Skip unnecessary RPC when topic has no message queues by @yx9o in #9781
• [ISSUE #9964] Rename intConfig method to initConfig by @yx9o in #9965
• [ISSUE #9962] Fix the failure of fastjson2 parsing metricsExporterType in proxy config by @yuz10 in #9963
• [ISSUE #9976] Update copyright year in NOTICE file to 2026 by @mxsm in #9977
• [ISSUE #9980] Skip invalid records when the group is absent in Pop by @lizhimins in #9981
• [ISSUE #9970] Refactor the MessageQueueSelector to support more flexible queue selection strategy by @qianye1001 in #9971
• [ISSUE #9994] Improve switchTimerEngine command with OptionGroup validation by @majialoong in #9995
• [ISSUE #9923] Transactional messages should not send custom delayed messages by @yx9o in #9924
• [ISSUE #9953] Fix: there's no need to decompress message body in server side by @humkum in #9954
• [ISSUE #9912] Reduce excessive requests for consumer offset timestamps in tiered storage by @lizhimins in #9991
• [ISSUE #9992] Fix remoting server netty server codec thread reuse problem by @ymwneu in #9993
• [ISSUE #9978] Remove static from loadJsonConfig and unify exception handling by @yx9o in #9979
• [ISSUE #9900] Support sending heartbeats to the broker concurrently by @Kris20030907 in #9901
• [ISSUE #9975] Bump broker rocksdb from 1.0.2 to 1.0.6 by @lizhimins in #10002
• [ISSUE #10005] Fix switch-case logic in updateConsumerOffsetAsync by @yx9o in #10006
• [ISSUE #10015] Optimize writeWithoutMmap: add page alignment to avoid read-modify-write by @guyinyou in #10016
• [ISSUE #9980] Skip invalid POP records when consumer group does not exist by @Gautam-aman in #9982
• [ISSUE #10023] Remove duplicate shutdown and rejection handler calls for routeThreadPoolExecutor by @Kris20030907 in #10024
• [ISSUE #10017] Validate commitlog offset in recoverAbnormally to prevent processing invalid data by @guyinyou in #10018
• [ISSUE #10031] Add PreprocessHandler interface in AllocateMappedFileService by @guyinyou in #10032
• [ISSUE #10019] Revert "[ISSUE #8127] Optimize the metric calculation logic of the time wheel" by @RongtongJin in #10020
• [ISSUE #10035] Fix: avoid extra padding when message end position is already page-aligned by @guyinyou in #10036
• [ISSUE #10040] Ignore flattened-pom.xml files generated by maven by @yx9o in #10041
• [ISSUE #10038] Fix checkCommitLogOffsetOnRecover to skip validation for BLANK_MAGIC_CODE by @guyinyou in #10039
• [ISSUE #9852] Print full message content when CRC not found in properties by @guyinyou in #9853
• [ISSUE #9988] Remove mismatched response header in getConsumerConnectionList by @yx9o in #9989
• [ISSUE #10043] Make TimerMessageReputService thread pool configurable and shutdown gracefully by @Kris20030907 in #10044
• [ISSUE #10021] Optimize consumer type check with EnumSet by @yx9o in #10022
• [ISSUE #10054] Correct the output format for ConsumerRecords by @yx9o in #10055
• [ISSUE #10050] Support ChangeInvisibleTime without incrementing message reconsume times by @ltamber in #10051
• [ISSUE #10034] Optimizing cq iterator and calculating lag by @lizhimins in #10056
• [ISSUE #9999] Mark custom delay time messages with delay type by @yx9o in #10000
• [ISSUE #10046] Fix lock leak risk in sendHeartbeatToBroker by @yx9o in #10047
• [ISSUE #10063] Notification request adds subscription expression to support on-demand wake-up by @qianye1001 in #10064
• [ISSUE #10068] Remove duplicate registration in DefaultMessagingProcessor.init by @yx9o in #10069
• [ISSUE #10071] Fix PopLiteLongPollingService#cleanUnusedResource by @f1amingo in #10072
• [ISSUE #10073] Fix StoreCheckpoint logicsMsgTimestamp to reflect flushed consume queues storetime by @guyinyou in #10074
• [ISSUE #10079] FlushConsumeQueueService: always flush store checkpoint after CQ flush by @guyinyou in #10080
• [ISSUE #10082] Missing PROPERTY_TIMER_DELAY_MS property check in delay message type validation by @dingshuangxi888 in #10084
• [ISSUE #10095] Upgraded Commons Lang3 to remediate CVEs by @shub-est in #10096
• [ISSUE #10086] Fix timer engine switch to persist correct config key by @Liu-ZhenYu in #10085
• [ISSUE #10093] Enhance delayed message type validation in batch send by @yx9o in #10094
• [ISSUE #10105] Fix ClassCastException in getLocks() method by @yx9o in #10106
• [ISSUE #10108] Broker startup fail in recover by @yuz10 in #10109
• [ISSUE #10110] Plain request process success and response fail when tlsMode=enforcing by @yuz10 in #10111
• [ISSUE #10107] Fix fastjson2 integer overflow when parsing AtomicLong by @yx9o in #10112
• [ISSUE #10061] Optimize the issue/pull request template of RocketMQ by @mxsm in #10062
• [ISSUE #10011] Optimize accelerated recovery process and refactor code by @RongtongJin in #10012
• [ISSUE #10159] Fix unstable tests in DefaultMQLitePullConsumerWithTraceTest by @yx9o in #10160
• [ISSUE #10077] Support password-encrypted private keys for Proxy TLS by @majialoong in #10078
• [ISSUE #10009] Add null-check log and convert internal-only public classes to inner classes by @sinberCS in #10028
• [ISSUE #10157] Fix tiered metadata leak after topic delete by @woaishixiaoxiao in #10158
• [ISSUE #10154] Rename BrokerConsumeStatsSubCommad to BrokerConsumeStatsSubCommand by @yx9o in #10155
• [ISSUE #10161] Reduce bytes copy by @ChineseTony in #10162
• [ISSUE #10168] Fix GetAllTopicConfigResponseHeader compatibility issue by @gaoyf in #10169
• [ISSUE #10103] Improve batch polling efficiency in pollIndexRecord method by @yx9o in #10104
• [ISSUE #10171] Support custom JAVA_HOME on Linux in runbroker.sh and runserver.sh by @majialoong in #10172
• [ISSUE #10181] Some minor fixes in PopConsumerService by @lizhimins in #10182
• [ISSUE #10195] Ensure RocksDB compatibility in slave-master synchronization by @gaoyf in #10196
• [ISSUE #10199] Fix stale write timestamp leads to duplicate transaction commit by @lizhimins in #10200
• [ISSUE #10201] Optimize queryOffset method overloads in IndexService by @yx9o in #10202
• [ISSUE #10221] Add RejectedExecutionHandler support for ThreadPoolMonitor by @ltamber in #10222
• [ISSUE #10229] Fix server-side reset offset does not take effect for FIFO (orderly) pop consumers by @qianye1001 in #10230
• [ISSUE #10223] Not query the index of system topics in tiered storage by @lizhimins in #10224
• [ISSUE #10003] Add gRPC maxConcurrentCallsPerConnection Configuration to Proxy by @qianye1001 in #10004
• [ISSUE #10165] Prevent RocksDB metrics from being overwritten after timer engine switch by @3424672656 in #10166
• [ISSUE #10076] Make orderl...

This version introduces two new features and a few minor fixes.

• [RIP-80] Implement Priority Message by @imzs in #9929
• [RIP-82] Implement Timer message, transaction message, and index based on RocksDB by @zk-drizzle in #9787

What's Changed

• [ISSUE #9891] Optimize pop orderly implementation to facilitate expansion by @qianye1001 in #9892
• [ISSUE #9883] Remove unnecessary MessageFormat.format by @yx9o in #9884
• [ISSUE #9888] Defer the shutdown behavior of popConsumerService to prevent JVM crash by @RongtongJin in #9889
• [ISSUE #9894] Update README for RocketMQ 5.3.4 and minor fixes by @majialoong in #9895
• [ISSUE #9396] Use fastjson2 in all modules by @yx9o in #9397
• Add some log for gRPC route by @qianye1001 in #9896
• Fix controller mode HAService removeConnection by @LittleBoy18 in #9897
• [ISSUE #9898] Remove AbstractBrokerRunnable and replace with Runnable by @RongtongJin in #9893
• [ISSUE #9910] [ACL 2.0] Incorrect consumer group extraction from retry topic in SEND_MESSAGE_V2/SEND_BATCH_MESSAGE by @dingshuangxi888 in #9911
• [ISSUE #9885] Fix tiered store cache count and bytes metrics by @majialoong in #9886
• [ISSUE #9918] Fix the message may be renewed once more if the gRPC push consumer is unexpectedly disconnected by @qianye1001 in #9919
• [ISSUE #9912] Consumer offset timestamp displayed incorrect in tiered store by @woaishixiaoxiao in #9913
• [ISSUE #9868] Fix getBrokerEpoch no response issue for empty parameters by @yx9o in #9869
• Fix dledger mode expired message can not delete on jdk9+ by @LittleBoy18 in #9851
• [ISSUE #9396] Replace fastjson with fastjson2 by @yuz10 in #9927
• [ISSUE #9902] Remove unnecessary String.format by @yx9o in #9903
• [ISSUE #9921] Limit the concurrency of Pop revive by @lizhimins in #9922
• [ISSUE #9914] Simplify isolation logic when updating fault item in sendKernelImpl by @yx9o in #9915
• [ISSUE #9928] Add Priority IT for GRPC protocol. by @imzs in #9932
• [ISSUE #9933] Fix the failure when RocksDBConfigToJsonCommand exports locally by @RongtongJin in #9934
• Optimized the function naming by @zk-drizzle in #9935
• [ISSUE #9938] Rename misnamed Messing classes to Messaging by @yx9o in #9939
• [ISSUE #9943] Remove redundant containsKey check in checkBrokerConfig by @yx9o in #9944
• Fix epoch truncate by @LittleBoy18 in #9942
• [ISSUE #9945] Use UniqueKey as TimerDelKey by default. by @imzs in #9946
• [ISSUE #9947] Fix TimerMessageStore.checkAndReviseMetrics throws BufferUnderflowException by @gaoyf in #9948
• [ISSUE #9945] Use UniqueKey as the TimerDelKey value when no namespace is appended by @imzs in #9951

Full Changelog: rocketmq-all-5.3.4...rocketmq-all-5.4.0

This is a bug-fix release that includes numerous improvements to enhance stability, performance, and correctness. Key highlights include critical dependency upgrades (e.g., Netty, OpenTelemetry), significant stability enhancements like the TimerWheel snapshot mechanism for reliable recovery, and a wide range of bug fixes across modules such as Broker, Proxy, and Client.

What's Changed

• [ISSUE #9337] Upgrade Netty to 4.1.119.Final by @weihubeats in #9338
• [ISSUE #9253] Make the message visible earlier when response process encounters errors by @redlsz in #9255
• [ISSUE #8651] Fix revive topic process lag metric calculation by @redlsz in #8652
• [ISSUE #8629] Add proxy RocketmqTraffic logger appender to separate traffic logs by @redlsz in #8630
• [ISSUE #8232] Fix the issue that proxy remoting thread pool isolation does not take effect by @redlsz in #8233
• [ISSUE #9414] Updated the Quick Start version in README to the 5.3.3 by @mxsm in #9415
• [ISSUE #9412] Flush bak metrics file before deleting the original file by @GenerousMan in #9413
• [ISSUE #9403] Fix the issue of metadata synchronization failure between master and slave when the topic has attributes by @RongtongJin in #9404
• [ISSUE #9416] Fix batch send messages have the same message id when consumed by @qianye1001 in #9417
• [ISSUE #9379] Set compact timestamp when timeStoreTable empty by @lizhimins in #9419
• [ISSUE #9418] Fix ColumnFamilyHandle not close in PopConsumerRocksdbStore by @lizhimins in #9420
• [ISSUE #9352] Fix wrong value in topic-group cache by @golden-yang in #9424
• [ISSUE #9441] Add file length check in IndexService by @lizhimins in #9442
• [ISSUE #9443] Fix add wrong value to topicGroupTable in ConsumerManager by @yx9o in #9444
• [ISSUE #9254] Add CombineConsumeQueue to support CQ migration by @qianye1001 in #9256
• [ISSUE #9439] Add escape for win in the method returning broker configuration by @Crazylychee in #9440
• [ISSUE #9451] Optimize back pressure default value to 1024. by @GenerousMan in #9452
• [ISSUE #9454] Make sure topic can be deleted when using RocksDB CQ by @qianye1001 in #9457
• Fix IllegalStateException during app shutdown caused by premature shutdown trigger by @hepengju in #9408
• [ISSUE #9335] Use MixAll.ROCKETMQ_HOME_DIR for home directory by @WJ66880 in #9474
• [ISSUE #9481] Fix Issue 4050 didn't fix completely by @WJ66880 in #9482
• [ISSUE #9489] Fix clean pull offset in #removeOffset by @3424672656 in #9490
• [ISSUE #8920] Refactor SSL context loading process to support multiple protocols dynamic loading by @EnableAsync in #9483
• [ISSUE #9491] Remove the volatile declaration for the two variables requestsWrite and requestsRead in the GroupCommitService class by @huanzhikang in #9492
• [ISSUE #9486] Fix missing of valueOfCurrentMinusBorn equals checkImmunityTime by @WJ66880 in #9487
• [ISSUE #9497] Fix IndexOutOfBoundsException in getEarliestMessageTime when running in IPv6 environment by @woaishixiaoxiao in #9498
• [ISSUE #9479] Relax topic length constraint when creating retry and dlq topics by @Allenhuangrui in #9480
• [ISSUE #9476] Set queueId to 0 in DefaultTransactionalMessageCheckListener#toMessageExtBrokerInner to improve performance by @mxsm in #9477
• [ISSUE #9447] Avoiding possible resource leaks in InputStream by @AROP-REPLICATION in #9459
• [ISSUE #9467] Implement paged retrieval of Topic and SubscriptionGroup information by @ltamber in #9468
• [ISSUE #8920] Make TLS certificate watch interval configurable by @EnableAsync in #9513
• fix CONTRIBUTING.md spelling mistake by @datagramsocket in #9511
• [ISSUE #9501] Correcting mismatched comments by @yx9o in #9502
• [ISSUE #9515] Return origin handle to consumer when changeInvisibleDuration encounters flow limit by @qianye1001 in #9516
• [ISSUE #9254] Fix combineCQ extra search commitLog files for recovery by @qianye1001 in #9526
• [ISSUE #9309] Avoid the generation of dirty data in #assignResetOffset by @3424672656 in #9310
• [ISSUE #9530] Reduce unnecessary memory allocation in adaptiveBackOffSpinLock by @3424672656 in #9530
• [ISSUE #9520] Remove unnecessary topicConfig data version change when enable split registration by @RongtongJin in #9521
• [ISSUE #9254] Optimize the logs of the message store by @qianye1001 in #9528
• [ISSUE #9537] MQClientAPIFactory Implement NameServerUpdateCallback interface by @qianye1001 in #9538
• [ISSUE #9544] Must correct file size when init the file segment by @lizhimins in #9545
• [ISSUE #9539] Fix compare policy entry logic in ACL 2.0 by @1782935682 in #9540
• [ISSUE #9534] Remove the meaningless brokerVersion by @RongtongJin in #9533
• [ISSUE #9555] Fix the npe in the hashCode method when subscriptionDataSet is null by @1782935682 in #9556
• [ISSUE #9553] Improve performance by avoiding repeated get(key) by @yx9o in #9554
• Limit group max length to 120. by @lollipopjin in #9563
• [ISSUE #9254] Refactor notifyMessageArriveInBatch in RocksDBConsumeQueueStore to adapt to CombineConsumeQueueStore by @qianye1001 in #9566
• [ISSUE #9572] Unnecessary code comment cleanup by @yx9o in #9573
• Fix typos by @co63oc in #9560
• [ISSUE #9254] Optimize innerConsumeQueueStoreList order in CombineConsumeQueueStore by @qianye1001 in #9599
• [ISSUE #9596] Optimize log in invokeSync when addr is null by @1782935682 in #9597
• [ISSUE #9605] Fixed a potential resource leak by @yx9o in #9606
• [ISSUE #9589] Optimize broker metrics initialization by @qianye1001 in #9598
• [ISSUE #9611] Should exec callback in the Pop based on rocksdb impl by @lizhimins in #9612
• [ISSUE #9600] Remove wrong logic in the callback for sending messages in rpc by @3424672656 in #9608
• [ISSUE #9626] Prevent premature offset commit before consumer record flush by @lizhimins in #9627
• [ISSUE #9542, #9609] Fix bazel CI and reduce dependencies by @xuhongxu96 in #9610
• [ISSUE #9652] Enhance test for MQClientInstance by @GabrielDUX in #9653
• [ISSUE #9648] Fix getOffsetInQueueByTime missing boundaryType in tieredMessageStore by @GabrielDUX in #9649
• Fix start() and shutdown() of DefaultMessagingProcessor by @redlsz in #7838
• [ISSUE #9663] Adopt Maven's revision mechanism (requires Maven >= 3.5.0) by @cvictory in #9665
• [ISSUE #9650] Unified FAQ related URLs by @yx9o in #9651
• [ISSUE #9620] Placeholder replacement string concatenation by @yx9o in #9621
• [ISSUE #9581] Optimize the resource bloat of pollingMap and topicCidMap in LMQ scenarios by @RongtongJin in #9579
• [ISSUE #9764] Fix bazel-compile (ubuntu-latest) error by @yx9o in #9675
• [ISSUE #9666] Add accelerated startup recovery feature for RocksDB store with SYNC_FLUSH by @RongtongJin in #9667
• [ISSUE #9634] Improve BrokerContainer extensibility and module structure by @RongtongJin in #9635
• [ISSUE #9547] Fix sync group if attributes isn't null by @1782935682 in #9679
• [ISSUE #9682] Increase initial delay for scanning inactive brokers to 5000 milliseconds by @mxsm in #9683
• [ISSUE #9680] Improve RocksDB compaction filter factory resource management by @RongtongJin in #9681
• [ISSUE #9677] Resolve metrics static variable conflicts in BrokerContainer mode by @RongtongJin in #9678
• [ISSUE #9695] ...

What's Changed

This version no longer supports "ACL 1.0" related features, please use "ACL 2.0".
Additionally, this minor version includes several general bug fixes.

• [ISSUE #8997] Ensure there is an opportunity to send a retry message when broker no response by @gaoyf in #9137
• [ISSUE #9233] Query message in tiered storage may fail for the first correct index file was not selected by @bxfjb in #9234
• [ISSUE #9246] Support init offset mode in PopConsumerService by @lizhimins in #9247
• Fix unstable test: BrokerOuterAPITest.test_needRegister_timeout by @DivyanshIITB in #9250
• [ISSUE #9249] When delivery fails, there is an incorrect start offset in the delivery settings by @coolmoon101 in #9252
• [ISSUE #9241] RocksDBConsumeQueueStore do not need to update StoreCheckpoint by @qianye1001 in #9242
• [ISSUE #9244] Avoid writing dirty data in consumption mode by @3424672656 in #9245
• [ISSUE #8701] Fix documentation for brokerAddrTable property in MQClientInstance.java by @DivyanshIITB in #9263
• [ISSUE #8243] Update Configuration Docs for RocketMQ 5.x Compatibility by @DivyanshIITB in #9258
• [ISSUE #9259] Remove duplicate flushing operation of StoreCheckpoint by @mxsm in #9260
• [ISSUE #9266] Update the Quick Start version in README to the latest by @yx9o in #9267
• [ISSUE #7948] Prevent invoking the queryMessage method lead to OOM by @yangxiaohui-coll in #9265
• [ISSUE #9271] Enhance tiered storage getQueueOffsetByTimeAsync by @bxfjb in #9272
• [ISSUE #9282] Optimize BrokerController#printWaterMark by @yx9o in #9283
• [ISSUE #9304] Resolve cold data read control issue in DefaultMessageStore by @ymwneu in #9305
• [ISSUE #9300] Periodic cleanup of inactive items in StatsItemSet by @ymwneu in #9301
• [ISSUE #9286] Counting the filtered message when filter by SQL92 by @ymwneu in #9287
• [ISSUE #9284] When pullMessage overflow one, should refresh recordDiskFallBehind data by @ymwneu in #9285
• [ISSUE #9279] Restrict system subscription group creation and add pull request rejection policy by @ymwneu in #9280
• Avoid NPE for handling client settings null in notifyClientTermination by @lollipopjin in #9308
• [ISSUE #9297] Supports outputting topic put TPS in TopicStatusSubCommand by @ymwneu in #9298
• [ISSUE #1918] Catch throwable in PullMessageService thread run method by @fuyou001 in #9278
• [ISSUE #9302] SendMessageContext add message type by @ymwneu in #9303
• Optimize the log output of tlsHelper by @RongtongJin in #9324
• Prxoy remoting compatible batch message by @gaoyf in #9295
• [ISSUE #9115] Optimize the broker's reverse notification for consumerId change by @yx9o in #9116
• [ISSUE #9288] Support the disablement of producer registration and fast channel shutdown by @ymwneu in #9293
• [ISSUE #9331] Found one info log lose parameters during proxy startup by @WJ66880 in #9332
• Make sure to create system topics to all the brokers in 'systemTopicClusterName' cluster by @lollipopjin in #9327
• [ISSUE #9339] Fix pop update consumption offset when message are filtered by @lizhimins in #9340
• [ISSUE #9358] Timediff should multiply 1000 when query message from tiered storage by @bxfjb in #9359
• [ISSUE #9360] Fix some services are not shut down when the broker goes offline by @lizhimins in #9361
• [ISSUE #9351] Add topic-group mapping in queryTopicConsumeByWho command by @golden-yang in #9352
• [ISSUE #9313]add scheduled clean task. by @GenerousMan in #9314
• [ISSUE #9369] Fix reset offset commit pull offset when use pop consumer service by @lizhimins in #9370
• [ISSUE #9371] Delete ConsumeQueue index before CommitLog in tiered storage by @lizhimins in #9372
• [ISSUE #9233] Fix query time boundary calculation in tiered storage by @dingshuangxi888 in #9374
• [ISSUE #9375] Make client trace thread can be closed correctly by @qianye1001 in #9376
• [ISSUE #9362] [RIP-77] Deprecate and Remove ACL 1.0 by @dingshuangxi888 in #9363
• [ISSUE #9377] Fix 'send trace data can fail if shutdown producer immediately' by @kingkh1995 in #9378
• [ISSUE #9379] Fix timeStoreTable delete logic in IndexService by @lizhimins in #9384

New Contributors

• @janni1288 made their first contribution in #9238
• @DivyanshIITB made their first contribution in #9250
• @coolmoon101 made their first contribution in #9252
• @yangxiaohui-coll made their first contribution in #9265
• @WJ66880 made their first contribution in #9332

Full Changelog: rocketmq-all-5.3.2...rocketmq-all-5.3.3

What's Changed

This release introduces a new implementation of Pop consumption based on RocksDB (in the alpha phase, see RIP-73 for details). It improves and provides a migration plan for the capability of using RocksDB to store consumption queue indexes, adds support for the ability to cancel scheduled messages, enhances graceful online and offline capabilities, and includes numerous regular detail fixes related to HA, ACL, Metrics and Pop consumption.

• [ISSUE #8784] PrintMessageSubCommand support lmq by @RongtongJin in #8785
• [ISSUE #8790] Add Utils for put header to Metadata to avoid duplicate data by @dingshuangxi888 in #8792
• [ISSUE #8802] Update controller design.md by @luozongle01 in #8803
• [ISSUE #8798] Fix typo by @luozongle01 in #8799
• [ISSUE #8804] Clean offset when remove group offset by @leizhiyuan in #8805
• [ISSUE #8806] Fix autoBatch bug when connecting multiple RocketMQ clusters. by @luozongle01 in #8807
• [ISSUE #8810] Fix independent execution of e2e and benchmark deployments by @chi3316 in #8812
• [ISSUE #8816] Fix log typo. by @luozongle01 in #8817
• [ISSUE #8764] Implement consume lag estimation in cq rocksdb store by @LetLetMe in #8800
• [ISSUE #8824] Fix IllegalStateException caused by logical errors by @yx9o in #8825
• [ISSUE #8780] Implement asynchronous storage of ack/ck messages in pop consume to enhance performance by @RongtongJin in #8727
• [ISSUE #8835] When ck is in the buffer, incomplete ack will lead to message duplication. by @GenerousMan in #8836
• [ISSUE #8820] Fix variables match annotation (@RocketMQResource) by @mawen12 in #8821
• [ISSUE #8830] Fix atomic flush incorrect use and clean up code by @lizhanhui in #8830
• [ISSUE #8829] Fix make ConsumeQueueStore bottom most compression type configurable by @lizhanhui in #8841
• [ISSUE #8839] Remove unnecessary synchronized to improve concurrency by @lizhanhui in #8840
• [ISSUE #8833] Update netty version to 4.1.114 to fix CVE-2023-34462 by @ShannonDing in #8832
• [ISSUE #8846] Fix registerProducer should not be affected by concurrent scanNotAct… by @lizhanhui in #8847
• [ISSUE #8829] Support LMQ dispatch in case if Consume Queue Store is RocksDB-based by @lizhanhui in #8842
• [ISSUE #8850] Use correct log method by @mawen12 in #8851
• [ISSUE #8772] Remove lock mq step in broadcasting mode rebalancing by @redlsz in #8774
• [ISSUE #8442] [RIP-70] Extract adaptive lock mechanism by @3424672656 in #8663
• [ISSUE #8829] Feat: provide ConfigManagerV2 to make best uses of RocksDB by @lizhanhui in #8856
• [ISSUE #8822] Double write cq, reduce unnecessary switches by @LetLetMe in #8823
• [ISSUE #8875] Fix HAConnection leak by @crazywen in #8876
• [ISSUE #8725] Clean DefaultMQPushConsumer after start fail by @yuz10 in #8726
• [ISSUE #8829] Keep data version while reload and XXXConfigManagerV2 turns off sync by @lizhanhui in #8891
• [ISSUE #8885] Resolve the issue of inaccurate CK number statistics by @RongtongJin in #8886
• [ISSUE #8808] Resolve unsupported 'UseBiasedLocking' VM Option for JDK21 by @taomaree in #8809
• [ISSUE #8882] Change the compare method for acl signature to improve the security. by @dingshuangxi888 in #8883
• [ISSUE #8889] handle namespace outside the loop by @mawen12 in #8890
• [ISSUE #8906] Handle string toUpperCase outside the loop by @mawen12 in #8907
• [ISSUE #8599] Throw exception when receiving GO_AWAY twice to close channel. by @qianye1001 in #8862
• [ISSUE #8917] Topic route return none permission message queues for gRPC client by @dingshuangxi888 in #8919
• [ISSUE #8921] Add isWakeCommitWhenPutMessage for AIO by @zk-drizzle in #8922
• [ISSUE #8925] Fix the bug of update user for ACL 2.0 by @dingshuangxi888 in #8926
• [ISSUE #8909] Move nullcheck ahead by @jjastan in #8910
• [ISSUE #8942] Add incGroupAckNums and incGroupCkNums to LmqBrokerStatsManager by @RongtongJin in #8943
• [ISSUE #8829] Support for Persisting LMQ Consumer Offsets in Config V1 Using RocksDB by @RongtongJin in #8939
• [ISSUE #8945] Remove unnecessary operations from the critical section by @3424672656 in #8946
• [ISSUE #8940] Fix incorrect path for exportMetadataInRocksDBCommand by @RongtongJin in #8941
• [ISSUE #8935] Fix behind metrics unit error in timer message store by @GenerousMan in #8936
• [ISSUE #8765] Fix low performance of delay message when enable rocksdb consume queue by @yuz10 in #8766
• [ISSUE #8953] Improve IO for asynchronous delivery processes by @3424672656 in #8954
• [ISSUE #8829] Fix avoid memory overhead when there is large number of LMQ CQ by @lizhanhui in #8956
• [ISSUE #8947] Notify pop request before calculate consumer lag by @lizhimins in #8949
• [ISSUE #8933] feat: DefaultPullConsumer add balance switch. by @humkum in #8934
• [ISSUE #8929] Proxy adds message body empty check when send in grpc protocol by @qianye1001 in #8930
• [ISSUE #8877] Refactor lock in ReceiptHandleGroup to make the lock can be properly released when future can not be completed. by @qianye1001 in #8916
• [ISSUE #8955] Fix message buffer not release and dispatch thread exit in tiered storage by @lizhimins in #8965
• [ISSUE #8972] Adding the EnableLmqStats option allows monitoring of LMQ statistics at runtime by @RongtongJin in #8973
• [ISSUE #8961] Automatic recognition of address scheme in Topic Route by host by @dingshuangxi888 in #8962
• [ISSUE #8460] Set default broker name when revive found ack without broker name field by @lizhimins in #8981
• [ISSUE #8982] Dynamically install latest Go version for e2e pipeline by @chi3316 in #8985
• [ISSUE #8976] Modify file segment construct method by @lizhimins in #8977
• [ISSUE #8963] Fix code36 request sent to ns by @yx9o in #8964
• [ISSUE #8968] Introduce the clearRetryTopicWhenDeleteTopic option to enable precise external deletion of topics by @RongtongJin in #8969
• [ISSUE #8991] PrepareHeartbeatData should not be set by default subscriptionDataSet data by @weihubeats in #8992
• [ISSUE #7199] GrpcClientChannel header add null judgement by @weihubeats in #7238
• [ISSUE #9009] Optimize message accumulation display and Metrics in DefaultPullConsumer by @qianye1001 in #9010
• [ISSUE #8984] Fix the broker switch enableMixedMessageType doesn't work by @redlsz in #8986
• [ISSUE #8950] Remove Redundant nullcheck of configPath by @jjastan in #8951
• [ISSUE #8966] Feat: add remote address information to acl perm error by @humkum in #8967
• [ISSUE #9007] Fix client connection local ip is null in RemotingClient by @weihubeats in #9008
• [ISSUE #9014] Fix clusterAclConfigVersion command execution failed by @yx9o in #9017
• [ISSUE #7480] Fix the offset in the timerCheckPoint will not be corrected when the commitlog and consumeQueue are truncated by @RongtongJin in #7488
• [ISSUE #9015] Sync SysFlag and message body inflation status; allow omit of message body by @lizhanhui in #9016
• [ISSUE #8979] Add configurable switch for timer message retry logic by @chi3316 in #8980
• [ISSUE #9034] Refactor(LmqBrokerStatsManager): Refactor Redundant Code in LmqBrokerStatsManager by @asapple in #9034
• [ISSUE #8974] Support recalling of delay message by @imzs in #8975
• [ISSUE #9042] Update createTimerMessageStore call with new parameter by @chi3316 i...

This release contains some important bug fix and improvement since version 5.3.0

What's Changed

• [ISSUE #8375] Add more test coverage for MqClientAdminImpl by @yx9o in #8376
• [ISSUE #8365] Add remoting client non-oneway updateConsumerOffset function by @qianye1001 in #8368
• [ISSUE #8384] Add more test coverage for ClientConfig by @yx9o in #8385
• [ISSUE #8350] Fix properties store error: crc32ReservedLength make undefine mem… by @DongyuanPan in #8351
• [ISSUE #8365] Add remoting client non-oneway updateConsumerOffset function by @qianye1001 in #8391
• [ISSUE #8372] Add more test coverage for AdminBrokerProcessor by @TanXiang7o in #8373
• [ISSUE #8396] Fix typo in TraceConstants by @yx9o in #8398
• [ISSUE #8392] Add tests for QueryMessageProcessor by @TanXiang7o in #8393
• [ISSUE #8366] Eliminate deadlocks during the client shutdown process. by @YanYunyang in #8367
• [ISSUE #8400] Add tests for ConsumerManageProcessor by @TanXiang7o in #8401
• [ISSUE #8345] Add some tests for nameserver by @TanXiang7o in #8349
• [ISSUE #8411] Add more test coverage for DefaultMQPushConsumerImpl by @yx9o in #8412
• [ISSUE #8413] Add some test cases for commom module by @yueranniu in #8414
• [ISSUE #8405] Add the ability to write ConsumeQueue using fileChannel to prevent JVM crashes in some situations by @RongtongJin in #8403
• [ISSUE #8402] Fix init retry topic offset incorrect when EscapeBridge enabled by @imzs in #8404
• [ISSUE #8421] Add more test coverage for SlaveSynchronize by @TanXiang7o in #8422
• [ISSUE #8417] Add some test cases for org.apache.rocketmq.common.AclConfig by @TeFuirnever in #8418
• [ISSUE #8409] Fix tiered storage roll file logic if committing the last part of a file failed by @bxfjb in #8410
• [ISSUE #8437] Add more test coverage for ClientRemotingProcessor by @yx9o in #8433
• [ISSUE #8438] Fix broker return two messages when query message and index service bug by @lizhimins in #8439
• [ISSUE #8434] Add test cases for org.apache.rocketmq.common.action by @TeFuirnever in #8435
• [ISSUE #8446] Add more test coverage for MQClientInstance by @yx9o in #8447
• [ISSUE #8458] Add more test coverage for ProcessQueue by @yx9o in #8459
• [ISSUE #8454] Active brokers number should be initailized to 1 in broker heartbeat manager. by @ShannonDing in #8453
• [ISSUE #8448] Commitlog class annotation optimize by @Qoozm in #8452
• [ISSUE #8429] Fix trace message loss when traffic is heavy by @LetLetMe in #8430
• [ISSUE #8261] Avoid unnecessary waiting when a response is successfully returned by @3424672656 in #8272
• [ISSUE #8332] Fix ack msg which has reached maxReconsumeTimes by @cserwen in #8333
• [ISSUE #7731] Fix runBroker.cmd cannot start on Windows (#7731) by @hackjus in #8338
• [ISSUE #8465] Add more test coverage for ConsumeMessagePopConcurrentlyService by @yx9o in #8466
• [ISSUE #8432] Make autoDeleteUnusedStats default to true by @RongtongJin in #8431
• [ISSUE #8463] Some statistical items should also be deleted to prevent memory leakage when a topic or group is deleted by @RongtongJin in #8464
• [ISSUE #8472] Fix pop message delay due to not notify message arriving after suspend by @lizhimins in #8473
• only initialize all the variables once to speed up test ConsumeMessageConcurrentlyServiceTest by @TestBoost in #8436
• [ISSUE #8460] Improve the pop revive process when reading biz messages from a remote broker by @imzs in #8475
• [ISSUE #8476] Add test cases for org.apache.rocketmq.common.attribute by @TeFuirnever in #8477
• [ISSUE #8490] Fix getMaxReconsumeTimes calculation error in concurrent consumption mode by @yx9o in #8491
• [ISSUE #8495] Add more test coverage for PeekMessageProcessor by @TanXiang7o in #8498
• [ISSUE #8481] Improve delete and rolling strategy for tiered storage modules by @lizhimins in #8493
• [ISSUE #8486] Add more test coverage for BrokerMetricsManager by @ziiyee in #8487
• [ISSUE #8500] Add more test coverage for RocksDBLmqConsumerOffsetManager by @StudentGu in #8502
• [ISSUE #8496] Add more test coverage for ConsumeMessagePopOrderlyService by @yx9o in #8497
• [ISSUE #8503] Add test cases for org.apache.rocketmq.common.chain/coldstr/compression/consumer by @TeFuirnever in #8504
• [ISSUE #8514] Fix bazel-compile (ubuntu-latest) ci run failure by @yx9o in #8515
• [ISSUE #8510] Fix CI Failure in Test E2E Golang Job of PUSH-CI and PR-E2E-TEST by @chi3316 in #8520
• [ISSUE #8499] Modify batch send delay time to 3000ms in unit test. by @ShannonDing in #8522
• [ISSUE #8517] Fix client send UNREGISTER_CLIENT request twice may cause proxy NPE by @qianye1001 in #8528
• [ISSUE #8517] Add more test coverage for PullAPIWrapper by @yx9o in #8518
• [ISSUE #8460] Improve the pop revive process when reading biz messages from a remote broker - part2 by @imzs in #8494
• [ISSUE #8532] Fix flush metadata when commit file because of full file by @bxfjb in #8533
• [ISSUE #8531] Update jaeger-thrift, exclude unnecessary tomcat-embed-core by @leizhiyuan in #8536
• [ISSUE #8289] Fixed network bugs and merged networkutil code by @zekai-li in #8290
• [ISSUE #8519] Add test case for rocketmq acl module. by @HardX8 in #8508
• [ISSUE #8517] Add more test coverage for PullMessageService by @yx9o in #8542
• [ISSUE #8544] Add a retry mechanism to the unit test pipeline by @chi3316 in #8545
• [ISSUE #8547] Add more ControllableOffset by @syhleo in #8548
• [ISSUE #8551] Add more test coverage for AuthMigrator by @yx9o in #8552
• [ISSUE #8534] Supports timer message queries by @leizhiyuan in #8535
• [ISSUE #8565] Set specific permissions to trigger the workflow retry mechanism by @chi3316 in #8566
• [ISSUE #8553] Add UnitTest of OffsetSerialize by @syhleo in #8554
• [ISSUE #8562] Add more test coverage for StatefulAuthorizationStrategy by @yx9o in #8563
• [ISSUE #8549] Ipv6 enabled in broker, pickupStoreTimestamp size should be 20 by @leizhiyuan in #8567
• [ISSUE #8555] Make ctx constructed in scheduleRenewTask by @qianye1001 in #8556
• [ISSUE #8058] Support for upgrading metadata in json to rocksdb (#8045) by @LetLetMe in #8571
• [ISSUE #8573] Correct mismatched comments by @yx9o in #8574
• fix document typo in SlaveActingMasterMode.md by @maclong1989 in #8575
• [ISSUE #8544] Restore retry mechanism in unit test pipeline by @chi3316 in #8581
• [ISSUE #8137] Support pop consumption for light message queue by @HScarb in #8138
• [ISSUE #8576] Support Creating or Updating Subscription Groups in Batch by @caigy in #8577
• [ISSUE #8586] Add more test coverage for SelectMessageQueueByRandom by @yx9o in #8587
• [ISSUE #8592] Not notify long polling request when pop orderly consume blocked by @lizhimins in #8593
• [ISSUE #8607] Exclude loopback addresses when iterating over local network interfaces by @chi3316 in #8608
• [ISSUE #8601 ]When isPopShouldStop hit,unlock queueLockManager by @leizhiyuan in #8602
• [ISSUE #8591] Preliminary support for key commands of LMQ by @RongtongJin in #8590
• [ISSUE #8483] Optimize unnecessary broker reverse notification (notifyConsumerIdsChanged) in broadcast mode by @yx9o in h...

Feature

• [ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 by @dingshuangxi888 in #7725

Improvement

• [ISSUE #7831] Make rat-check successful by @caigy in #7832
• [ISSUE #7821] Add notifyLast flag for PopLongPollingService by @drpmma in #7835
• [ISSUE #7815] Use createChannelAsync for async invoke rpc by @drpmma in #7816
• [ISSUE #7840] Update the version in the README.md document to 5.2.0 by @mxsm in #7841
• Add statistics for the production of transaction messages. by @kingkh1995 in #7766
• [ISSUE #7868] Use entrySet to close channel by @ChineseTony in #7869
• [ISSUE #7845] Simplify the AbstractSendMessageProcessor#buildMsgContext code using Optional by @mxsm in #7846
• [ISSUE #7875] Add constructor for ProxyTopicRouteData by @drpmma in #7876
• [ISSUE #7881] Add parameter configuration explanations for jRaft controller by @RongtongJin in #7882
• fix document typo by @zjko in #7721
• [ISSUE #7907] Revise the description of transaction messages in Rocke… by @Gezi-lzq in #7908
• [ISSUE #7904] Use string builder to concat string by @ChineseTony in #7905
• [ISSUE #7926] Delete the unnecessary 'else' statement by @oopooa in #7920
• [ISSUE #7923] Exclude the master that are currently down. by @zhuyuemufeng in #7925
• [ISSUE #7932] Rectify the modifier order in namesrv by @oopooa in #7921
• Fix some ambiguous logs by @caizhaomin1 in #7934
• [ISSUE #7929] Add some request codes to the permission verification for the admin role by @RongtongJin in #7930
• [ISSUE #7945] Make HAProxyMessageForwarder Scalable by @dingshuangxi888 in #7946
• Fix notification integration test in pop consume mode by @drpmma in #7947
• [ISSUE #7943] Add bazel config for auth module and fix bazel test by @dingshuangxi888 in #7944
• [ISSUE #7955] Don't set default auth metadata provider by @dingshuangxi888 in #7956
• [ISSUE #7974] Add repeatedly read same offset log to find unexpected situations by @lizhimins in #7975
• [ISSUE #7961] Use BoundaryType in binarySearchInCQByTime by @Koado in #7968
• Consume request count threshold log fix by @iamgd67 in #7969
• [ISSUE #7970] remove unnecessary type cast by @ChineseTony in #7971
• [ISSUE #7983] Use java optional by @ChineseTony in #7984
• [ISSUE #7988] Refector client trace by @drpmma in #7989
• [ISSUE #7963] Check consumer group existence in updateConsumerOffset by @redlsz in #7964
• [ISSUE #7988] Set enableTrace default to false by @drpmma in #8015
• [ISSUE #8020] Fix document typo by @hakusai22 in #8021
• [ISSUE #8032] Set checkDupInfo value from config by @LittleBoy18 in #8033
• [ISSUE #6398] Remove duplicate code in TopicPublishInfo by @syshenyao in #8034
• [ISSUE #8023] Add expression filtering capability to the pullBlockIfNotFound method of pull consumer by @RongtongJin in #8024
• [ISSUE #8044] Add Override annotation for AllocateMappedFileService#run by @mxsm in #8045
• build: fix workflow and skip failed test for auth module on mac by @HScarb in #8068
• [ISSUE #8100] Expose print audit log function by @dingshuangxi888 in #8101
• [ISSUE #8105] Fix typo about udpate user by @zhiliatom in #8106
• [ISSUE #5923] Fix tiered store README.md error about Configuration by @yuz10 in #8110
• [ISSUE #8092] Fixed non-idempotent test by @kaiyaok2 in #8093
• [ISSUE #8090] Optimize isSetEqual for DefaultLitePullConsumerImpl by @Willhow-Gao in #8091
• [ISSUE #5838] Retry to send when broker returns SYSTEM_BUSY by @cserwen in #5845
• [ISSUE #5923] Fix tiered store README.md error by @yuz10 in #8115
• [ISSUE #8124] Avoid scheduled tasks exiting because of unknown exceptions by @colin719 in #8121
• [ISSUE #8079] Add unit test for MQClientAPIExtTest by @drpmma in #8080
• [ISSUE #8118] Remove redundant mod in client by @miles-ton in #8119
• [ISSUE #8136] Replace with createProcessQueue and remove createProce… by @miles-ton in #8139
• [ISSUE #8145] Optimize some code style in client module by @Willhow-Gao in #8146
• [ISSUE #8148] Fix variable typo by @oopooa in #8149
• [ISSUE #8155] Fix doc typo by @oopooa in #8157
• [ISSUE #8142] Show time of create topic and subScriptionGroup by @superdev42 in #8143
• [ISSUE #8164] Log more accurate for the MQClientInstance#doRebalance by @miles-ton in #8165
• [ISSUE #8162] Optimize the logging printout for the ConfigManager#loadBak method by @mxsm in #8163
• [ISSUE #8129] Support topic reserved time in tiered storage by @yuz10 in #8130
• [ISSUE #8166] Optimize make compression type configurable in producer clinet level by @humkum in #8167
• [ISSUE #8182] Modify variable names to enhance readability #8182 by @Stephanie0002 in #8183
• [ISSUE #6873] If dns resolve controller address exception will update controllerAddresses to null by @weihubeats in #8180
• [ISSUE #8222] Fix spelling errors in comments by @yx9o in #8224
• Revert "[ISSUE #7757] UseCompositeByteBufto prevent memory copy." by @yuz10 in #8209
• [ISSUE #8053] Return SYSTEM_BUSY if PutMessageStatus is OS_PAGE_CACHE_BUSY by @biningo in #8054
• [ISSUE #8211] Add two metrics rocketmq_topic_create_execution_time and rocketmq_consumer_group_create_execution_time by @Stephanie0002 in #8212
• [ISSUE #8223] Add two metrics rocketmq_topic_number and rocketmq_consumer_group_number by @Stephanie0002 in #8225
• [ISSUE #8235] Add @OverRide annotation for handleDiskFlush method by @mxsm in #8236
• [ISSUE #8241] Remove duplicate code by @3424672656 in #8242
• [ISSUE #8245] Fix typo in user_guide.md by @liuzc9 in #8244
• [ISSUE #8197] Support fast filter message by tag in tiered storage by @lizhimins in #8198
• [ISSUE #8269] Support pop consumption filter in long polling service by @lizhimins in #8271
• [ISSUE #8265] Implement Batch Creation of Topics in RocketMQ Admin by @guyinyou in #8267
• [ISSUE #8278] Fix fail test by @3424672656 in #8279
• [ISSUE #8285] Add more test coverage for BrokerPreOnlineService by @yx9o in #8286
• [ISSUE #8276] Merge duplicate code in DefaultMQProducer constructor by @yx9o in #8277
• Restrict some actions to be triggered only in the official repository by @totalo in #7695
• [ISSUE #7941] Increase annotation by @3424672656 in #7959
• [ISSUE #8227] Repeated merging in the constructor by @yx9o in #8228
• [ISSUE #8281] Optimize pop log level by @drpmma in #8282
• [ISSUE #8293] Remove the redundant code from the MessageDecoder#encodeMessage method by @mxsm in #8294
• [ISSUE #7466] Added fast failure in adminBrokerThreadPoolQueue (#7466) by @yp969803 in #7798
• [ISSUE #8300] Add more test coverage for DefaultMQProducer by @yx9o in #8301
• fix document typo in SlaveActingMasterMode.md by @maclong1989 in #8315
• [ISSUE #8274] Optimize some codestyles and fix some warnings by @Mrhorse99 in #8275
• [ISSUE #8291] Format proxy watermark output by @zhiliatom in #8292
• [ISSUE #8324] Add more test coverage for DefaultMQProducerI...

What's Changed

• [ISSUE #7579] Fix globalWhiteRemoteAddressStrategy concurrent bug by @leizhiyuan in #7580
• [ISSUE #7663] Bump snakeyaml version from 1.32 to 2.0 by @ShannonDing in #7663
• [ISSUE #7649] Add validation in broker/nameserver configure updating command by @RongtongJin in #7649
• [ISSUE #7653] Remove getBrokerClusterAclConfig from admin and server by @RongtongJin in #7653
• [ISSUE #7688] Bump guava version from 31.1-jre to 32.0.1-jre by @RongtongJin in #7688
• [ISSUE #7716] MQFaultStrategy check queue if writable by @leizhiyuan in #7716
• [ISSUE #7783] Fix the selectOneMessageQueue to avoid change messageQueue permanently by @Tcytw in #7783
• [ISSUE #7740] Optimize LocalFileOffsetStore by @redlsz in #7745
• [ISSUE #7538] Fix wrong cachedMsgSize if msg body is changed in consumer callback by @yuz10 in #7820
• [ISSUE #7849] Promptly return a response when the validation parameters cannot be modified by @RongtongJin #7849

Full Changelog: rocketmq-all-4.9.7...rocketmq-all-4.9.8

Feature

• [ISSUE #7545] [RIP-65] Support efficient random index for massive messages by @lizhimins in #7546
• [ISSUE #7064] [RIP-66] Support KV(RocksDB) Storage for ConsumeQueue by @fujian-zfj in #7120
• [ISSUE #7300] [RIP-67] jRaft-Controller Implementation by @yulangz in #7301

Improvement

• [ISSUE #7381] Fix the problem of inaccurate timer message metric by @GenerousMan in #7382
• [ISSUE #7389] Fix the problem that getLastMappedFile function affects performance by @guyinyou in #7390
• [ISSUE #7393] Add timeout configuration for grpc server by @drpmma in #7394
• [ISSUE #7396] Fix wrong word in BrokerController#doResterBrokerAll by @francisoliverlee in #7397
• [ISSUE #7313] Enhancement Optimization Method name by @shriVATSA54 in #7420
• [ISSUE #7321] Refactor NettyRemotingAbstract with unify future implementation by @drpmma in #7322
• [ISSUE #7296] Add ChannelEventListener for MQClientAPIImpl by @drpmma in #7324
• [ISSUE #7429] Clean channel map when CLIENT_UNREGISTER in proxy by @xdkxlk in #7426
• [ISSUE #7431] Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener by @RongtongJin in #7432
• [ISSUE #7433] Update the version in the README.md document to 5.1.4 by @mxsm in #7434
• [ISSUE #7441] Fix log "Init the confirmOffset" keep printing error in controller mode by @fujian-zfj in #7442
• [ISSUE #7444] Fix testCalculateFileSizeInPath test can not rerun in same environment by @RongtongJin in #7445
• [ISSUE #7425] Add RocketmqControllerConsole log to print config to console by @ingdex in #7458
• [ISSUE #7451] Override toString for TopicConfigAndQueueMapping by @LetLetMe in #7452
• [ISSUE #7265] Adding how to debug in Idea document by @joeCarf in #7266
• [ISSUE #7464] Polish the pop logger format by @joeCarf in #7465
• [ISSUE #7330] Fix channel connect issue for goaway by @drpmma in #7467
• [ISSUE #7472] AddBroker removes parsing configuration from body by @RongtongJin in #7472
• [ISSUE #7454] Utilizing cache to avoid duplicate parsing by @guyinyou in #7455
• [ISSUE #7475] Check the input yaml and the path in ACL by @GenerousMan in #7475
• [ISSUE #7231] Fix proxy client language error by @weihubeats in #7200
• [ISSUE #7489] Code comment enhancement in example by @joeCarf in #7490
• [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE by @drpmma in #7494
• [ISSUE #7486] Remove getBrokerClusterAclConfig from admin and server by @RongtongJin in #7486
• [ISSUE #7497] Extract the frequency of calling updateNamesrvAddr into a configuration by @xdkxlk in #7498
• [ISSUE #7437] Add the CRC check of commitlog by @guyinyou in #7468
• [ISSUE #7505] Do not validate the length when deleting a topic by @RongtongJin in #7506
• [ISSUE #7501] The broker supports idempotence in creating topics by @fuyou001 in #7502
• [ISSUE #7523] Message will flush timeout when transientStorePoolEnable=true and flushDiskType=SYNC_FLUSH by @fujian-zfj in #7524
• [ISSUE #7531] Clear POP_CK when sending messages by @xdkxlk in #7532
• [ISSUE #7419] Fix unstable UtilAllTest#testCalculateFileSizeInPath on Windows by @mureinik in #7419
• [ISSUE #7547] Let consumer be aware of message queue assignment change by @lizhanhui in #7548
• [ISSUE #7551] Reuse helper methods from Netty to free direct byte buffer by @lizhanhui in #7550
• [ISSUE #7570] Add default value for lastPopTimestamp by @HScarb in #7571
• [ISSUE #7462] Remove deprecated LocalTransactionExecuter by @985492783 in #7463
• [ISSUE #7567] TransactionProducer get the topic route before sending the message by @panzhi33 in #7569
• [ISSUE #7543] Retry topic v2 in pop by @drpmma in #7544
• [ISSUE #7577] SlaveActingMaster Timer Message retry without escape logic by @AYue-94 in #7578
• [ISSUE #7584] Add validation in broker/namesrv configure updating command. by @ShannonDing in #7584
• [ISSUE #7587] Add validation in broker container configure updating command by @RongtongJin in #7587
• [ISSUE #7586] Add set method for config black list in broker/namesrv/controller config. by @ShannonDing in #7586
• [ISSUE #7592] testCleanBuffer unit test modifies, changed non-direct … by @yp969803 in #7593
• [ISSUE #7534] Use high performance concurrent set to replace copyonwriteset by @keranbingaa in #7583
• [ISSUE #7585] Support message filtering in rocketmq tiered storage by @lizhimins in #7594
• [ISSUE #7614] Fix flaky test RocksDBMessageStoreTest by @lizhanhui in #7625
• [ISSUE #7638] Bump com.squareup.okio:okio-jvm from 3.0.0 to 3.4.0 by @dependabot in #7638
• [ISSUE #7627] Fix flaky test testSemiSyncReplicaWhenAdaptiveDegradation by @RongtongJin in #7631
• [ISSUE #7636] Bump snakeyaml from 1.32 to 2.0 by @RongtongJin in #7632
• [ISSUE #7637] Bump grpc from 1.50.0 to 1.53.0 by @RongtongJin in #7633
• [ISSUE #7634] Introduce controllableOffset to prevent unnecessary suspension when OFFSET_ILLEGAL by @drpmma in #7635
• [ISSUE #7585] Always return duplicate buffer when filter message and fix log format by @lizhimins in #7654
• [ISSUE #7543] Use "+" as the new separator for retry topic by @drpmma in #7655
• [ISSUE #7543] Only call a single type of retry topic in pop by @drpmma in #7665
• [ISSUE #7646] Optimize pull onException logging by @drpmma in #7647
• [ISSUE #7659] Trim property by @DongyuanPan in #7660
• [ISSUE #7656] ConfirmOffset directly takes the max offset when allAckInSyncStateSet is false by @RongtongJin in #7657
• [ISSUE #7669] Map variable delayLevelTable changed to ConcurrentSkipL… by @yp969803 in #7675
• [ISSUE #7679] Optimize the serialization of RemotingCommand processTimer property by @mxsm in #7683
• [ISSUE #7676] Use clientDecode for consuming message directly by @cserwen in #7677
• [ISSUE #7680] Bump guava version from 31.1-jre to 32.0.1-jre by @RongtongJin in #7681
• [ISSUE #7330] Add goaway and reconnection mechanism by @drpmma in #7331
• [ISSUE #7686] The bornTime is not set when using the popMessage API in cluster mode. by @dingshuangxi888 in #7687
• [ISSUE #7642] Add return value for sendHeartbeat related method by @drpmma in #7643
• [ISSUE #7644] Optimize client rebalance by @drpmma in #7645
• [ISSUE #7710] Handle blank string for UtilAll#split to fix the bugs of ACL by @Qinglong-Lee in #7712
• [ISSUE #7719] Add more property check for dealy message when auto-ba… by @zhiliatom in #7720
• [ISSUE #7543] Add enableRetryTopicV2 brokerConfig by @drpmma in #7734
• [ISSUE #7699] Add namespace v2 in client by @drpmma in #7700
• [ISSUE #7747] Simplify code checks using Optional in ClientRequestProcessor#getRouteInfoByTopic method by @mxsm in #7748
• [ISSUE #7495] Support Higher Java version in Windows by @joeCarf in #7507
• [ISSUE #7757] Use CompositeByteBuf to prevent memory copy. by @dao-jun in #7694
• [ISSUE #7760] Make timerSkipUnknownError can be set by config file by @leizhiyuan in #7763
• [ISSUE #7500] Enhanced metrics for timing and transactional messages by @GenerousMan in #7500
• [ISSUE #7699] Refactor NamespaceRpcHook by @drpmma in https://github.com/apache/rocketmq/pull/...