Skip to content

FIP-53: Log Scanner Offset Management #4608

Open

Description

@pisceslj

Search before asking

  • I searched in the issues and found nothing similar.

Description

Implementation of consumer offset commit to system table.

Willingness to contribute

  • I'm willing to submit a PR!

Activity

  1. added theissue type on Oct 12, 2026
  2. pisceslj commented on Oct 13, 2026

    @pisceslj
    ContributorAuthor

    Subtasks

    • 4625 [server] Add consumer offset table foundations
    • 4665 [rpc] Add consumer offset protocol and error definitions
    • 4714 [server] Add consumer group owner discovery
    • 4849 [server] Implement consumer offset commits
    • xx. Server-side fetch path (handleGetConsumerOffsets, point/prefix lookup, value decoding)
    • xx. Server-side management path (list / delete groups / delete offsets, prefix scan, tombstones)
    • xx. Client-side ConsumerGroupManager skeleton + FindConsumerGroupOwner (owner discovery, retries, rediscovery)
    • xx. Client-side commit path (sync/async commit, callback queue, partial failure handling)
    • xx. Client-side fetch path + auto-commit (committed offset retrieval, caching, periodic commits)
    • xx. LogScanner and MultiTableLogScanner integration (switch manually-assigned consumers to the new path, multi-table shared groupId)
    • xx. Admin API implementation (list/alter/delete offsets and groups)
    • xx. LogScannerITCase (end-to-end: starting offsets, auto-commit, restart recovery, multi-table)
    • xx. ConsumerGroupManagerFailoverITCase (immediate serving after leader switch, owner rediscovery, no data loss)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions