Skip to content

[Engine] Full support for IQ4_NL #4055

Closed as not planned
Closed as not planned

Description

@jintakhan

I'm looking for a quant of a size and quality in between IQ4_XS and Q4_K_XL. The IQ4_NL quant from ggml-org fits the bill but Strata currently lacks the kernel support for IQ4_NL gate/up projections. Would be great if support for it could be added.

  • Strata version: v0.2.3.1
  • Graphics card: 7900XT, 20GB VRAM; R9700, 32GB VRAM
  • RAM: 96GB
  • OS: Fedora 44

Activity

  1. github-actions commented on Oct 25, 2026

    @github-actions

    Thanks for the issue. To keep the tracker readable, every item needs an area prefix in the title and the parts of the issue form filled in. This one is missing:

    • Add the Strata version (Settings > About, or strata --version).
    • Add your graphics card with its VRAM, your RAM and your operating system.

    Edit the issue (title and description) and this note goes away on its own. If it is still missing parts in 5 days it will be closed, which is not a rejection: fix it and comment /reopen.

    Details: CONTRIBUTING.md

  2. github-actions commented on Oct 25, 2026

    @github-actions

    Thanks, this follows the format now.

  3. jintakhan commented on Oct 25, 2026

    @jintakhan
    Author

    /reopen

  4. changed the title [-][Engine] Support for ggml-org IQ4_NL quant[/-] [+][Engine] Full support for IQ4_NL[/+] on Oct 25, 2026
  5. jintakhan commented on Oct 25, 2026

    @jintakhan
    Author

    Duplicate/related issue: #4060. Title updated to reflect that Bartowski also uses IQ4_NL.

  6. Niko1221 commented on Nov 5, 2026

    @Niko1221
    Owner

    Thanks for taking the time to report this.

    Strata has changed a lot since this was opened, and 0.2.11 is out now, so many older reports no longer apply. We're closing issues older than a week that have had no new reports in the last week. Closed here does not mean rejected.

    To reopen it takes about two minutes:

    1. Re-test on 0.2.11. It may already be fixed. Write down what you see.
    2. Start the title with its area: [Engine], [GUI], [TUI], [Benchmark], [Docs] or [Other].
    3. Fill in the parts of the issue form: what happened, the Strata version, your graphics card, memory and system.
    4. Comment /reopen. A check runs and either reopens the issue or lists what is still missing.

    The rules are in CONTRIBUTING.md.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions