Skip to content

Handling pathological xz files #17

Closed

Description

@mhenriks

Hi, KubeVirt's Containerized Data Importer project uses nbdkit internally to "import" xz compressed disk images. I just want to make you aware of an issue that has come our way: kubevirt/containerized-data-importer#2288

There are two problematic URLs, but I mostly want to bring your attention to the second: https://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2.xz

It is a single stream/single block xz file. Since the goal of our project is maximum compatibility, and there is no way to realistically support such pathological cases with nbdkit xz filter as-is, we are researching alternatives.

Do you think it makes sense for xz filter to handle these pathological files? I guess you'd have to do something similar to the gzip filter where the entire file is downloaded and extracted.

Activity

  1. rwmjones commented on Jun 13, 2022

    @rwmjones
    Member

    nbdkit is managed as a gitlab project now: https://gitlab.com/nbdkit/nbdkit

    I answered the query on the other ticket.

  2. added a commit that references this issue on Aug 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions