Skip to content

Add benchmarking for writing and compacting vortex files #10386

Open
0 of 1 issue completed
Open

Description

@joseph-isaacs

Currently we mostly focus on read performance in vortex.

We should add more comprehensive writer performance benchmarks. We have https://github.com/vortex-data/vortex/tree/develop/benchmarks/compress-bench but those hides to compress and decompress and also excludes other benchmarks compression time (eg. clickbench).

We should update this benchmark to break out compression, size and decompression speed and also include all other sql benchmarks

We should have mode of compression.

  1. quick ingestion time
  2. slow compaction time
  3. very slow, but faster to scan

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions