Skip to content

ANN layer with LSH #80

Description

@deBrian07

fingerprint query ──► MinHash signature (256 ints)
└─query ANN index──► 30-50 candidate song_ids ──► exact vote buckets only for those

  1. Sketch each song’s hash set into a small, fixed-length MinHash vector.

  2. Bucket similar signatures with LSH bands so “likely matches” land in the same slot.

  3. At query time, collide once, pull ≤ 50 song IDs, and run your exact voter only on those.

  4. Result: 10–100× fewer DB hits and ~10× faster P95 latency, with recall ≈ ideal.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    • Status
      Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions