-
Notifications
You must be signed in to change notification settings - Fork 22
[MOD-13164] [MOD-13481] Introduce VecSimDiskParams Wrapper for Disk-Based Vector Indexes
#887
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
add VecSimHNSWDiskParams to AlgoParams
VecSimHNSWDiskParams: replace hnsw alg parametrs with HNSWParams struct introduce TieredHNSWDiskParams have TieredHNSWDiskParams in the union of TieredIndexParams
| void *storage; // Opaque pointer to disk storage | ||
| const char *indexName; | ||
| size_t indexNameLen; | ||
| void *logCtx; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
void *logCtx is in VecSimParams
move disk params to VecSimParamsDisk
VecSimParamsDisk Wrapper for Disk-Based Vector Indexes
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #887 +/- ##
==========================================
- Coverage 97.13% 97.09% -0.05%
==========================================
Files 129 129
Lines 7615 7493 -122
==========================================
- Hits 7397 7275 -122
Misses 218 218 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
typedef struct {
void *storage; // Opaque pointer to disk storage
const char *indexName;
size_t indexNameLen;
} VecSimDiskContext;
split VecSimParamsDisk to:
typedef struct {
VecSimParams *indexParams;
VecSimDiskContext *diskContext;
} VecSimDiskParams;
VecSimParamsDisk Wrapper for Disk-Based Vector IndexesVecSimDiskParams Wrapper for Disk-Based Vector Indexes
Generalize the disk index creation API to support any disk-based algorithm.
Problem:
storage,indexName) was embedded inVecSimHNSWDiskParamsSolution:
VecSimDiskContextfor disk metadata (storage, indexName)VecSimDiskParamswrapper that accepts anyVecSimParams*+ disk contextVecSimHNSWDiskParams- useHNSWParamsdirectlyTieredHNSWDiskParamsto support Tiered HNSW Disk