跳到正文
Hacker News:AI 熱帖·· 3 天前AI 評分39

Lakegres:在現有開放式、Hudi 或 Iceberg 資料表上進行向量搜尋

Lakegres: Vector search on existing Open/Hudi/Iceberg tables

AI 導讀

Lakegres 提供在現有開放式、Hudi 或 Iceberg 資料表上進行向量搜尋的功能。相關設計的 RFC 記錄了儲存佈局、查詢路徑和一致性模型;Hudi 實作正提交至上游,Apache XTable(Incubating)則正在進行候選版本測試,為開源發布作準備。

正文

Image 1Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Lakegres: Vector search on existing Open/Hudi/Iceberg tables (onehouse.ai) 24 points by cloud8bits1 hour ago | hide | past | favorite | 5 comments help Image 2jauntywundrkind46 minutes ago | next[–] Pretty good write up, talking to the problem, surveying what and how other players do things? Went looking to see if there was going to be anything open (mostly it's product pitch), found: >Iceberg support builds on the Hudi-backed indexing work in Apache XTable (Incubating). We developed the design in the open with engineers from Uber and Walmart to support their planet-scale tables. The open RFC documents the storage layout, query path and consistency model. >The design is settled and ships in Lakegres today; the Hudi implementation is being upstreamed and XTable is in release-candidate testing ahead of OSS releases that other engines can integrate. With two links inline, https://github.com/apache/incubator-xtable/pull/935https://github.com/apache/hudi/blob/master/rfc/rfc-109/rfc-1... reply Image 3gardnr41 minutes ago | parent | next[–] The problem doesn’t really seem to be solved though. Most attempts at decentralized index storage will be limited by what this project calls nprobes. The authors propose a cheap search first approach but it’s unclear how it scales. reply Image 4tokYoComPleX1 hour ago | prev | next[–] This is a solidly built feature with great performance eclipsing other competing solutions on the market. reply Image 5CBLT54 minutes ago | parent | next[–] Since you created an account just to compliment this product, it would probably be best to explain your relationship to the product in question. Even a simple "not affiliated, just a happy user" would be great. reply Image 6jyasveer1 hour ago | prev[–] great reply Image 7 Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search:

來源:Hacker News:AI 熱帖 · news.ycombinator.com