semantic search rs
1.0.0
demo pencarian semantik dengan server gRPC di Rust
src/hnsw_index ( hnswlib-rs ) dari proyek ini dan impor dari peti. std::simd ( packed_simd_2 ) Ekstrak embeddings dari dokumen yang diberikan dan buat & simpan indeks ke disk lokal.
cargo +nightly run --release --features progress --bin embedding Jika Anda menginginkan kuantisasi, teruskan quantize ke argumen.
cargo +nightly run --release --features progress --bin embedding quantizeBangun & Jalankan server gRPC (untuk model & inferensi pencarian).
make serverBangun & Jalankan klien gRPC. Klien akan mulai melakukan benchmark server berdasarkan parameter yang diberikan.
make client Anda juga dapat mengubah argumennya. misalnya ./client num_users num_requests bs k
cargo +nightly run --release --bin client 1 1000 128 10 Jalankan contoh dengan kueri yang diberikan. (harus ada indeks yang dibangun dengan dataset ag_news )
cargo +nightly run --release --features progress --bin main " query " AVX2 , flag FMA% latensi sedikit berbeda dari versi Rust. Pada versi terbaru (1.73.0 nightly), kecepatannya menjadi lebih lambat (2.275 ms -> 3.000 ms).
% i8 diukur dengan 1.73.0.
| P | dist | bs | persyaratan | k | jenis | berarti | hal95 | hal99 | hal99.9 | maks | QPS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| f32 | L2 | 1 | 10k | 10 | total | 4,833 mdtk | 5,426 ms | 6,037 mdtk | 9,578 ms | 12,411 mdtk | 207 |
| model | 4,507 ms | 4,994 ms | 5,505 ms | 8,979 mdtk | 12,094 mdtk | ||||||
| mencari | 0,203 ms | 0,308 ms | 0,354 ms | 0,449 ms | 0,567 ms | 4926 | |||||
| 32 | 1k | 10 | total | 10,403 mdtk | 10,951 ms | 11,625 ms | 16,794 mdtk | 16,794 mdtk | 3076 | ||
| model | 9,211 mdtk | 9,684 mdtk | 10,226 ms | 14,796 ms | 14,796 ms | ||||||
| mencari | 0,981 ms | 1,183 mdtk | 1,386 ms | 2,386 ms | 2,386 ms | 32620 | |||||
| 128 | 1k | 10 | total | 32.220 ms | 32,602 ms | 32,862 ms | 33,440 ms | 33,440 ms | 3973 | ||
| model | 29,120 mdtk | 29,411 mdtk | 29,653 mdtk | 30,333 ms | 30,333 ms | ||||||
| mencari | 2,855 ms | 3,007 mdtk | 3,154 ms | 3,452 ms | 3,452 ms | 44834 | |||||
| Karena | 128 | 1k | 10 | total | 31,547 ms | 31,890 ms | 32,087 mdtk | 33,479 ms | 33,479 ms | 4128 | |
| model | 28,992 mdtk | 29,229 mdtk | 29,438 ms | 30,936 ms | 30,936 ms | ||||||
| mencari | 2,275 ms | 2,444 ms | 2,595 ms | 2,722 ms | 2,722 ms | 56264 | |||||
| i8 | Karena | 128 | 1k | 10 | total | 30,896 ms | 31,271 mdtk | 31,483 mdtk | 31,786 mdtk | 31,786 mdtk | 4142 |
| model | 28,816 mdtk | 29,123 mdtk | 29,286 mdtk | 29,598 ms | 29,598 ms | 4442 | |||||
| mencari | 1,764 ms | 1,934 ms | 2,006 ms | 2,308 ms | 2,308 ms | 72560 |
| P | dist | bs | persyaratan | k | berarti | hal50 | hal95 | hal99 | hal99.9 | maks | QPS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| f32 | karena | 1024 | 2k | 10 | 10,969 mdtk | 10,856 ms | 12,078 mdtk | 12,384 ms | 14,817 mdtk | 18,024 mdtk | 93354 |
| 2048 | 2k | 10 | 21,829 mdtk | 21,617 mdtk | 23,952 ms | 24,514 ms | 25,892 ms | 26,171 mdtk | 93820 | ||
| 4096 | 2k | 10 | 43,538 ms | 43,199 mdtk | 46,303 ms | 48,374 ms | 50,194 ms | 57,159 ms | 94079 | ||
| 8192 | 2k | 10 | 86,234 ms | 85,684 ms | 90,645 ms | 93,850 ms | 101,188 mdtk | 102,607 mdtk | 94997 | ||
| i8 | karena | 1024 | 2k | 10 | 9,102 mdtk | 9,022 mdtk | 10,043 mdtk | 10,222 mdtk | 11,297 mdtk | 11,602 mdtk | 112506 |
| 2048 | 2k | 10 | 18,084 mdtk | 17,867 mdtk | 19,799 mdtk | 20,548 ms | 22,749 ms | 29.330 ms | 113249 | ||
| 4096 | 2k | 10 | 35,772 ms | 35,488 ms | 38,246 mdtk | 40,089 ms | 41,745 ms | 43,144 ms | 114503 | ||
| 8192 | 2k | 10 | 71,447 ms | 70,790 ms | 76,420 ms | 78,610 mdtk | 94,783 mdtk | 122,490 ms | 114659 |
| P | dist | bs | persyaratan | k | berarti | hal50 | hal95 | hal99 | hal99.9 | maks | QPS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| f32 | karena | 1024 | 2k | 10 | 9,459 ms | 9,033 mdtk | 11,412 mdtk | 11,842 ms | 12,753 ms | 12,819 ms | 108252 |
| 2048 | 2k | 10 | 19,620 mdtk | 19,708 mdtk | 21,072 mdtk | 22,023 mdtk | 24,704 ms | 24,881 mdtk | 104383 | ||
| 4096 | 2k | 10 | 38,269 mdtk | 38,237 ms | 40,505 ms | 42,475 ms | 45,439 ms | 45,691 mdtk | 107030 | ||
| 8192 | 2k | 10 | 75,385 ms | 74,877 ms | 80,448 ms | 84,589 mdtk | 89,629 ms | 89,887 ms | 108668 | ||
| i8 | karena | 1024 | 2k | 10 | 7,003 mdtk | 6.700 ms | 8,270 ms | 8,668 ms | 9,655 ms | 10,011 mdtk | 146223 |
| 2048 | 2k | 10 | 14,388 mdtk | 14,419 mdtk | 15,637 ms | 16,067 mdtk | 19,237 mdtk | 20,231 mdtk | 142341 | ||
| 4096 | 2k | 10 | 27,894 ms | 27,815 ms | 29,818 ms | 31,213 mdtk | 39,733 mdtk | 40,387 ms | 146842 | ||
| 8192 | 2k | 10 | 54,674 ms | 54,348 ms | 57,844 ms | 61,486 mdtk | 100,327 ms | 135,911 ms | 149834 |
Asia shares drift lower as investors factor in Fed rate hike.Jarak kosinus
top 1 | id : 92048, dist : 0.3335874
Asian Shares Lower as Oil Fall Stalls SINGAPORE (Reuters) - Asian share markets saw light selling in line with a slowing retreat in oil prices on Tuesday, while the dollar steadied as officials in Europe and Japan fretted about the U.S. currency's recent decline.
top 2 | id : 65687, dist : 0.38142937
Asian Shares Lower on Earnings, Steel SINGAPORE (Reuters) - Asian share markets staged a broad-based retreat on Wednesday, led by steelmakers amid warnings of price declines, but also enveloping technology and financial stocks on worries that earnings may disappoint.
top 3 | id : 15361, dist : 0.39869058
Asian Stocks Mostly Lower on Tech Worries SINGAPORE (Reuters) - Asian shares were mostly lower on Tuesday, pulled down by technology stocks following worries about a sales forecast from bellwether Intel Corp. and unexpectedly flat industrial output in Japan.
top 4 | id : 63234, dist : 0.40184337
Asian Stocks Slip as Oil Moves Above $55 Asian share markets fell on Monday after oil hit a record above $55 a barrel, with investors cautious ahead of earnings reports from bellwether firms IBM and Texas Instruments later in the day.
top 5 | id : 76590, dist : 0.4137212
Asian Stocks Ease After China Rate Rise SINGAPORE (Reuters) - China's surprise interest rate rise weighed down Asian stocks on Friday as investors sold shares of miners, shippers and other firms whose fortunes have been closely linked to the country's rapid growth.
top 6 | id : 65572, dist : 0.4192986
Asian Shares Lower on Earnings SINGAPORE (Reuters) - Asian share markets slumped on Wednesday, led by South Korea's POSCO Co. Ltd. and other steelmakers amid warnings of a drop in prices, and as investors worried that third-quarter earnings may disappoint.
top 7 | id : 14210, dist : 0.41932273
Asian Stocks Mostly Flat to Lower SINGAPORE (Reuters) - Asian shares were mostly flat to lower on Monday as investors kept a wary eye on stabilizing oil prices and looked past signs Japanese consumers were beginning to spend more freely.
top 8 | id : 14904, dist : 0.4203742
European Shares Drift Down in Thin Trade European stocks were slightly lower by mid-day in holiday-hit trading on Monday, with crude oil rises weighing on shares, though Sanofi-Aventis gained on the result of trials of an anti-obesity drug.
top 9 | id : 76632, dist : 0.4244548
Asian Stocks Ease After China Rate Rise (Reuters) Reuters - China's surprise interest rate riseweighed down Asian stocks on Friday as investors sold shares ofminers, shippers and other firms whose fortunes have beenclosely linked to the country's rapid growth.
top 10 | id : 15265, dist : 0.42584515
Asian Stocks Mostly Lower on Tech Worries (Reuters) Reuters - Asian shares were mostly lower onTuesday, pulled down by technology stocks following worriesabout a sales forecast from bellwether Intel Corp. andunexpectedly flat industrial output in Japan.
Jarak L2
top 1 | id : 92048, dist : 0.667175
Asian Shares Lower as Oil Fall Stalls SINGAPORE (Reuters) - Asian share markets saw light selling in line with a slowing retreat in oil prices on Tuesday, while the dollar steadied as officials in Europe and Japan fretted about the U.S. currency's recent decline.
top 2 | id : 65687, dist : 0.76285875
Asian Shares Lower on Earnings, Steel SINGAPORE (Reuters) - Asian share markets staged a broad-based retreat on Wednesday, led by steelmakers amid warnings of price declines, but also enveloping technology and financial stocks on worries that earnings may disappoint.
top 3 | id : 15361, dist : 0.7973814
Asian Stocks Mostly Lower on Tech Worries SINGAPORE (Reuters) - Asian shares were mostly lower on Tuesday, pulled down by technology stocks following worries about a sales forecast from bellwether Intel Corp. and unexpectedly flat industrial output in Japan.
top 4 | id : 63234, dist : 0.80368686
Asian Stocks Slip as Oil Moves Above $55 Asian share markets fell on Monday after oil hit a record above $55 a barrel, with investors cautious ahead of earnings reports from bellwether firms IBM and Texas Instruments later in the day.
top 5 | id : 76590, dist : 0.82744247
Asian Stocks Ease After China Rate Rise SINGAPORE (Reuters) - China's surprise interest rate rise weighed down Asian stocks on Friday as investors sold shares of miners, shippers and other firms whose fortunes have been closely linked to the country's rapid growth.
top 6 | id : 65572, dist : 0.83859724
Asian Shares Lower on Earnings SINGAPORE (Reuters) - Asian share markets slumped on Wednesday, led by South Korea's POSCO Co. Ltd. and other steelmakers amid warnings of a drop in prices, and as investors worried that third-quarter earnings may disappoint.
top 7 | id : 14210, dist : 0.83864534
Asian Stocks Mostly Flat to Lower SINGAPORE (Reuters) - Asian shares were mostly flat to lower on Monday as investors kept a wary eye on stabilizing oil prices and looked past signs Japanese consumers were beginning to spend more freely.
top 8 | id : 14904, dist : 0.8407483
European Shares Drift Down in Thin Trade European stocks were slightly lower by mid-day in holiday-hit trading on Monday, with crude oil rises weighing on shares, though Sanofi-Aventis gained on the result of trials of an anti-obesity drug.
top 9 | id : 77269, dist : 0.84736
Asian Markets Mixed on China Rate Hike (AP) AP - Asian financial markets showed a mixed reaction Friday to China's first interest rate rise in nine years, which analysts welcomed as a shift toward capitalist-style economic tools and away from central planning.
top 10 | id : 76632, dist : 0.8489096
Asian Stocks Ease After China Rate Rise (Reuters) Reuters - China's surprise interest rate riseweighed down Asian stocks on Friday as investors sold shares ofminers, shippers and other firms whose fortunes have beenclosely linked to the country's rapid growth.
Jarak kosinus dengan i8 (tidak berskala)
top 1 | id : 70945, dist : 8807
Asian Shares Fall on Dollar; Gold, Oil Up (Reuters) Reuters - The U.S. dollar stumbled on Monday,setting multi-month lows against the yen and euro and tradingaround four-year lows against the Korean won and Singaporedollar, prompting investors to clip Asian share markets.
top 2 | id : 33140, dist : 10982
US Stock-Index Futures Decline; Citigroup, GE Slip in Europe US stock-index futures declined. Dow Jones Industrial Average shares including General Electric Co. slipped in Europe. Citigroup Inc.
top 3 | id : 33077, dist : 11208
US Stock-Index Futures Are Little Changed; Citigroup, GE Slip US stock-index futures were little changed. Dow Jones Industrial Average shares including General Electric Co. slipped in Europe. Citigroup Inc.
top 4 | id : 95897, dist : 11290
Red hot Google shares cooling Google Inc. may be subject to the law of gravity, after all. Its shares, which more than doubled in the two months after the company's Aug. 19 initial public offering and traded as high as $201.60 on Nov. 3, have slipped about 17 percent over the past two weeks. They closed at $167.54 yesterday, down 2.88 percent for the day, ...
top 5 | id : 40354, dist : 11390
Tokyo stocks open slightly lower TOKYO - Stocks opened slightly lower Monday on the Tokyo Stock Exchange as declines in US technology shares last Friday prompted selling.
top 6 | id : 64025, dist : 12241
E*Trade Profit Rises as Expenses Drop (Reuters) Reuters - E*Trade Financial Corp. , anonline bank and brokerage, on Monday said its third-quarterprofit rose as lower expenses offset a drop in net revenue.
top 7 | id : 58035, dist : 12458
UK inflation rate fall continues The UK's inflation rate fell in September, thanks in part to a fall in the price of airfares, increasing the chance that interest rates will be kept on hold.
top 8 | id : 65573, dist : 12583
Yen Eases Against Dollar TOKYO (Reuters) - The yen edged down against the dollar on Wednesday as Japanese stock prices slid, but it remained within striking distance of three-month highs on persistent concerns about the health of the U.S. economy.
top 9 | id : 50470, dist : 12828
Tower Auto Sees Wider Loss, Shares Fall CHICAGO (Reuters) - Auto parts maker Tower Automotive Inc. <A HREF="http://www.investor.reuters.com/FullQuote.aspx?ticker=TWR.N target=/stocks/quickinfo/fullquote">TWR.N</A> said on Tuesday its third-quarter loss would be twice as deep as previously expected because of lower vehicle production in North America and higher steel costs.
top 10 | id : 1267, dist : 13020
Study: Global Warming Could Change Calif. (AP) AP - Global warming could cause dramatically hotter summers and a depleted snow pack in California, leading to a sharp increase in heat-related deaths and jeopardizing the water supply, according to a study released Monday.
@kozistr
