semantic search rs
1.0.0
عرض توضيحي للبحث الدلالي باستخدام خادم gRPC في Rust
src/hnsw_index ( hnswlib-rs ) من هذا المشروع وقم باستيراده من الصندوق. std::simd ( packed_simd_2 ) قم باستخراج التضمينات من المستندات المحددة وقم بإنشاء فهرس وحفظه على القرص المحلي.
cargo +nightly run --release --features progress --bin embedding إذا كنت تريد التكميم، قم بتمرير quantize إلى الوسيطة.
cargo +nightly run --release --features progress --bin embedding quantizeإنشاء وتشغيل خادم gRPC (لاستدلال النموذج والبحث).
make serverبناء وتشغيل عميل gRPC. سيبدأ العميل في قياس الخادم بناءً على المعلمات المحددة.
make client يمكنك أيضًا تغيير الحجج. على سبيل المثال ./client num_users num_requests bs k
cargo +nightly run --release --bin client 1 1000 128 10 قم بتشغيل مثال مع الاستعلام المحدد. (يجب أن يكون هناك فهرس مدمج مع مجموعة بيانات ag_news )
cargo +nightly run --release --features progress --bin main " query " AVX2 و FMAيختلف زمن الوصول % قليلاً عن إصدار Rust. في الإصدار الأخير (1.73.0 ليلاً)، تصبح السرعة أبطأ (2.275 مللي ثانية -> 3.000 مللي ثانية).
تم قياس % i8 بـ 1.73.0.
| ص | حي | بكالوريوس | طلبات | ك | يكتب | يقصد | ص95 | ص99 | ص99.9 | الأعلى | QPS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| f32 | L2 | 1 | 10 ألف | 10 | المجموع | 4.833 مللي ثانية | 5.426 مللي ثانية | 6.037 مللي ثانية | 9.578 مللي ثانية | 12.411 مللي ثانية | 207 |
| نموذج | 4.507 مللي ثانية | 4.994 مللي ثانية | 5.505 مللي ثانية | 8.979 مللي ثانية | 12.094 مللي ثانية | ||||||
| يبحث | 0.203 مللي ثانية | 0.308 مللي ثانية | 0.354 مللي ثانية | 0.449 مللي ثانية | 0.567 مللي ثانية | 4926 | |||||
| 32 | 1 ك | 10 | المجموع | 10.403 مللي ثانية | 10.951 مللي ثانية | 11.625 مللي ثانية | 16.794 مللي ثانية | 16.794 مللي ثانية | 3076 | ||
| نموذج | 9.211 مللي ثانية | 9.684 مللي ثانية | 10.226 مللي ثانية | 14.796 مللي ثانية | 14.796 مللي ثانية | ||||||
| يبحث | 0.981 مللي ثانية | 1.183 مللي ثانية | 1.386 مللي ثانية | 2.386 مللي ثانية | 2.386 مللي ثانية | 32620 | |||||
| 128 | 1 ك | 10 | المجموع | 32.220 مللي ثانية | 32.602 مللي ثانية | 32.862 مللي ثانية | 33.440 مللي ثانية | 33.440 مللي ثانية | 3973 | ||
| نموذج | 29.120 مللي ثانية | 29.411 مللي ثانية | 29.653 مللي ثانية | 30.333 مللي ثانية | 30.333 مللي ثانية | ||||||
| يبحث | 2.855 مللي ثانية | 3.007 مللي ثانية | 3.154 مللي ثانية | 3.452 مللي ثانية | 3.452 مللي ثانية | 44834 | |||||
| كوس | 128 | 1 ك | 10 | المجموع | 31.547 مللي ثانية | 31.890 مللي ثانية | 32.087 مللي ثانية | 33.479 مللي ثانية | 33.479 مللي ثانية | 4128 | |
| نموذج | 28.992 مللي ثانية | 29.229 مللي ثانية | 29.438 مللي ثانية | 30.936 مللي ثانية | 30.936 مللي ثانية | ||||||
| يبحث | 2.275 مللي ثانية | 2.444 مللي ثانية | 2.595 مللي ثانية | 2.722 مللي ثانية | 2.722 مللي ثانية | 56264 | |||||
| i8 | كوس | 128 | 1 ك | 10 | المجموع | 30.896 مللي ثانية | 31.271 مللي ثانية | 31.483 مللي ثانية | 31.786 مللي ثانية | 31.786 مللي ثانية | 4142 |
| نموذج | 28.816 مللي ثانية | 29.123 مللي ثانية | 29.286 مللي ثانية | 29.598 مللي ثانية | 29.598 مللي ثانية | 4442 | |||||
| يبحث | 1.764 مللي ثانية | 1.934 مللي ثانية | 2.006 مللي ثانية | 2.308 مللي ثانية | 2.308 مللي ثانية | 72560 |
| ص | حي | بكالوريوس | طلبات | ك | يقصد | ص50 | ص95 | ص99 | ص99.9 | الأعلى | QPS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| f32 | كوس | 1024 | 2 كيلو | 10 | 10.969 مللي ثانية | 10.856 مللي ثانية | 12.078 مللي ثانية | 12.384 مللي ثانية | 14.817 مللي ثانية | 18.024 مللي ثانية | 93354 |
| 2048 | 2 كيلو | 10 | 21.829 مللي ثانية | 21.617 مللي ثانية | 23.952 مللي ثانية | 24.514 مللي ثانية | 25.892 مللي ثانية | 26.171 مللي ثانية | 93820 | ||
| 4096 | 2 كيلو | 10 | 43.538 مللي ثانية | 43.199 مللي ثانية | 46.303 مللي ثانية | 48.374 مللي ثانية | 50.194 مللي ثانية | 57.159 مللي ثانية | 94079 | ||
| 8192 | 2 كيلو | 10 | 86.234 مللي ثانية | 85.684 مللي ثانية | 90.645 مللي ثانية | 93.850 مللي ثانية | 101.188 مللي ثانية | 102.607 مللي ثانية | 94997 | ||
| i8 | كوس | 1024 | 2 كيلو | 10 | 9.102 مللي ثانية | 9.022 مللي ثانية | 10.043 مللي ثانية | 10.222 مللي ثانية | 11.297 مللي ثانية | 11.602 مللي ثانية | 112506 |
| 2048 | 2 كيلو | 10 | 18.084 مللي ثانية | 17.867 مللي ثانية | 19.799 مللي ثانية | 20.548 مللي ثانية | 22.749 مللي ثانية | 29.330 مللي ثانية | 113249 | ||
| 4096 | 2 كيلو | 10 | 35.772 مللي ثانية | 35.488 مللي ثانية | 38.246 مللي ثانية | 40.089 مللي ثانية | 41.745 مللي ثانية | 43.144 مللي ثانية | 114503 | ||
| 8192 | 2 كيلو | 10 | 71.447 مللي ثانية | 70.790 مللي ثانية | 76.420 مللي ثانية | 78.610 مللي ثانية | 94.783 مللي ثانية | 122.490 مللي ثانية | 114659 |
| ص | حي | بكالوريوس | طلبات | ك | يقصد | ص50 | ص95 | ص99 | ص99.9 | الأعلى | QPS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| f32 | كوس | 1024 | 2 كيلو | 10 | 9.459 مللي ثانية | 9.033 مللي ثانية | 11.412 مللي ثانية | 11.842 مللي ثانية | 12.753 مللي ثانية | 12.819 مللي ثانية | 108252 |
| 2048 | 2 كيلو | 10 | 19.620 مللي ثانية | 19.708 مللي ثانية | 21.072 مللي ثانية | 22.023 مللي ثانية | 24.704 مللي ثانية | 24.881 مللي ثانية | 104383 | ||
| 4096 | 2 كيلو | 10 | 38.269 مللي ثانية | 38.237 مللي ثانية | 40.505 مللي ثانية | 42.475 مللي ثانية | 45.439 مللي ثانية | 45.691 مللي ثانية | 107030 | ||
| 8192 | 2 كيلو | 10 | 75.385 مللي ثانية | 74.877 مللي ثانية | 80.448 مللي ثانية | 84.589 مللي ثانية | 89.629 مللي ثانية | 89.887 مللي ثانية | 108668 | ||
| i8 | كوس | 1024 | 2 كيلو | 10 | 7.003 مللي ثانية | 6.700 مللي ثانية | 8.270 مللي ثانية | 8.668 مللي ثانية | 9.655 مللي ثانية | 10.011 مللي ثانية | 146223 |
| 2048 | 2 كيلو | 10 | 14.388 مللي ثانية | 14.419 مللي ثانية | 15.637 مللي ثانية | 16.067 مللي ثانية | 19.237 مللي ثانية | 20.231 مللي ثانية | 142341 | ||
| 4096 | 2 كيلو | 10 | 27.894 مللي ثانية | 27.815 مللي ثانية | 29.818 مللي ثانية | 31.213 مللي ثانية | 39.733 مللي ثانية | 40.387 مللي ثانية | 146842 | ||
| 8192 | 2 كيلو | 10 | 54.674 مللي ثانية | 54.348 مللي ثانية | 57.844 مللي ثانية | 61.486 مللي ثانية | 100.327 مللي ثانية | 135.911 مللي ثانية | 149834 |
Asia shares drift lower as investors factor in Fed rate hike.مسافة جيب التمام
top 1 | id : 92048, dist : 0.3335874
Asian Shares Lower as Oil Fall Stalls SINGAPORE (Reuters) - Asian share markets saw light selling in line with a slowing retreat in oil prices on Tuesday, while the dollar steadied as officials in Europe and Japan fretted about the U.S. currency's recent decline.
top 2 | id : 65687, dist : 0.38142937
Asian Shares Lower on Earnings, Steel SINGAPORE (Reuters) - Asian share markets staged a broad-based retreat on Wednesday, led by steelmakers amid warnings of price declines, but also enveloping technology and financial stocks on worries that earnings may disappoint.
top 3 | id : 15361, dist : 0.39869058
Asian Stocks Mostly Lower on Tech Worries SINGAPORE (Reuters) - Asian shares were mostly lower on Tuesday, pulled down by technology stocks following worries about a sales forecast from bellwether Intel Corp. and unexpectedly flat industrial output in Japan.
top 4 | id : 63234, dist : 0.40184337
Asian Stocks Slip as Oil Moves Above $55 Asian share markets fell on Monday after oil hit a record above $55 a barrel, with investors cautious ahead of earnings reports from bellwether firms IBM and Texas Instruments later in the day.
top 5 | id : 76590, dist : 0.4137212
Asian Stocks Ease After China Rate Rise SINGAPORE (Reuters) - China's surprise interest rate rise weighed down Asian stocks on Friday as investors sold shares of miners, shippers and other firms whose fortunes have been closely linked to the country's rapid growth.
top 6 | id : 65572, dist : 0.4192986
Asian Shares Lower on Earnings SINGAPORE (Reuters) - Asian share markets slumped on Wednesday, led by South Korea's POSCO Co. Ltd. and other steelmakers amid warnings of a drop in prices, and as investors worried that third-quarter earnings may disappoint.
top 7 | id : 14210, dist : 0.41932273
Asian Stocks Mostly Flat to Lower SINGAPORE (Reuters) - Asian shares were mostly flat to lower on Monday as investors kept a wary eye on stabilizing oil prices and looked past signs Japanese consumers were beginning to spend more freely.
top 8 | id : 14904, dist : 0.4203742
European Shares Drift Down in Thin Trade European stocks were slightly lower by mid-day in holiday-hit trading on Monday, with crude oil rises weighing on shares, though Sanofi-Aventis gained on the result of trials of an anti-obesity drug.
top 9 | id : 76632, dist : 0.4244548
Asian Stocks Ease After China Rate Rise (Reuters) Reuters - China's surprise interest rate riseweighed down Asian stocks on Friday as investors sold shares ofminers, shippers and other firms whose fortunes have beenclosely linked to the country's rapid growth.
top 10 | id : 15265, dist : 0.42584515
Asian Stocks Mostly Lower on Tech Worries (Reuters) Reuters - Asian shares were mostly lower onTuesday, pulled down by technology stocks following worriesabout a sales forecast from bellwether Intel Corp. andunexpectedly flat industrial output in Japan.
المسافة L2
top 1 | id : 92048, dist : 0.667175
Asian Shares Lower as Oil Fall Stalls SINGAPORE (Reuters) - Asian share markets saw light selling in line with a slowing retreat in oil prices on Tuesday, while the dollar steadied as officials in Europe and Japan fretted about the U.S. currency's recent decline.
top 2 | id : 65687, dist : 0.76285875
Asian Shares Lower on Earnings, Steel SINGAPORE (Reuters) - Asian share markets staged a broad-based retreat on Wednesday, led by steelmakers amid warnings of price declines, but also enveloping technology and financial stocks on worries that earnings may disappoint.
top 3 | id : 15361, dist : 0.7973814
Asian Stocks Mostly Lower on Tech Worries SINGAPORE (Reuters) - Asian shares were mostly lower on Tuesday, pulled down by technology stocks following worries about a sales forecast from bellwether Intel Corp. and unexpectedly flat industrial output in Japan.
top 4 | id : 63234, dist : 0.80368686
Asian Stocks Slip as Oil Moves Above $55 Asian share markets fell on Monday after oil hit a record above $55 a barrel, with investors cautious ahead of earnings reports from bellwether firms IBM and Texas Instruments later in the day.
top 5 | id : 76590, dist : 0.82744247
Asian Stocks Ease After China Rate Rise SINGAPORE (Reuters) - China's surprise interest rate rise weighed down Asian stocks on Friday as investors sold shares of miners, shippers and other firms whose fortunes have been closely linked to the country's rapid growth.
top 6 | id : 65572, dist : 0.83859724
Asian Shares Lower on Earnings SINGAPORE (Reuters) - Asian share markets slumped on Wednesday, led by South Korea's POSCO Co. Ltd. and other steelmakers amid warnings of a drop in prices, and as investors worried that third-quarter earnings may disappoint.
top 7 | id : 14210, dist : 0.83864534
Asian Stocks Mostly Flat to Lower SINGAPORE (Reuters) - Asian shares were mostly flat to lower on Monday as investors kept a wary eye on stabilizing oil prices and looked past signs Japanese consumers were beginning to spend more freely.
top 8 | id : 14904, dist : 0.8407483
European Shares Drift Down in Thin Trade European stocks were slightly lower by mid-day in holiday-hit trading on Monday, with crude oil rises weighing on shares, though Sanofi-Aventis gained on the result of trials of an anti-obesity drug.
top 9 | id : 77269, dist : 0.84736
Asian Markets Mixed on China Rate Hike (AP) AP - Asian financial markets showed a mixed reaction Friday to China's first interest rate rise in nine years, which analysts welcomed as a shift toward capitalist-style economic tools and away from central planning.
top 10 | id : 76632, dist : 0.8489096
Asian Stocks Ease After China Rate Rise (Reuters) Reuters - China's surprise interest rate riseweighed down Asian stocks on Friday as investors sold shares ofminers, shippers and other firms whose fortunes have beenclosely linked to the country's rapid growth.
مسافة جيب التمام w/i8 (غير محددة الحجم)
top 1 | id : 70945, dist : 8807
Asian Shares Fall on Dollar; Gold, Oil Up (Reuters) Reuters - The U.S. dollar stumbled on Monday,setting multi-month lows against the yen and euro and tradingaround four-year lows against the Korean won and Singaporedollar, prompting investors to clip Asian share markets.
top 2 | id : 33140, dist : 10982
US Stock-Index Futures Decline; Citigroup, GE Slip in Europe US stock-index futures declined. Dow Jones Industrial Average shares including General Electric Co. slipped in Europe. Citigroup Inc.
top 3 | id : 33077, dist : 11208
US Stock-Index Futures Are Little Changed; Citigroup, GE Slip US stock-index futures were little changed. Dow Jones Industrial Average shares including General Electric Co. slipped in Europe. Citigroup Inc.
top 4 | id : 95897, dist : 11290
Red hot Google shares cooling Google Inc. may be subject to the law of gravity, after all. Its shares, which more than doubled in the two months after the company's Aug. 19 initial public offering and traded as high as $201.60 on Nov. 3, have slipped about 17 percent over the past two weeks. They closed at $167.54 yesterday, down 2.88 percent for the day, ...
top 5 | id : 40354, dist : 11390
Tokyo stocks open slightly lower TOKYO - Stocks opened slightly lower Monday on the Tokyo Stock Exchange as declines in US technology shares last Friday prompted selling.
top 6 | id : 64025, dist : 12241
E*Trade Profit Rises as Expenses Drop (Reuters) Reuters - E*Trade Financial Corp. , anonline bank and brokerage, on Monday said its third-quarterprofit rose as lower expenses offset a drop in net revenue.
top 7 | id : 58035, dist : 12458
UK inflation rate fall continues The UK's inflation rate fell in September, thanks in part to a fall in the price of airfares, increasing the chance that interest rates will be kept on hold.
top 8 | id : 65573, dist : 12583
Yen Eases Against Dollar TOKYO (Reuters) - The yen edged down against the dollar on Wednesday as Japanese stock prices slid, but it remained within striking distance of three-month highs on persistent concerns about the health of the U.S. economy.
top 9 | id : 50470, dist : 12828
Tower Auto Sees Wider Loss, Shares Fall CHICAGO (Reuters) - Auto parts maker Tower Automotive Inc. <A HREF="http://www.investor.reuters.com/FullQuote.aspx?ticker=TWR.N target=/stocks/quickinfo/fullquote">TWR.N</A> said on Tuesday its third-quarter loss would be twice as deep as previously expected because of lower vehicle production in North America and higher steel costs.
top 10 | id : 1267, dist : 13020
Study: Global Warming Could Change Calif. (AP) AP - Global warming could cause dramatically hotter summers and a depleted snow pack in California, leading to a sharp increase in heat-related deaths and jeopardizing the water supply, according to a study released Monday.
@kozistr
