jina financial qa search
1.0.0
在此示例中，我们使用 Jina、PyTorch 和 Hugging Face 转换器构建一个可投入生产的基于 BERT 的金融问答系统。我们采用段落重新排序方法，首先检索前 50 个候选答案，然后使用 FinBERT-QA 对候选答案重新排序，FinBERT-QA 是一种基于 BERT 的模型，在 FiQA 数据集上进行了微调，取得了最先进的结果。
？请参阅本教程以获取分步指南和详细说明。
受金融行业对大规模非结构化和结构化数据自动分析的新兴需求的推动，QA 系统可以通过促进财务顾问的决策制定，为公司提供利润丰厚的竞争优势。我们系统的目标是搜索给定问题的相关答案段落列表。以下是 FiQA 数据集中的问题和真实答案的示例：
https://github.com/yuanbit/jina-financial-qa-search.git
我们将使用jina-financial-qa-search/作为我们的工作目录。
pip install -r requirements.txt
bash get_data.sh
我们想要索引 FiQA 数据集dataset/test_answers.csv中答案段落的子集：
398960 From http://financial-dictionary.thefreedictionary.com/Business+Fundamentals The facts that affect a company's underlying value. Examples of business fundamentals include debt, cash flow, supply of and demand for the company's products, and so forth. For instance, if a company does not have a sufficient supply of products, it will fail. Likewise, demand for the product must remain at a certain level in order for it to be successful. Strong business fundamentals are considered essential for long-term success and stability. See also: Value Investing, Fundamental Analysis. For a stock the basic fundamentals are the second column of numbers you see on the google finance summary page, P/E ratio, div/yeild, EPS, shares, beta. For the company itself it's generally the stuff on the 'financials' link (e.g. things in the quarterly and annual report, debt, liabilities, assets, earnings, profit etc.
19183 If your sole proprietorship losses exceed all other sources of taxable income, then you have what's called a Net Operating Loss (NOL). You will have the option to "carry back" and amend a return you filed in the last 2 years where you owed tax, or you can "carry forward" the losses and decrease your taxes in a future year, up to 20 years in the future. For more information see the IRS links for NOL. Note: it's important to make sure you file the NOL correctly so I'd advise speaking with an accountant. (Especially if the loss is greater than the cost of the accountant...)
327002 To be deductible, a business expense must be both ordinary and necessary. An ordinary expense is one that is common and accepted in your trade or business. A necessary expense is one that is helpful and appropriate for your trade or business. An expense does not have to be indispensable to be considered necessary. (IRS, Deducting Business Expenses) It seems to me you'd have a hard time convincing an auditor that this is the case. Since business don't commonly own cars for the sole purpose of housing $25 computers, you'd have trouble with the "ordinary" test. And since there are lots of other ways to house a computer other than a car, "necessary" seems problematic also.
您可以更改answer_collection.tsv的路径以使用完整数据集建立索引。
python app.py index
最后你会看到以下内容：
✅ done in ⏱ 1 minute and 54 seconds ? 7.7/s
gateway@18904[S]:terminated
doc_indexer@18903[I]:recv ControlRequest from ctl▸doc_indexer▸⚐
doc_indexer@18903[I]:Terminating loop requested by terminate signal RequestLoopEnd()
doc_indexer@18903[I]:#sent: 56 #recv: 56 sent_size: 1.7 MB recv_size: 1.7 MB
doc_indexer@18903[I]:request loop ended, tearing down ...
doc_indexer@18903[I]:indexer size: 865 physical size: 3.1 MB
doc_indexer@18903[S]:artifacts of this executor (vecidx) is persisted to ./workspace/doc_compound_indexer-0/vecidx.bin
doc_indexer@18903[I]:indexer size: 865 physical size: 3.2 MB
doc_indexer@18903[S]:artifacts of this executor (docidx) is persisted to ./workspace/doc_compound_indexer-0/docidx.bin
我们需要构建一个自定义执行器来重新排名前 50 个候选答案。我们可以使用 Jina Hub API 来做到这一点。让我们确保 Jina Hub 扩展已安装：
pip install "jina[hub]"
我们可以通过运行以下命令来构建自定义Ranker FinBertQARanker ：
jina hub build FinBertQARanker/ --pull --test-uses --timeout-ready 60000
我们现在可以通过运行以下命令来使用我们的财务 QA 搜索引擎：
python app.py search
由于Ranker 使用基于 BERT 的模型，因此可能需要一些时间来计算相关性分数。您可以尝试 FiQA 数据集中的问题列表：
• What does it mean that stocks are “memoryless”?
• What would a stock be worth if dividends did not exist?
• What are the risks of Dividend-yielding stocks?
• Why do financial institutions charge so much to convert currency?
• Is there a candlestick pattern that guarantees any kind of future profit?
• 15 year mortgage vs 30 year paid off in 15
• Why is it rational to pay out a dividend?
• Why do companies have a fiscal year different from the calendar year?
• What should I look at before investing in a start-up?
• Where do large corporations store their massive amounts of cash?
#JinaSearch与他们互动版权所有 (c) 2021 吉娜的朋友。版权所有。
