Japanese NLU Engine Comparison between IBM Watson, Dialogflow (API.ai) & wit.ai

Clare.AI is dedicated to continually develop Asian language NLP sets in the finance domain. Japanese is spoken by 126 million speakers. Clare.AI was honored to be selected by Tokyo Metropolitan Government as one of the 8 companies to join the Fintech Business Camp. We have also been traveling more to Japan to explore business opportunities.

We have also recently collected FAQ data from Japanese financial institutions and conducted the benchmark test like we did in other languages.The raw FAQ and variation data is available here. See more details of  English, Chinese and Indonesian Bahasa Benchmark test.

japanese all new

The table above is the results of our tests with Japanese questions.  We initially imported 25 questions and 4 variations of each question. In total, we imported 100 questions in each system.

japanese processing time new

Once again, our system returned results the quickest, much faster than the other solutions and almost 8 times faster than IBM Watson.

japanese correct answer new.PNG

Clare.AI is shown to excel in Japanese compared to the other platforms. Our system had a 19% better accuracy than IBM Watson. We have included few examples where Clare.AI is able to correctly match with the right question, while IBM did not: 

Testing Variation Clare.AI Match IBM Match
リアルタイム入金はMRFにそのまま反映される?

Would the real time deposit be reflected my MRF?

リアルタイム入金サービスを利用し振込を行うと、楽天証券の預り金(MRF)に即時反映されますか?

If I conduct real time deposit, will the deposit record be directly reflected in Money Reserve Fund(MRF)?  ✅

リアルタイム入金サービスの手順を教えてください

How do I deposit in real time?

 NISA口座開設は何が必要?

What do I need to create a NISA account?

NISA口座開設に必要な書類を教えてください。

What are the required documents for opening a NISA account? ✅

NISAやジュニアNISAは何歳から口座開設できますか?

What is the minimum age to create a NISA/Junior NISA account?

スターターキットを無くしました、どうすればいいか教えてください

I have lost my Starter kit. Please tell me what to do

 NISA口座のスターターキットを紛失しました。再発行はできますか?

Starter Kit of NISA account has been lost. Can it be reissued? ✅

入金方法を教えてください

Tell me how to deposit

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s