Do you remember how you learnt to read? AI is learning to read using something called deep learning and analysing thousands of examples of text. After extensive training, often using a lot of computer power (and electricity), we can build a basic AI model. It’s difficult to say that it has any understanding, but it gives that appearance, and irrespective, is a useful tool.
The aztext package demonstrates some of the capability of AI based text analysis. It does this using Microsoft’s Azure Text cloud service which makes a number of natural language processing (NLP) models available. See Section overview for details.
This MLHub package makes most of the Azure Text Analytics functionality easily available for us to explore the capabilities of NLP and even to utilise it in our own tools.
To install, configure, and demonstrate the package:
ml install aztext ml configure aztext ml readme aztext ml commands aztext ml demo aztext
Azure-based models, unlike the MLHub models in general, use closed source services which have no guarantee of ongoing availability and do not come with the freedom to modify and share. This cloud based service also sends your text to the Azure cloud for analysis.
Your donation will support ongoing availability and give you access to the PDF version of this book. Desktop Survival Guides include Data Science, GNU/Linux, and MLHub. Books available on Amazon include Data Mining with Rattle and Essentials of Data Science. Popular open source software includes rattle, wajig, and mlhub. Hosted by Togaware, a pioneer of free and open source software since 1984. Copyright © 1995-2022 Graham.Williams@togaware.com Creative Commons Attribution-ShareAlike 4.0