Original featured: KD Nuggets™
NLG tools automate the analysis and enhance traditional BI platforms by explaining in plain English the significance of visualizations and findings – here is an overview of the market.
It is often said that a picture is worth a thousand words. But in the era of big data, a paragraph from a natural language generation (NLG) tool might be worth a thousand pictures.
NLG tools automatically analyze data, interpret it, identify the most significant parts, and generate written reports in plain English. In essence, NLG brings artificial intelligence to business intelligence (BI), automating routine analysis, saving business users time and money.
Although BI products generate visualizations, reports, and dashboards, business users still have to analyze and interpret data. That’s where NLG comes in. It automatically performs the analysis and generates an English language translation of what is significant and meaningful in the data. Business users no longer have to study the data to interpret its meaning; NLG tools do that for them.
Moreover, NLG tools bypass the need to create visualizations, charts, and reports in the first place. The tools can sift through large volumes of data and generate reports automatically. This is particularly valuable in the age of big data where huge amounts of data can overwhelm business users and IT departments alike. With NLG tools, data analysts can spend 80% of their time analyzing data rather than 80% of their time preparing data. In other words, NLG tools augment the job of business users so they can focus more on high-value tasks and less on menial work.
For example, Dominion Dealer Solutions use a NLG tool from Narrative Science to generate unique vehicle descriptions based on data gathered from a variety of sources, including automotive reviews, Kelley Blue Book, and, CARFAX. A study revealed that cars with NLG-generated descriptions sell an average of twenty days earlier than those without one.
Since NLG tools automate analysis and have human-like capabilities, some people worry that NLG and other artificial intelligence products will undermine job security. Although this is a legitimate concern, officials at all three companies I interviewed emphasize that NLG tools augment the job of business users, and don’t replace them. They say NLG tools allow business users to focus on higher value tasks. Although NLG tools generate written analysis, business users still have to read, understand, and act on the reports. Rather than replacing analysts, these tools allow for more analysis to happen more often.
However, this explanation is incomplete. What if an NLG tool automates reports that usually take a dozen people a month to write? In this case, the people who are paid to prepare those reports will need to be shifted to another role in the business, if one is available, or laid off. For example, Forbes uses Narrative Science as a cost-effective way to generate content and expand market coverage. Instead of hiring people, Forbes chose Narrative Science to generate the content.
Although NLG technology is quite new, there are already a number of vendors selling NLG products, including Yseop (pronounced “easy-op”), Narrative Science, and Arria. (Another early player, BeyondCore, was recently purchased by Salesforce.com for an undisclosed amount.) Each offers an NLG tool that automatically creates reports and analysis from data sets and existing reports. They use inference and natural language generation engines to identify the most significant parts of the data, draw insights, and recommend actions that get embedded in automatically generated written reports.
Because they automate analysis, most NLG vendors are forging partnerships with business intelligence vendors who want to embed NLG capabilities into their products. The partnerships provide BI vendors with NLG capabilities they don’t have and likely won’t build, and NLG providers get new channels and revenue streams for their technology. Yseop’s Savvy, for example, has plug ins for Excel and Qlik.
Here is an overview of three major NLG products today:
Arria’s NLG Platform and Recount
Arria offers NLG Platform, which works with almost any data source or application. NLG Platform runs on the cloud or on-premises and works in any industry, including financial services, healthcare, and marketing. Soon, Arria will release two cloud versions of the product: an enterprise version called Articulator Pro and Articulator Lite geared to non-NLG programmers that will compete with Yseop Savvy.
Arria also sells Recount, an accounting solution that works with accounting software from Xero. Recount automatically generates reports that identify key trends and issues in their accounting data that they need to pay attention to. The tool helps small and medium-sized business owners focus on the business rather than administrative duties and bookkeeping.
According to Jeff Zie, CMXO and Head of Recount, “Xero is a fantastic accounting platform, but it doesn’t tell owners what’s going on and whether it’s a good thing or a bad thing. Using Recount is like picking up a phone to a financial analyst and asking ‘what’s going on with my business?’”