Natural Language Processing(NLG)

Natural Language Processing: Natural Language Processing is a software process that produces natural language output. In one of the most widely-cited survey of NLG methods, NLG is characterized as "the subfield of artificial intelligence and computational linguistics that is concerned with the construction of computer systems than can produce understandable texts in English or other human languages from some underlying non-linguistic representation of information".



While it is widely agreed that the output of any NLG process is text, there is some disagreement on whether the inputs of an NLG system need to be non-linguistic. Common applications of NLG methods include the production of various reports, for example weather and patient reports image captions and chatbots.

Automated NLG can be compared to the process humans use when they turn ideas into writing or speech. Pyscholinguists prefer the term language production for this process, which can also be described in mathematical terms, or modeled in a computer for psychological research. NLG systems can also be compared to translators of artificial computer languages, such as decompilers or transpilers, which also produce human-readable code generated from an intermediate representation. Human languages tend to be considerably more complex and allow for much more ambiguity and variety of expression than programming languages, which makes NLG more challenging.

NLG may be viewed as complementary to natural-language understanding (NLU): whereas in natural-language understanding, the system needs to disambiguate the input sentence to produce the machine representation language, in NLG the system needs to make decisions about how to put a representation into words. The practical considerations in building NLU vs. NLG systems are not symmetrical. NLU needs to deal with ambiguous or erroneous user input, whereas the ideas the system wants to express through NLG are generally known precisely. NLG needs to choose a specific, self-consistent textual representation from many potential representations, whereas NLU generally tries to produce a single, normalized representation of the idea expressed.

NLG has existed since ELIZA was developed in the mid 1960s, but the methods were first used commercially in the 1990s. NLG techniques range from simple template-based systems like a mail mergethat generates form letters to systems that have a complex understanding of human grammar. NLG can also be accomplished by training a statistical model using machine learning typically on a large corpus proof human-written texts.


Example:

The Pollen Forecast for Scotland system is a simple example of a simple NLG system that could essentially be a template. This system takes as input six numbers, which give predicted pollen levels in different parts of Scotland. From these numbers, the system generates a short textual summary of pollen levels as its output.

For example, using the historical data for July 1, 2005, the software produces:

Grass pollen levels for Friday have increased from the moderate to high levels of yesterday with values of around 6 to 7 across most parts of the country. However, in Northern areas, pollen levels will be moderate with values of 4.

In contrast, the actual forecast (written by a human meteorologist) from this data was:

Pollen counts are expected to remain high at level 6 over most of Scotland, and even level 7 in the south east. The only relief is in the Northern Isles and far northeast of mainland Scotland with medium levels of pollen count.

Comments

Post a Comment

Popular posts from this blog

Deep Learning

Image
  Deep Learning in AI Deep learning is based on the branch of machine learning, which is a subset of artificial intelligence. Since neural networks imitate the human brain and so deep learning will do. In deep learning, nothing is programmed explicitly. Basically, it is a machine learning class that makes use of numerous nonlinear processing units so as to perform feature extraction as well as transformation. The output from each preceding layer is taken as input by each one of the successive layers. Deep learning models are capable enough to focus on the accurate features themselves by requiring a little guidance from the programmer and are very helpful in solving out the problem of dimensionality. Deep learning algorithms a re used, especially when we have a huge no of inputs and in the deep learning has been evolved by the machine learning  which itself is a subset of artificial intelligence and as the idea behind the  artificial intelligence  is to mimi...
Read more

Expert Systems in AI

Image
  What is an Expert System? An expert system is a computer program that is designed to solve complex problems and to provide decision-making ability like a human expert. It performs this by extracting knowledge from its knowledge base using the reasoning and inference rules according to the user queries. The expert system is a part of AI, and the first ES was developed in the year 1970, which was the first successful approach of artificial intelligence. It solves the most complex issue as an expert by extracting the knowledge stored in its knowledge base. The system helps in decision making for complex problems using  both facts and heuristics like a human expert . It is called so because it contains the expert knowledge of a specific domain and can solve any complex problem of that particular domain. These systems are designed for a specific domain, such as  medicine, science,  etc. The performance of an expert system is based on the expert's knowledge stored in its...
Read more

Decision Management in AI

What is AI decision making? AI and decision management systems can help companies in making valid decisions by providing up-to-date and relevant information and performing analytic functions. Companies base their decisions on data available from management information systems as they reflect information that comes from the operations of their company. Combining AI and decision management systems can take decision-making to different levels. AI’s capabilities help these decision management systems in translating customer data into predictive models of key trends. This has helped marketing and consumer departments in customizing their efforts according to key demographics. AI AND DECISION MANAGEMENT: BENEFITS  Since its beginning, AI has played a revolutionary role in automating both knowledge based and non-knowledge based activities. Today, a huge amount of data is used for generating various models on a weekly basis or even on a daily basis, that help an organization in making deci...
Read more