Evaluating NLP software for automatic knowledge graph construction - What to look for


Knowledge graphs are increasingly becoming important in the AI world as an enabling technology for data integration and analytics, semantic search and question answering, and other cognitive applications. However, developing and maintaining large knowledge graphs in a manual way is too expensive and time consuming. To accelerate and scale the process, methods and techniques from the areas of information extraction and natural language processing (NLP) can be very helpful. In this talk we'll see the main NLP tasks that knowledge graph mining involves, the factors that affect how easy or difficult the execution of these tasks can be, and some common pitfalls that we need to avoid in order to mine high quality knowledge graphs. We will also describe some important questions that can help us evaluate available knowledge extraction tools and decide if and to what extent we should use them. The talk is of interest to practitioners who develop knowledge graphs and look for ways to automate the process, as well as to practitioners and vendors who develop NLP solutions for automatic knowledge graph construction.