Task Dispatching System for the Complex of Natural Language Processing Tools
October 21, 10:50
High calculating resources requirements for processing even typical computer linguistics tasks and durable execution of complex algorithms significantly obstruct the development of multi user program linguistic tools.
The report describes the developed task dispatching system for the complex of automated natural language processing tools for research in the field of Natural Language Processing or NLP, which provides task management, resource monitoring and queue management taking into account features of NLP tasks.
The report is intended for both experienced system architects developing high-load systems and developers of various NLP tools to allow extending the usage of their applications.
The proposed dispatching system could be useful for other NLP tools when the number of processed tasks is increasing and for any multi user systems solving complex high load tasks.