Ship-lemmatagger: Building an nlp toolkit for a peruvian native language

No hay miniatura disponible
Pereira-Noriega J.
Mercado-Gonzales R.
Melgar A.
Sobrevilla-Cabezudo M.
Oncevay-Marcos A.
Título de la revista
Revista ISSN
Título del volumen
Springer Verlag
Proyectos de investigación
Unidades organizativas
Número de la revista
Natural Language Processing deals with the understanding and generation of texts through computer programs. There are many different functionalities used in this area, but among them there are some functions that are the support of the remaining ones. These methods are related to the core processing of the morphology of the language (such as lemmatization) and automatic identification of the part-of-speech tag. Thereby, this paper describes the implementation of a basic NLP toolkit for a new language, focusing in the features mentioned before, and testing them in an own corpus built for the occasion. The obtained results exceeded the expected results and could be used for more complex tasks such as machine translation.
Palabras clave
Text processing, Automation, Computational linguistics, Ships, Automatic identification, Core processing, Lemmatization, Low resource languages, Machine translations, Native language, Part of speech tagging, Shipibo-konibo, Natural language processing systems