Publicación:
Ship-lemmatagger: Building an nlp toolkit for a peruvian native language
Ship-lemmatagger: Building an nlp toolkit for a peruvian native language
No hay miniatura disponible
Fecha
2017
Autores
Pereira-Noriega J.
Mercado-Gonzales R.
Melgar A.
Sobrevilla-Cabezudo M.
Oncevay-Marcos A.
Título de la revista
Revista ISSN
Título del volumen
Editor
Springer Verlag
Proyectos de investigación
Unidades organizativas
Número de la revista
Abstracto
Natural Language Processing deals with the understanding and generation of texts through computer programs. There are many different functionalities used in this area, but among them there are some functions that are the support of the remaining ones. These methods are related to the core processing of the morphology of the language (such as lemmatization) and automatic identification of the part-of-speech tag. Thereby, this paper describes the implementation of a basic NLP toolkit for a new language, focusing in the features mentioned before, and testing them in an own corpus built for the occasion. The obtained results exceeded the expected results and could be used for more complex tasks such as machine translation.
Descripción
Palabras clave
Text processing,
Automation,
Computational linguistics,
Ships,
Automatic identification,
Core processing,
Lemmatization,
Low resource languages,
Machine translations,
Native language,
Part of speech tagging,
Shipibo-konibo,
Natural language processing systems