项目作者: fostroll

项目描述 :
Toolkit that simplifies corpus processing
高级语言: Python
项目地址: git://github.com/fostroll/corpuscula.git
创建时间: 2020-04-05T12:30:36Z
项目社区:https://github.com/fostroll/corpuscula

开源协议:BSD 3-Clause "New" or "Revised" License

下载


RuMor: Russian Morphology project

Corpuscula: a python NLP library for corpus processing

PyPI Version
Python Version
License: BSD-3

A part of RuMor project. It contains tools to simplify corpus
processing. Highlights are:

  • full CoNLL-U support
    (includes CoNLL-U Plus)
  • wrappers for known corpora of Russian language
  • parser and wrapper for Russian part of Wikipedia
  • Corpus Dictionary that can be used for further morphology processing
  • simple database to keep named entities

Installation

pip

Corpuscula supports Python 3.5 or later. To install it via pip, run:

  1. $ pip install corpuscula

If you currently have a previous version of Corpuscula installed, use:

  1. $ pip install corpuscula -U

From Source

Alternatively, you can also install Corpuscula from source of this git
repository
:

  1. $ git clone https://github.com/fostroll/corpuscula.git
  2. $ cd corpuscula
  3. $ pip install -e .

This gives you access to examples and data that are not included to the
PyPI package.

Setup

After installation, you need to specify a directory where you prefer to store
downloaded corpora:

  1. >>> import corpuscula.corpus_utils as cu
  2. >>> cu.set_root_dir(<path>) # We will keep corpora here

NB: it will create/update config file .rumor in your home directory.

If you won’t set the root directory, Corpuscula will keep corpora
in the directory where it’s installed.

Usage

CoNLL-U Support

Management of Corpora

Wrapper for Wikipedia

Corpus Dictionary

Utilities

Items database

Examples

You can find examples in the directory examples of our Corpuscula github
repository.

License

Corpuscula is released under the BSD License. See the
LICENSE file for
more details.