All posts by euge

New Release: JoBimText 0.1.2

We have released a new JoBimText pipeline. The main addition in this version is an API access via the JoBimViz interface. Users can start developing with JoBimText, e.g. using lexical expansion from a JoBimText model.

To demonstrate this capabilities, we held a Tutorial where the functionality is demonstrated in an example project.

Other improvements include:

  • Mate-tools holing pipelines with lemmatization
  • more accurate ISA patterns from PattaMaika
  • a more flexible script for JoBimText pipeline creation

You can download the pipeline in your desired version:

New Release: JoBimText 0.1.1

This release includes optimizations to the new PattaMaika component:

This release brings some minor improvements and new Holing Operations:

  • MateTools Parser (GPL)  for English and German
  • MaltParser (ASL) for English and German
  • N-gram Holing operation
  • Updated build process reduces project size by about 30%.
  • Build options available for the GPL components (documentation)
  • updates to the Hadoop pipeline generators to accommodate for new parsers and their memory/time demands

You can download the new release from Sourceforge:

New Release: JoBimText Pipeline 0.1.0

We are proud to announce the next release of the JoBimText pipeline. The main addition of version 0.1.0 is the pattern matching engine PattaMaika, that can run locally and on Hadoop. The pattern matching engine is able to extract hierarchical relations between terms and is very flexible. It utilizes the Apache UIMA Ruta annotation engine to tag patterns. For more information on the pattern engine, consult the PattaMaika project page.

Other improvements include the re-organization of thirdparty models. Since their number grows with the increasing number of components (segmenters, taggers, parsers) they are now structure. Additionally, the build scripts have been updated.

You can download the new release from Sourceforge: JoBimText pipeline 0.1.0.

New Release: JoBimText Pipeline 0.0.8

We are happy to announce a new JoBimText version release! The most significant change is the ability to run JoBimText Holing Operations on Hadoop using UIMA pipelines. Here are the updates:

  • Holing Operations on Hadoop
    This release comes with fully working bigram and trigram holing operations. A GPL-licensed Stanford Dependency parser is being evaluated and the ASL-licensed MaltParser is being integrated for the next release.
  • DT generation pipeline for Hadoop reworked
    The new pipeline is more streamlined and offers different similarity scoring methods.
  • Bim DT (Feature DT) calculation possible out-of-the box
    The Bim DT can be used to reduce sparsity issues when working with JoBimText models.
  • Updates to the IThesaurus interface
    This involves missing methods, especially for access to the Bim DT and word-based resources like word clusters.
  • Updated demonstration components for easier introduction to the codebase

You can download the latest version of JoBimText from Sourceforge.

Wikipedia Trigram model available in the Web Demo

Today, we have released the Wikipedia Trigram model for English in the web demo. It was computed from an English Wikipedia dump from 2013 and is one of the first models that contains a Bim DT (Feature DT).

The Bim DT is a “reversed Distributional Thesaurus”; users can find similar context features when they need more contexts to reduce sparsity issues. The Bim DT was computed using words as “Bims” and features as “Jos”. This demonstrates the general JoBimText approach, where users can define any type of Jos and Bims for their tasks.

Currently, we are using the Wikipedia trigram model to develop in-text contextualization, that is able to assign the induced word senses to words in text. Due to sparsity of contexts, the Bim DT helps in this application.