cc.factorie.app.nlp.lexicon

PhraseLexicon

class PhraseLexicon extends MutableLexicon

A list of words or phrases, with methods to check whether a String, Seq[String], or Token (or more generally a cc.factorie.app.chain.Observation) is in the list.

Linear Supertypes
MutableLexicon, Lexicon, AnyRef, Any
Known Subclasses
Battle, BattleDisambiguation, BattleRedirect, Book, BookDisambiguation, BookRedirect, Business, BusinessDisambiguation, BusinessRedirect, City, Company, Competition, CompetitionDisambiguation, CompetitionRedirect, Continents, Country, Demonym, Demonyms, Demonyms, Event, EventDisambiguation, EventRedirect, Film, FilmDisambiguation, FilmRedirect, JobTitle, Location, LocationDisambiguation, LocationRedirect, ManMadeThing, ManMadeThingDisambiguation, ManMadeThingRedirect, OrgSuffix, Organization, OrganizationDisambiguation, OrganizationRedirect, Person, PersonDisambiguation, PersonRedirect, PhraseLexicon, Pronoun, Song, SongDisambiguation, SongRedirect, USState
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. PhraseLexicon
  2. MutableLexicon
  3. Lexicon
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PhraseLexicon(file: File)

    Populate lexicon from file, with one entry per line, consisting of space-separated tokens.

  2. new PhraseLexicon(name: String, tokenizer: StringSegmenter = ..., lemmatizer: Lemmatizer = ...)

Type Members

  1. class LexiconPhraseToken extends LexiconToken

  2. class LexiconToken extends Observation[LexiconToken]

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. def ++=(file: File, enc: String = "UTF-8"): PhraseLexicon.this.type

    All a lines from the input File to this lexicon.

    All a lines from the input File to this lexicon. File contains multiple newline-separated lexicon entries

    Definition Classes
    MutableLexicon

  5. def ++=(phrases: String): PhraseLexicon.this.type

    All a lines from the input String to this lexicon.

    All a lines from the input String to this lexicon. String contains multiple newline-separated lexicon entries

    Definition Classes
    MutableLexicon

  6. def ++=(source: Source): PhraseLexicon.this.type

    All a lines from the input Source to this lexicon.

    All a lines from the input Source to this lexicon. Source is assumed to contain multiple newline-separated lexicon entries

    Definition Classes
    MutableLexicon

  7. def +=(phrase: String): Unit

    Add a new lexicon entry consisting of one or more words.

    Add a new lexicon entry consisting of one or more words. The Lexicon's tokenizer will be used to split the string, if possible.

    Definition Classes
    PhraseLexicon → MutableLexicon

  8. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  9. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  10. object LexiconToken extends LexiconToken

  11. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  12. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  13. def contains[T <: Observation[T]](query: T): Boolean

    Is 'query' in the lexicon, accounting for lexicon phrases and the context of 'query'

    Is 'query' in the lexicon, accounting for lexicon phrases and the context of 'query'

    Definition Classes
    PhraseLexicon → Lexicon

  14. def contains[T <: Observation[T]](query: Seq[T]): Boolean

    Definition Classes
    PhraseLexicon → Lexicon

  15. def contains(untokenizedString: String): Boolean

    Is the input String in the lexicon.

    Is the input String in the lexicon. The input is tokenized and lemmatized; if the tokenizer indicates that it is a multi-word phrase, it will be processed by containsWords, otherwise containsWord.

    Definition Classes
    Lexicon

  16. def contains(span: TokenSpan): Boolean

    Definition Classes
    Lexicon

  17. def containsLemmatizedWord(word: String): Boolean

    Do any of the Lexicon entries contain the given word string.

    Do any of the Lexicon entries contain the given word string.

    Definition Classes
    PhraseLexicon → Lexicon

  18. def containsLemmatizedWords(words: Seq[String]): Boolean

    Is the pre-tokenized sequence of words in the lexicon? The input words are expected to already be processed by the lemmatizer.

    Is the pre-tokenized sequence of words in the lexicon? The input words are expected to already be processed by the lemmatizer.

    Definition Classes
    PhraseLexicon → Lexicon

  19. def containsSingle[T <: Observation[T]](query: T): Boolean

    Is 'query' in the lexicon, ignoring context.

  20. def containsWord(word: String): Boolean

    Is this single word in the lexicon? The input String will not be processed by tokenizer, but will be processed by the lemmatizer.

    Is this single word in the lexicon? The input String will not be processed by tokenizer, but will be processed by the lemmatizer.

    Definition Classes
    Lexicon

  21. def containsWords(words: Seq[String]): Boolean

    Is the pre-tokenized sequence of words in the lexicon? Each of the input words will be processed by the lemmatizer.

    Is the pre-tokenized sequence of words in the lexicon? Each of the input words will be processed by the lemmatizer.

    Definition Classes
    Lexicon

  22. val contents: HashMap[String, List[LexiconToken]]

  23. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  24. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  25. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  26. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  27. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  28. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  29. val lemmatizer: Lemmatizer

    The string lemmatizer that simplifies lexicon entries and queries before searching for a match.

    The string lemmatizer that simplifies lexicon entries and queries before searching for a match. For example, a common lemmatizer is one that lowercases all strings.

    Definition Classes
    PhraseLexicon → Lexicon

  30. val name: String

    An identifier for this lexicon, suitable for adding as a category to a FeatureVectorVariable[String].

    An identifier for this lexicon, suitable for adding as a category to a FeatureVectorVariable[String].

    Definition Classes
    PhraseLexicon → Lexicon

  31. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  32. final def notify(): Unit

    Definition Classes
    AnyRef

  33. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  34. def phrases: Seq[String]

    String contains multiple newline-separated lexicon entries

  35. def startsAt[T <: Observation[T]](query: T): Int

    Return length of match, or -1 if no match.

  36. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  37. def toString(): String

    Definition Classes
    AnyRef → Any

  38. val tokenizer: StringSegmenter

    The string segmenter that breaks a lexicon entries and queries into (potentially) multi-word phrases.

    The string segmenter that breaks a lexicon entries and queries into (potentially) multi-word phrases.

    Definition Classes
    PhraseLexicon → Lexicon

  39. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  40. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  41. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from MutableLexicon

Inherited from Lexicon

Inherited from AnyRef

Inherited from Any

Ungrouped