cc.factorie.app.nlp.segment

DeterministicTokenizer

object DeterministicTokenizer extends DeterministicTokenizer

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. DeterministicTokenizer
  2. DeterministicTokenizer
  3. DocumentAnnotator
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. val abbrev: String

    Definition Classes
    DeterministicTokenizer
  7. val abbrevs: String

    Definition Classes
    DeterministicTokenizer
  8. val ap: String

    Definition Classes
    DeterministicTokenizer
  9. val ap2: String

    Definition Classes
    DeterministicTokenizer
  10. def apply(s: String): Seq[String]

    Convenience function to run the tokenizer on an arbitrary String.

    Convenience function to run the tokenizer on an arbitrary String. The implementation builds a Document internally, then maps to token strings.

    Definition Classes
    DeterministicTokenizer
  11. val apword: String

    Definition Classes
    DeterministicTokenizer
  12. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  13. val atuser: String

    Definition Classes
    DeterministicTokenizer
  14. val caps: String

    Definition Classes
    DeterministicTokenizer
  15. val catchAll: String

    Definition Classes
    DeterministicTokenizer
  16. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  17. val consonantNonAbbrevs: String

    Definition Classes
    DeterministicTokenizer
  18. val contractedWord: String

    Definition Classes
    DeterministicTokenizer
  19. val contraction: String

    Definition Classes
    DeterministicTokenizer
  20. val contraction2: String

    Definition Classes
    DeterministicTokenizer
  21. val currency: String

    Definition Classes
    DeterministicTokenizer
  22. val dash: String

    Definition Classes
    DeterministicTokenizer
  23. val dashedPrefixWord: String

    Definition Classes
    DeterministicTokenizer
  24. val dashedPrefixes: String

    Definition Classes
    DeterministicTokenizer
  25. val dashedSuffixWord: String

    Definition Classes
    DeterministicTokenizer
  26. val dashedSuffixes: String

    Definition Classes
    DeterministicTokenizer
  27. val date: String

    Definition Classes
    DeterministicTokenizer
  28. val day: String

    Definition Classes
    DeterministicTokenizer
  29. def documentAnnotationString(document: Document): String

    How the annotation of this DocumentAnnotator should be printed as extra information after a one-word-per-line (OWPL) format.

    How the annotation of this DocumentAnnotator should be printed as extra information after a one-word-per-line (OWPL) format. If there is no document annotation, return the empty string. Used in Document.owplString.

    Definition Classes
    DocumentAnnotator
  30. val ellipsis: String

    Definition Classes
    DeterministicTokenizer
  31. val email: String

    Definition Classes
    DeterministicTokenizer
  32. val emoticon: String

    Definition Classes
    DeterministicTokenizer
  33. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  34. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  35. val filename: String

    Definition Classes
    DeterministicTokenizer
  36. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  37. val fraction: String

    Definition Classes
    DeterministicTokenizer
  38. val frphone: String

    Definition Classes
    DeterministicTokenizer
  39. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  40. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  41. val hashtag: String

    Definition Classes
    DeterministicTokenizer
  42. val honorific: String

    Definition Classes
    DeterministicTokenizer
  43. val html: String

    Definition Classes
    DeterministicTokenizer
  44. val htmlAccentedLetter: String

    Definition Classes
    DeterministicTokenizer
  45. val htmlChar: String

    Definition Classes
    DeterministicTokenizer
  46. val htmlComment: String

    Definition Classes
    DeterministicTokenizer
  47. val htmlSymbol: String

    Definition Classes
    DeterministicTokenizer
  48. val initials: String

    Definition Classes
    DeterministicTokenizer
  49. val initials2: String

    Definition Classes
    DeterministicTokenizer
  50. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  51. val latin: String

    Definition Classes
    DeterministicTokenizer
  52. val latin2: String

    Definition Classes
    DeterministicTokenizer
  53. val letter: String

    Definition Classes
    DeterministicTokenizer
  54. def main(args: Array[String]): Unit

  55. val mdash: String

    Definition Classes
    DeterministicTokenizer
  56. def mentionAnnotationString(mention: Mention): String

    Definition Classes
    DocumentAnnotator
  57. val month: String

    Definition Classes
    DeterministicTokenizer
  58. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  59. val newline: String

    Definition Classes
    DeterministicTokenizer
  60. val noAbbrev: String

    Definition Classes
    DeterministicTokenizer
  61. final def notify(): Unit

    Definition Classes
    AnyRef
  62. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  63. val number: String

    Definition Classes
    DeterministicTokenizer
  64. val number2: String

    Definition Classes
    DeterministicTokenizer
  65. val ordinals: String

    Definition Classes
    DeterministicTokenizer
  66. val org: String

    Definition Classes
    DeterministicTokenizer
  67. val patterns: ArrayBuffer[String]

    Definition Classes
    DeterministicTokenizer
  68. def phraseAnnotationString(phrase: Phrase): String

    Definition Classes
    DocumentAnnotator
  69. val place: String

    Definition Classes
    DeterministicTokenizer
  70. def postAttrs: Iterable[Class[_]]

  71. def prereqAttrs: Iterable[Class[_]]

  72. def process(document: Document): Document

  73. def processParallel(documents: Iterable[Document], nThreads: Int = ...): Iterable[Document]

    Definition Classes
    DocumentAnnotator
  74. def processSequential(documents: Iterable[Document]): Iterable[Document]

    Definition Classes
    DocumentAnnotator
  75. val punc: String

    Definition Classes
    DeterministicTokenizer
  76. val quote: String

    Definition Classes
    DeterministicTokenizer
  77. val repeatedPunc: String

    Definition Classes
    DeterministicTokenizer
  78. val sgml: String

    Definition Classes
    DeterministicTokenizer
  79. val sgml2: String

    Definition Classes
    DeterministicTokenizer
  80. val space: String

    Definition Classes
    DeterministicTokenizer
  81. val state: String

    Definition Classes
    DeterministicTokenizer
  82. val state2: String

    Definition Classes
    DeterministicTokenizer
  83. val suffix: String

    Definition Classes
    DeterministicTokenizer
  84. val symbol: String

    Definition Classes
    DeterministicTokenizer
  85. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  86. def toString(): String

    Definition Classes
    AnyRef → Any
  87. def tokenAnnotationString(token: Token): String

    How the annotation of this DocumentAnnotator should be printed in one-word-per-line (OWPL) format.

    How the annotation of this DocumentAnnotator should be printed in one-word-per-line (OWPL) format. If there is no per-token annotation, return null. Used in Document.owplString.

    Definition Classes
    DeterministicTokenizerDocumentAnnotator
  88. val tokenRegex: Regex

    Definition Classes
    DeterministicTokenizer
  89. val tokenRegexString: String

    Definition Classes
    DeterministicTokenizer
  90. val units: String

    Definition Classes
    DeterministicTokenizer
  91. val url: String

    Definition Classes
    DeterministicTokenizer
  92. val url2: String

    Definition Classes
    DeterministicTokenizer
  93. val url3: String

    Definition Classes
    DeterministicTokenizer
  94. val usphone: String

    Definition Classes
    DeterministicTokenizer
  95. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  96. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  97. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  98. val word: String

    Definition Classes
    DeterministicTokenizer

Inherited from DeterministicTokenizer

Inherited from DocumentAnnotator

Inherited from AnyRef

Inherited from Any

Ungrouped