šŸ”„šŸ”„ Donā€™t Miss Out on Our End of Autumn Sale. If you have any questions, feel free to click the bottom right corner to contact our customer service..

Concat us[email protected]
Shopping Cart

No products in the cart.

šŸ”
BS ISO 24614-2:2011:2013 Edition

BS ISO 24614-2:2011:2013 Edition

$198.66

Language resource management. Word segmentation of written texts – Word segmentation for Chinese, Japanese and Korean

Published By Publication Date Number of Pages
BSI 2013 54
PDF Format Searchable Printable Preview Now
Guaranteed Safe Checkout
Category:

If you have any questions, feel free to reach out to our online customer service team by clicking on the bottom right corner. Weā€™re here to assist you 24/7.
Email:[email protected]

The basic concepts and general principles of word segmentation as defined in ISO 24614-1 apply to Chinese, Japanese and Korean. Text needs to be segmented into tokens, words, phrases or some other types of smaller textual units in order to perform certain computational applications on language resources, such as natural language processing, information retrieval (IR) and machine translation (MT). This part of ISO 24614 is restricted to the segmentation of a text into words or other word segmentation units (WSUs). This task is distinct from morphological or syntactic analysis per se, although it greatly depends on morphosyntactic analysis. It is also different from the task of laying out a framework for constructing a lexicon and identifying its lexical entries, namely lemmas and lexemes. The frameworks for the latter tasks are provided by ISO 24611, ISO 24613 and ISO 24615.

The main objective of this part of ISO 24614 is to specify rules for delineating WSUs for Chinese, Japanese and Korean. Some rules are common to all three languages, though each language also has its own distinct rules for identifying WSUs. The common features are discussed in Clause 5, then the distinct rules are laid out in Clause 6 for Chinese, Clause 7 for Japanese and Clause 8 for Korean.

PDF Catalog

PDF Pages PDF Title
9 1 Scope
2 Normative references
10 3 Terms and definitions
12 4 Overview
4.1 Introduction
4.2 Markup convention
13 4.3 Review of the concept of word segmentation unit
4.4 Features common to Chinese, Japanese and Korean
14 5 General rules for identifying WSUs in Chinese, Japanese and Korean
5.1 Words
5.2 Derivationally formed words
15 5.3 Word compounds
16 5.4 Phrasal compounds
5.5 Idioms
17 5.6 Fixed expressions
18 5.7 Abbreviations
5.8 Transliterated loanwords
19 5.9 Strings of foreign or special characters
5.10 Components of a WSU
20 6 Specific rules for identifying WSUs in Chinese
6.1 Lexical items followed by the suffixå„æ(r)
6.2 Lexical items
6.2.1 Nouns
6.2.1.1 General
6.2.1.2 Common nouns
22 6.2.1.3 Proper nouns
25 6.2.2 Verbs
6.2.2.1 Various forms of reiterative verbs
6.2.2.2 Verbal prefixes with a negative meaning
6.2.2.3 Alternative question forms
26 6.2.2.4 Verb-object structures and verb collocations
6.2.2.5 Verbā€“complement word structures
27 6.2.2.6 Adverb-delimited verbs
28 6.2.2.7 Sequences of independent single verbs
6.2.3 Adjectives
6.2.3.1 Reiteratively combined adjectives
29 6.2.3.2 Adjectival phrases
6.2.3.3 Adjectives in a sequential form without a conjunction
6.2.3.4 Adjective-delimited nouns for colours
30 6.2.3.5 Adjectival phrases
6.2.4 Pronouns
31 6.2.5 Numerals
33 6.2.6 Measure words
6.2.7 Adverbs
34 6.2.8 Prepositions
6.2.9 Conjunctions
6.2.10 Auxiliary words
35 6.2.11 Modal words
6.2.12 Exclamations
6.2.13 Imitative words
7 Specific rules for identifying WSUs in Japanese text
7.1 Bunsetsus
7.2 Lexical items
7.2.1 General rule
36 7.2.2 Nouns
7.2.2.1 Nouns in general
37 7.2.2.2 Common nouns and abstract nouns
7.2.2.3 Proper nouns
38 7.2.2.4 Pronouns
39 7.2.2.5 Measure nouns
40 7.2.3 Verbs
41 7.2.4 Adjectives
42 7.2.5 Adnouns
7.2.6 Adverbs
43 7.2.7 Conjunctions
7.2.8 Exclamations
7.2.9 Particles
7.2.10 Auxiliary verbs
44 8 Specific rules for identifying WSUs in Korean text
8.1 Eojeols
8.2 Lexical items
8.2.1 General rule
45 8.2.2 Nouns
8.2.2.1 Nouns in general
8.2.2.2 Proper nouns
46 8.2.2.3 Bound nouns
8.2.3 Pronouns
47 8.2.4 Numerals
8.2.5 Verbs
8.2.6 Adjectives
48 8.2.7 Adnouns
8.2.8 Adverbs
8.2.9 Exclamations
8.3 Grammatical affixes

Related products

BS ISO 24614-2:2011
$198.66