Export citation

Show simple item record

dc.contributor.authorMoran, Steven
dc.contributor.authorCysouw, Michael
dc.date.issued2018-07-11
dc.date.submitted2018-10-11 23:55
dc.date.submitted2020-03-10 03:00:39
dc.date.submitted2020-04-01T12:19:47Z
dc.identifier1001685
dc.identifierOCN: 1076699025
dc.identifier2364-8899
dc.identifierhttp://library.oapen.org/handle/20.500.12657/28277
dc.identifier.urihttps://directory.doabooks.org/handle/20.500.12854/34976
dc.description.abstractThis text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts needed to understand how writing systems and character encodings function, and how they work together at the intersection between the Unicode Standard and the International Phonetic Alphabet. Although these standards are often met with frustration by users, they nevertheless provide language researchers and programmers with a consistent computational architecture needed to process, publish and analyze lexical data from the world's languages. Thus we bring to light common, but not always transparent, pitfalls which researchers face when working with Unicode and IPA. Having identified and overcome these pitfalls involved in making writing systems and character encodings syntactically and semantically interoperable (to the extent that they can be), we created a suite of open-source Python and R tools to work with languages using orthography profiles that describe author- or document-specific orthographic conventions. In this cookbook we describe a formal specification of orthography profiles and provide recipes using open source tools to show how users can segment text, analyze it, identify errors, and to transform it into different written forms for comparative linguistics research.
dc.languageEnglish
dc.relation.ispartofseriesTranslation and Multilingual Natural Language Processing
dc.rightsopen access
dc.subject.otherLinguistics
dc.titleThe Unicode cookbook for linguists
dc.title.alternativeManaging writing systems using orthography profiles
dc.typebook
oapen.identifier.doi10.5281/zenodo.1296780
oapen.relation.isPublishedByed03121b-b998-4b50-8d58-1d0745565558
virtual.oapen_relation_isPublishedBy.publisher_nameLanguage Science Press
virtual.oapen_relation_isPublishedBy.publisher_websitehttp://langsci-press.org/
oapen.relation.isFundedByKnowledge Unlatched
virtual.oapen_relation_isFundedBy.grantor_nameKnowledge Unlatched
oapen.relation.isFundedByb818ba9d-2dd9-4fd7-a364-7f305aef7ee9
oapen.relation.isbn9783961100903
oapen.collectionKnowledge Unlatched (KU)
oapen.place.publicationBerlin
oapen.grant.number103595
oapen.grant.programLanguage Science Press 2018 - 2020
dc.number103595
dc.relationisFundedByb818ba9d-2dd9-4fd7-a364-7f305aef7ee9


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record

open access
Except where otherwise noted, this item's license is described as open access