Search Results

The Unicode cookbook for linguists

Download or Read eBook The Unicode cookbook for linguists PDF written by Steven Moran and published by Language Science Press. This book was released on 2018-06-29 with total page 148 pages. Available in PDF, EPUB and Kindle.
The Unicode cookbook for linguists
Author :
Publisher : Language Science Press
Total Pages : 148
Release :
ISBN-10 : 9783961100903
ISBN-13 : 396110090X
Rating : 4/5 (03 Downloads)

Book Synopsis The Unicode cookbook for linguists by : Steven Moran

Book excerpt: This text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts needed to understand how writing systems and character encodings function, and how they work together at the intersection between the Unicode Standard and the International Phonetic Alphabet. Although these standards are often met with frustration by users, they nevertheless provide language researchers and programmers with a consistent computational architecture needed to process, publish and analyze lexical data from the world's languages. Thus we bring to light common, but not always transparent, pitfalls which researchers face when working with Unicode and IPA. Having identified and overcome these pitfalls involved in making writing systems and character encodings syntactically and semantically interoperable (to the extent that they can be), we created a suite of open-source Python and R tools to work with languages using orthography profiles that describe author- or document-specific orthographic conventions. In this cookbook we describe a formal specification of orthography profiles and provide recipes using open source tools to show how users can segment text, analyze it, identify errors, and to transform it into different written forms for comparative linguistics research. This book is a prime example of open publishing as envisioned by Language Science Press. It is open access, has accompanying open source software, has open peer review, versioning and so on. Read more in this blog post.


The Unicode cookbook for linguists Related Books

The Unicode cookbook for linguists
Language: en
Pages: 148
Authors: Steven Moran
Categories: Language Arts & Disciplines
Type: BOOK - Published: 2018-06-29 - Publisher: Language Science Press

DOWNLOAD EBOOK

This text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts ne
The Unicode Cookbook for Linguists
Language: en
Pages: 144
Authors: Steven Moran
Categories:
Type: BOOK - Published: 2020-10-09 - Publisher: Saint Philip Street Press

DOWNLOAD EBOOK

This text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts ne
Finite-State Text Processing
Language: en
Pages: 140
Authors: Kyle Gorman
Categories: Computers
Type: BOOK - Published: 2022-06-01 - Publisher: Springer Nature

DOWNLOAD EBOOK

Weighted finite-state transducers (WFSTs) are commonly used by engineers and computational linguists for processing and generating speech and text. This book fi
The Cambridge Handbook of Historical Orthography
Language: en
Pages: 1075
Authors: Marco Condorelli
Categories: Language Arts & Disciplines
Type: BOOK - Published: 2023-09-30 - Publisher: Cambridge University Press

DOWNLOAD EBOOK

Written by a team of global scholars, this is the first Handbook covering the rapidly growing field of historical orthography. Comprehensive yet accessible, it
Machine translation for everyone: Empowering users in the age of artificial intelligence
Language: en
Pages: 210
Authors: Dorothy Kenny
Categories: Computers
Type: BOOK - Published: 2022-07-06 - Publisher: Language Science Press

DOWNLOAD EBOOK

Language learning and translation have always been complementary pillars of multilingualism in the European Union. Both have been affected by the increasing ava
Scroll to top