ARTICLE
TITLE

The Finno-Ugric Languages and The Internet Project

SUMMARY

 This paper describes a Kone Foundation funded project called "The Finno-Ugric Languages and The Internet" together with some of the achieved results. The main activity of the project is to crawl the internet and gather texts written in small Uralic languages. The sentences and words of the found texts will be assembled into a freely available corpus. Crawling is done using the open source crawler Heritrix, which is developed by the Internet Archive. Heritrix crawls through the pages and passes the found texts to a language identifier. We are using a state of the art language identifier, which has been further developed within the project and has been evaluated using 285 languages. We describe the language identification evaluation results concerning the 34 Uralic languages known by the language identifier. We also describe the initial observations and results from the first five large crawls which were done in the national internet domains of Finland, Sweden, Norway, Russia, and Estonia. 

 Articles related

Veronika Vincze, Ágoston Nagy, Csilla Horváth, Norbert Szilágyi, István Kozmács, Edit Bogár, Anna Fenyvesi    

Nowadays, digital language use such as reading and writing e-mails, chats, messages, weblogs and comments on websites and social media platforms such as Facebook and Twitter has increased the amount of written language production for most of the users. T... see more


Niklas Laxström, Antti Kanner    

This paper introduces the concept of Multilingual Semantic MediaWiki, which can be used to build collaborative on-line projects for certain types of multilingual content. Namely, dictionaries whose users are multilingual or have different native language... see more


Rezeda Dilshatovna Shakirova,Guzel Abelkhasanovna Sadrieva,Adelina Renatovna Safina,Inga Gennadyevna Almikaeva,Alsu Flerovna Galimullina    

The article discusses the interaction of evidentiality categories, typical of many Turkic, Finno-Ugric, Samoyed, certain Slavic, and other languages with the categories of epistemic modality, which is widely represented particularly in Germanic languages... see more


Pirkko Muikku-Werner,Helka Riionheimo    

Reseptiivistä monikielisyyttä (RM) on suomalaisugrilaisessa kontekstissa tarkasteltu tavallisimmin viron ja suomen keskinäisen ymmärrettävyyden kannalta. Karjalan ja suomen välistä ymmärrettävyyttä ei ole tutkittu juuri lainkaan, joskin Alekseeva (2016) ... see more

Revista: Lähivõrdlusi

Annekatrin Kikerpill,Johanna Laakso,Kirsti Siitonen,Raili Pool    

-

Revista: Lähivõrdlusi