We (Dimuthu Upeksha, Chamila Wijayarathna, Maduranga Siriwardan, Lahiru Lasadun) started SinMin - Sinhala Corpus Project as final year undergraduates for our final year project under the supervision of Dr. Chinthana Wimalasuriya, Mr. N. H. N. D. de Silva and Prof Gihan Dias.
A rich language corpus enables a wide area of research topics for a language. Most of them include
1. Statistical analysis of the language usage pattens
2. Translators
3. Spell and Grammar Tools
4. Backend support to third party applications like OCR tools
Usually a corpus contains a collection of authentic texts of the language. However rather than storing them as raw text files, Sinmin further stores them in different databases with different schemas. This enables Sinmin to easily process language data in realtime. In addition to that SinMin Corpus contains a REST API that enable querying and finding data through third party applications.
SinMin web interface provides ability to illustrate and find patterns that occur in Sinhala Language over different time periods and different categories.
Useful Links
SinMin Sinhala Corpus currently crawl data from following sources
A rich language corpus enables a wide area of research topics for a language. Most of them include
1. Statistical analysis of the language usage pattens
2. Translators
3. Spell and Grammar Tools
4. Backend support to third party applications like OCR tools
Usually a corpus contains a collection of authentic texts of the language. However rather than storing them as raw text files, Sinmin further stores them in different databases with different schemas. This enables Sinmin to easily process language data in realtime. In addition to that SinMin Corpus contains a REST API that enable querying and finding data through third party applications.
SinMin web interface provides ability to illustrate and find patterns that occur in Sinhala Language over different time periods and different categories.
Useful Links
- SinMin Web : http://sinhala-corpus.projects.uom.lk/sinmin-web
- Crawled raw data files in XML format : http://sinhala-corpus.projects.uom.lk/sinmin-web/data
- Documentation : http://sinhala-corpus.projects.uom.lk/docs
- API documentation : http://sinhala-corpus.projects.uom.lk/docs/display/ds/REST+API
- Source Code : https://github.com/sinmin/core
- Additional Resources
- http://www.slideshare.net/cdwijayarathna/sinmin-literature-review-presentation
- http://www.slideshare.net/cdwijayarathna/implementing-a-corpus-for-sinhala-language
- http://www.slideshare.net/cdwijayarathna/sinmin-final-presentation
- Chamila's blog post : http://cdwijayarathna.blogspot.com/2015/04/sinmin-corpus-for-sinhala-language.html
SinMin Sinhala Corpus currently crawl data from following sources
- Sinhala Online Newspapers
- Lankadeepa - http://lankadeepa.lk/
- Divaina - http://www.divaina.com/
- Dinamina - http://www.dinamina.lk/2014/06/26/
- Lakbima - http://www.lakbima.lk/
- Mawbima - http://www.mawbima.lk/
- Rawaya - http://ravaya.lk/
- Silumina - http://www.silumina.lk/
- Sinhala News Sites
- Ada Derana - http://sinhala.adaderana.lk/
- Sinhala Religious and Educational Magazines
- Aloka Udapadi - http://www.lakehouse.lk/alokoudapadi/
- Budusarana - http://www.lakehouse.lk/budusarana/
- Namaskara - http://namaskara.lk/
- Sarasawiya - http://sarasaviya.lk/
- Vidusara - http://www.vidusara.com/
- Wijeya - http://www.wijeya.lk/
- Sri Lanka Gazette in Sinhala - http://documents.gov.lk/gazette/
- Online Mahawansaya - http://mahamegha.lk/mahawansa/
- Sinhala Movie Subtitles - http://www.baiscopelk.com/category/සිංහල-උපසිරැස/
- Sinhala Wikipedia - http://si.wikipedia.org/
- Sinhala Blogs
I am really interested in your Project and already read the Research paper "Implementing a Corpus for Sinhala Language". But when I am going to access SinMin web(http://sinhala-corpus.projects.uom.lk/sinmin-web) It timed out. Is the site still operational or is there any other way to access it?
ReplyDeleteThanks for your interest. Sorry. Site is down due to the lack of resources. However if you let me know what exactly you need, I may be able to help. Do you need to access the data?
ReplyDeleteYes please. My final year research project is "Bootstrapping Sinhala Linguistic Data for NLP Applications". So if I could access that data, It will be very helpful. Can you send me a way to access your data? E-mail :- kasunlakmal.klj@gmail.com
Delete