Course goals Advances in computer technology have revolutionized the ways linguists can approach their data. By using computers, we can access large bodies of text (corpora) and search for the phenomena in which we are interested. In this way, we can uncover complexities in naturally-occurring data and explore issues related to frequency of usage.
In this course, we will investigate some of the following questions, among others: What is a corpus, and what corpora exist? How are corpora developed? How does one search for specific phenomena in corpora? What is a concordancer? Do we need syntactic annotation? Are there programs that do the annotation automatically? Are there tools that help search linguistically annotated corpora?
Course website: http://cl.indiana.edu/~md7/13/615/
Assignments, slides, etc. will be posted here.
|or by appointment|
Assignments: There will be approximately one assignment every two weeks. These assignments give you the opportunity to practically explore the topics discussed in class.
Readings: There is a main required textbook we will use. Additionally, there will sometimes be readings available online.
Grading: Grades will be based on:
|Final project||40%||due 5pm on Mon., Apr. 29|
Final projects Final projects will allow you to explore a research topic of your own interest and how corpus linguistic methods can enhance the research. More details will be given soon, as part of your assignments.
Perl programming Approximately every week, we will have a short lesson (20-30 minutes) on the Perl programming language. This language is useful for writing quick programs to process text, change data formats, access web data, as a front-end for language technology, etc. I assume no previous programming background.
500 Billion Words Workshop It just so happens that there is a Workshop happening April 18–20 here at IU which is relevant to this course, the What Can We Do With 500 Billion Words? workshop (http://mypage.iu.edu/~meldye/workshop/). This is a great chance to hear various speakers talk on working with large data sets. Many talks are on Friday, April 19, so you should book part of that day to attend at least some of the workshop.
Academic Misconduct: Academic misconduct is not allowed in this course. The Indiana University Code of Student Rights, Responsibilities, and Conduct (http://dsa.indiana.edu/Code/) defines academic misconduct as “any activity that tends to undermine the academic integrity of the institution . . . Academic misconduct may involve human, hard-copy, or electronic resources . . . Academic misconduct includes, but is not limited to . . . cheating, fabrication, plagiarism, interference, violation of course rules, and facilitating academic misconduct” (II. G.1-6).
Students with Disabilities: Students who need an accommodation based on the impact of a disability should contact me to arrange an appointment as soon as possible to discuss the course format, to anticipate needs, and to explore potential accommodations.
I rely on Disability Services for Students for assistance in verifying the need for accommodations and developing accommodation strategies. Students who have not previously contacted Disability Services are encouraged to do so (812-855-7578; http://www.indiana.edu/~iubdss/).
Schedule We will mix practical sessions with more lecture-based sessions.
No class, MLK Day
|3 (.pl, leap.pl)|
R: corpus linguistics
|#3 due (.pl)|
No class, Spring Break
No class, Spring Break
In-class practice (scripts.tgz)
More information: linguistic annotation & web data
|8||8 (a.pl, b.pl, c.pl)|
Web as Corpus 2
In-class practice (one.pl)
500-Billion Words Workshop)
Perl wrap-up + presentations
Final papers due @ 5pm
Disclaimer This syllabus is subject to change. In fact, it will change as the course develops and as I figure out my travel schedule.
Baroni, Marco and Silvia Bernardini (2004). BootCaT: Bootstrapping corpora and terms from the web. In Proceedings of LREC 2004. http://sslmit.unibo.it/~baroni/publications/lrec2004/bootcat_lrec_2004.pdf.
Baroni, Marco and Adam Kilgarriff (2006). Large linguistically-processed Web corpora for multiple languages. In Proceedings of EACL-06, Demonstration Session. Trento, Italy. http://aclweb.org/anthology-new/E/E06/E06-2001.pdf.
Biber, Douglas (1993). Representativeness in Corpus Design. Literary and Linguistic Computing 8(4), 243–257. http://staff.um.edu.mt/albert.gatt/teaching/dl/biber93.pdf.
Jenset, Gard B. (2008a). Basic R for corpus linguistics. Methods in linguistics workshop, August 19, 2008, http://folk.uib.no/gje037/tutorialR.pdf.
Jenset, Gard B. (2008b). Basic statistics for corpus linguistics. Methods in linguistics workshop, August 19, 2008, http://folk.uib.no/gje037/statTutorialR.pdf.
Levy, Roger and Galen Andrew (2006). Tregex and Tsurgeon: tools for querying and manipulating tree data structures. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC 2006). Genoa, Italy. http://nlp.stanford.edu/pubs/levy_andrew_lrec2006.pdf.
Lozano, Cristóbal and Amaya Mendikoetxea (to appear). Learner corpora and Second Language Acquisition: The design and collection of CEDEL2. In N. Ballier, A. Díaz-Negrillo and P. Thompson (eds.), Automatic Treatment and Analysis of Learner Corpus Data, Amsterdam: John Benjamins. http://wdb.ugr.es/~cristoballozano/wp-content/uploads/Lozano-and-Mendikoetxea-2012-CEDEL2-versin-pgina-web.pdf.
Marcus, M., Beatrice Santorini and M. A. Marcinkiewicz (1993). Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics 19(2), 313–330. http://acl.ldc.upenn.edu/J/J93/J93-2004.pdf.
Meurers, Walt Detmar (2005). On the use of electronic corpora for theoretical linguistics. Case studies from the syntax of German. Lingua 115(1), 1619–1639. http://ling.osu.edu/~dm/papers/meurers-03.html.
Meurers, Walt Detmar and Stefan Müller (2007). Corpora and Syntax (Article 44). In Anke Lüdeling and Merja Kytö (eds.), Corpus linguistics, Berlin: Mouton de Gruyter. http://purl.org/net/dm/papers/meurers-mueller-07.html.
Pedersen, Ted, Satanjeev Banerjee, Bridget McInnes, Saiyam Kohli, Mahesh Joshi and Ying Liu (2011). The Ngram Statistics Package (Text::NSP) : A Flexible Tool for Identifying Ngrams, Collocations, and Word Associations. In Proceedings of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World. Portland, OR, pp. 131–133. http://www.aclweb.org/anthology-new/W/W11/W11-0821.pdf.
Sharoff, Serge (2006). Creating general-purpose corpora using automated search engine queries. In Marco Baroni and Silvia Bernardini (eds.), WaCky! Working papers on the Web as Corpus, Gedit, Bologna. http://wackybook.sslmit.unibo.it/pdfs/sharoff.pdf.