Corpus linguistics: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>James F. Perry
(bsd)
mNo edit summary
 
(8 intermediate revisions by 6 users not shown)
Line 1: Line 1:
{{speedydelete|Big Speedydelete|[[User:James F. Perry|James F. Perry]] 12:35, 19 February 2007 (CST)}}
{{subpages}}
{{TOC|right}}
'''Corpus [[linguistics]]''' is the study of language as expressed in samples ''([[Text corpus|corpora]])'' or "real world" text. This is a [[digest]]ive approach to deriving a set of abstract rules by which a [[natural language]] is governed or else relates to another language. Originally done by hand, corpora are largely derived by an automated process, which is corrected. The core of a corpus is the derivation of a set of [[Part-of-speech tagging|Part-of-speech tags]], representing a formal overview of the various types of words and word-relationships in a given language.


'''Corpus linguistics''' is the [[study of language]] as expressed in samples ''([[Text corpus|corpora]])'' or "real world" text. This method represents a [[digest]]ive approach to deriving a set of abstract rules by which a [[natural language]] is governed or else relates to another language. Originally done by hand, corpora are largely derived by an automated process, which is corrected. The core of a corpus is the derivation of a set of [[Part-of-speech tagging|Part-of-speech tags]], representing a formal overview of the various types of words and word-relationships in a given language.
Computational methods had once been viewed as a "holy grail" of linguistic research, which would ultimately manifest a [[ruleset]] for  
 
Computational methods had once been viewed as a [[holy grail]] of linguistic research, which would ultimately manifest a [[ruleset]] for  
[[natural language processing]] and [[machine translation]] at a high level. Such has not been the case, and since the [[cognitive revolution]], cognitive linguistics has been largely critical of many claimed practical uses for corpora. However, as [[computation]] capacity and speed have increased, the use of corpora to study language and term relationships en masse has gained some respectability.
[[natural language processing]] and [[machine translation]] at a high level. Such has not been the case, and since the [[cognitive revolution]], cognitive linguistics has been largely critical of many claimed practical uses for corpora. However, as [[computation]] capacity and speed have increased, the use of corpora to study language and term relationships en masse has gained some respectability.


The corpus approach runs counter to [[Noam Chomsky]]'s view that real language is riddled with performance-related errors, thus requiring careful analysis of small speech samples obtained in a highly controlled laboratory setting.  
The corpus approach runs counter to [[Noam Chomsky]]'s view that real language is riddled with performance-related errors, thus requiring careful analysis of small speech samples obtained in a highly controlled laboratory setting.  
Corpus linguistics does away with Chomsky's ''competence/performance'' split; adherents believe that reliable language analysis best occurs on field-collected samples, in natural contexts and with minimal experimental interference.{{fact}}
Corpus linguistics does away with Chomsky's ''competence/performance'' split; adherents believe that reliable language analysis best occurs on field-collected samples, in natural contexts and with minimal experimental interference.


== History ==
== History ==
Line 19: Line 19:
Other corpora represent many languages, varieties and modes, and include The [[British National Corpus]], a 100 million word collection of a range of spoken and written texts, created in the 1990s by a consortium of publishers, universities ([[Oxford University|Oxford]] and [[Lancaster University|Lancaster]]) and the [[British Library]]. There is a project underway to create an [[American National Corpus]].  
Other corpora represent many languages, varieties and modes, and include The [[British National Corpus]], a 100 million word collection of a range of spoken and written texts, created in the 1990s by a consortium of publishers, universities ([[Oxford University|Oxford]] and [[Lancaster University|Lancaster]]) and the [[British Library]]. There is a project underway to create an [[American National Corpus]].  


<!--
==Attribution==
== Methods ==
{{WPAttribution}}
This means dealing with real input data, where descriptions based on a linguist's intuition are not usually helpful.
-->


==References==
==References==
<small>
<references>
</references>
</small>
Other:
<small>
* Biber, Douglas, Susan Conrad, Randi Reppen ''Corpus Linguistics, Investigating Language Structure and Use'', Cambridge: Cambridge UP, 1998. ISBN 0-521-49957-7
* Biber, Douglas, Susan Conrad, Randi Reppen ''Corpus Linguistics, Investigating Language Structure and Use'', Cambridge: Cambridge UP, 1998. ISBN 0-521-49957-7
 
</small>
==See also==
 
* [[Concordance (publishing)|Concordance]] ([[KWIC]])
* [[Collocation]]
* [[Linguistic Data Consortium]]
* [[Keyword]]
* [[Machine translation]]
* [[Semantic prosody]]
* [[Text corpus]]
* [[Translation memory]]
 
==External links==
 
* [http://forum.corpus4u.org/index.php Corpus4u Community]
* [http://www.ling.lancs.ac.uk/monkey/ihe/linguistics/contents.htm McEnery and Wilson's Corpus Linguistics Page]
* [http://rdues.uce.ac.uk/ Research and Development Unit for English Studies]
* [http://www.corpus.bham.ac.uk/ The Centre for Corpus Linguistics at Birmingham University]
* [http://torvald.aksis.uib.no/corpora/ Corpora discussion list]
* [http://devoted.to/corpora Bookmarks for Corpus-based Linguists]: categorized and annotated links to language corpora, software, references, etc.
* [http://www.corpus-linguistics.com Gateway to Corpus Linguistics on the Internet]: an annotated guide to corpus resources on the web
* [http://compbio.uchsc.edu/corpora Biomedical corpora]
* [http://ldc.upenn.edu Linguistic Data Consortium], currently the premier distributor of corpora
 
[[Category:Discourse analysis]]
[[Category:Corpus linguistics|*]]
[[Category:Linguistics Workgroup (Top)]]
[[cs:Korpusová lingvistika]]
[[de:Korpuslinguistik]]
[[es:Corpus lingüístico]]
[[gl:Corpus lingüístico]]
[[ja:コーパス言語学]]
[[nl:Corpus (taalkunde)]]
[[pt:Corpus lingüístico]]
[[ru:Корпусная лингвистика]]
[[simple:Wikipedia:Concordancing]]

Latest revision as of 12:27, 29 September 2024

This article is developing and not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable Main Article is under development and subject to a disclaimer.

Corpus linguistics is the study of language as expressed in samples (corpora) or "real world" text. This is a digestive approach to deriving a set of abstract rules by which a natural language is governed or else relates to another language. Originally done by hand, corpora are largely derived by an automated process, which is corrected. The core of a corpus is the derivation of a set of Part-of-speech tags, representing a formal overview of the various types of words and word-relationships in a given language.

Computational methods had once been viewed as a "holy grail" of linguistic research, which would ultimately manifest a ruleset for natural language processing and machine translation at a high level. Such has not been the case, and since the cognitive revolution, cognitive linguistics has been largely critical of many claimed practical uses for corpora. However, as computation capacity and speed have increased, the use of corpora to study language and term relationships en masse has gained some respectability.

The corpus approach runs counter to Noam Chomsky's view that real language is riddled with performance-related errors, thus requiring careful analysis of small speech samples obtained in a highly controlled laboratory setting. Corpus linguistics does away with Chomsky's competence/performance split; adherents believe that reliable language analysis best occurs on field-collected samples, in natural contexts and with minimal experimental interference.

History

A landmark in modern corpus linguistics was the publication by Henry Kucera and Nelson Francis of Computational Analysis of Present-Day American English in 1967, a work based on the analysis of the Brown Corpus, a carefully compiled selection of current American English, totalling about a million words drawn from a wide variety of sources. Kucera and Francis subjected it to a variety of computational analyses, from which they compiled a rich and variegated opus, combining elements of linguistics, language teaching, psychology, statistics, and sociology. A further key publication was Randolph Quirk's 'Towards a description of English Usage' (1960, Transactions of the Philological Society, 40-61) in which he introduced The Survey of English Usage.

Shortly thereafter Boston publisher Houghton-Mifflin approached Kucera to supply a million word, three-line citation base for its new American Heritage Dictionary, the first dictionary to be compiled using corpus linguistics. The AHD made the innovative step of combining prescriptive elements (how language should be used) with descriptive information (how it actually is used).

Other publishers followed suit. The British publisher Collins' COBUILD dictionaries, designed for users learning English as a foreign language, were compiled using the Bank of English.

The Brown Corpus has also spawned a number of similarly structured corpora: the LOB Corpus (1960s British English), Kolhapur (Indian English), Wellington (New Zealand English), ACE (Australian English), the Frown Corpus (early 1990s American English), and the FLOB Corpus (1990s British English). Other corpora represent many languages, varieties and modes, and include The British National Corpus, a 100 million word collection of a range of spoken and written texts, created in the 1990s by a consortium of publishers, universities (Oxford and Lancaster) and the British Library. There is a project underway to create an American National Corpus.

Attribution

Some content on this page may previously have appeared on Wikipedia.

References

Other:

  • Biber, Douglas, Susan Conrad, Randi Reppen Corpus Linguistics, Investigating Language Structure and Use, Cambridge: Cambridge UP, 1998. ISBN 0-521-49957-7