Beyond kappa: A review of interrater agreement measures

Article Properties
  • Language
    English
  • DOI (url)
    10.2307/3315487
  • Publication Date
    1999/03/01
  • Journal
    Canadian Journal of Statistics
  • Indian UGC (journal)
  • Refrences
    63
  • Citations
    545
  • Mousumi Banerjee
  • Michelle Capozzoli
  • Laura McSweeney
  • Debajyoti Sinha
Abstract
Journal Categories
Science
Mathematics
Science
Mathematics
Probabilities
Mathematical statistics
You May Also Like
Refrences
Title Journal Journal Categories Citations Publication Date
Modeling Agreement among Raters Journal of the American Statistical Association
  • Science: Mathematics: Probabilities. Mathematical statistics
  • Science: Mathematics
 82 1985
Simple Models for the Analysis of Association in Cross-Classifications Having Ordered Categories Journal of the American Statistical Association
  • Science: Mathematics: Probabilities. Mathematical statistics
  • Science: Mathematics
 353 1979
The epidemiology of pregnancy complications and outcome in a Norwegian twin population 1992
The equivalence of tetrachoric and maximum likelihood estimates of p in 2 × 2 tables Biometrika
  • Science: Biology (General)
  • Medicine: Medicine (General): Computer applications to medicine. Medical informatics
  • Science: Biology (General)
  • Science: Mathematics: Probabilities. Mathematical statistics
  • Science: Mathematics
 1970
The equivalence of tetrachoric and maximum likelihood estimates of p in 2 × 2 tables 1973
Citations
Title Journal Journal Categories Citations Publication Date
Index of Microcirculatory Resistance to predict microvascular obstruction in STEMI: A systematic review and meta‐analysis

 Catheterization and Cardiovascular Interventions
  • Medicine: Internal medicine: Specialties of internal medicine: Diseases of the circulatory (Cardiovascular) system
  • Medicine: Internal medicine: Specialties of internal medicine: Diseases of the respiratory system
  • Medicine: Internal medicine: Specialties of internal medicine: Diseases of the circulatory (Cardiovascular) system
  • Medicine: Medicine (General)
 2024
The prevalence of constipation in adult psychiatric out‐patients on clozapine treatment at a regional public hospital in Hong Kong

 Human Psychopharmacology: Clinical and Experimental
  • Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry: Neurology. Diseases of the nervous system
  • Medicine: Therapeutics. Pharmacology
  • Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry: Neurology. Diseases of the nervous system: Psychiatry
  • Philosophy. Psychology. Religion: Psychology
  • Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry
  • Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry
 2024
Feasibility of Injecting Pretreated Mine Water into a Deep Ordovician Aquifer in the Lilou Coal Mine, China

 Zeitschrift für Erziehungswissenschaft
  • Education: Theory and practice of education
  • Social Sciences
 1 2024
Energy security dimensions and economic growth in Non-OECD Asia: An analysis on the role of institutional quality with energy policy implications Energy Policy
  • Social Sciences: Industries. Land use. Labor: Special industries and trades: Energy industries. Energy policy. Fuel trade
  • Geography. Anthropology. Recreation: Environmental sciences
  • Social Sciences: Economic theory. Demography: Economics as a science
  • Geography. Anthropology. Recreation: Environmental sciences
  • Social Sciences: Industries. Land use. Labor
  • Technology: Environmental technology. Sanitary engineering
  • Social Sciences
 2024
Pharmacophore-based ML model to filter candidate E3 ligands and predict E3 Ligase binding probabilities Informatics in Medicine Unlocked 2024
Citations Analysis
Category Category Repetition
Social Sciences152
Philosophy. Psychology. Religion: Psychology81
Medicine: Medicine (General)69
Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry: Neurology. Diseases of the nervous system: Psychiatry65
Education: Theory and practice of education61
Education49
Language and Literature: Philology. Linguistics: Communication. Mass media40
Medicine: Medicine (General): Medical technology39
Social Sciences: Sociology (General)38
Medicine: Public aspects of medicine37
Social Sciences: Economic theory. Demography: Economics as a science36
Social Sciences: Commerce: Business35
Science: Mathematics: Probabilities. Mathematical statistics32
Science: Mathematics30
Geography. Anthropology. Recreation: Environmental sciences29
Medicine: Internal medicine: Special situations and conditions: Industrial medicine. Industrial hygiene24
Science: Mathematics: Instruments and machines: Electronic computers. Computer science24
Medicine: Medicine (General): Computer applications to medicine. Medical informatics22
Social Sciences: Commerce: Business: Personnel management. Employment management20
Science: Biology (General)20
Technology: Electrical engineering. Electronics. Nuclear engineering: Electronics20
Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry19
Medicine18
Technology: Engineering (General). Civil engineering (General)18
Science: Biology (General): Ecology16
Technology: Environmental technology. Sanitary engineering16
Science15
Technology: Electrical engineering. Electronics. Nuclear engineering: Electric apparatus and materials. Electric circuits. Electric networks15
Geography. Anthropology. Recreation: Recreation. Leisure: Sports14
Science: Geology14
Science: Science (General)13
Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry: Neurology. Diseases of the nervous system: Psychiatry: Therapeutics. Psychotherapy13
Education: Education (General)12
Political science: Political institutions and public administration (General)11
Science: Science (General): Cybernetics: Information theory11
Technology: Mechanical engineering and machinery11
Medicine: Internal medicine: Special situations and conditions: Sports medicine10
Medicine: Internal medicine: Neurosciences. Biological psychiatry. Neuropsychiatry: Neurology. Diseases of the nervous system10
Bibliography. Library science. Information resources9
Language and Literature: Philology. Linguistics9
Geography. Anthropology. Recreation: Geography (General)9
Technology: Technology (General): Industrial engineering. Management engineering: Information technology9
Medicine: Surgery9
Education: Special aspects of education9
Science: Physics8
Agriculture: Plant culture8
Agriculture: Animal culture8
Medicine: Surgery: Orthopedic surgery8
Political science8
Technology: Electrical engineering. Electronics. Nuclear engineering8
Technology: Electrical engineering. Electronics. Nuclear engineering: Telecommunication8
Social Sciences: Social sciences (General)7
Technology: Photography7
Social Sciences: Social pathology. Social and public welfare. Criminology7
Social Sciences: Industries. Land use. Labor6
Medicine: Therapeutics. Pharmacology6
Social Sciences: Statistics6
Science: Chemistry5
Social Sciences: The family. Marriage. Woman5
Medicine: Pathology5
Science: Mathematics: Instruments and machines: Electronic computers. Computer science: Computer software5
Technology: Electrical engineering. Electronics. Nuclear engineering: Electronics: Computer engineering. Computer hardware5
Social Sciences: Industries. Land use. Labor: Management. Industrial management4
Agriculture: Animal culture: Veterinary medicine4
Science: Chemistry: General. Including alchemy4
Medicine: Pediatrics4
Medicine: Nursing4
Technology: Engineering (General). Civil engineering (General): Transportation engineering4
Social Sciences: Transportation and communications4
Medicine: Dentistry4
Social Sciences: The family. Marriage. Woman: Women. Feminism4
Medicine: Public aspects of medicine: Toxicology. Poisons4
Law4
Science: Chemistry: Organic chemistry: Biochemistry3
Technology: Chemical technology: Biotechnology3
Medicine: Internal medicine: Special situations and conditions: Geriatrics3
Agriculture3
Agriculture: Agriculture (General)3
Language and Literature3
Science: Botany: Plant ecology3
Medicine: Internal medicine: Specialties of internal medicine: Diseases of the circulatory (Cardiovascular) system3
Science: Zoology3
Medicine: Internal medicine: Specialties of internal medicine: Immunologic diseases. Allergy3
Science: Physics: Meteorology. Climatology3
Medicine: Gynecology and obstetrics3
Social Sciences: Social history and conditions. Social problems. Social reform3
Bibliography. Library science. Information resources: Information resources (General)3
Philosophy. Psychology. Religion: Ethics3
Technology: Manufactures3
Social Sciences: Finance3
Geography. Anthropology. Recreation: Anthropology3
Medicine: Internal medicine: Specialties of internal medicine: Diseases of the digestive system. Gastroenterology2
Science: Biology (General): Genetics2
Technology: Hydraulic engineering: River, lake, and water-supply engineering (General)2
Medicine: Dermatology2
Political science: International relations2
Geography. Anthropology. Recreation2
Agriculture: Forestry2
Technology: Mechanical engineering and machinery: Renewable energy sources2
Medicine: Internal medicine2
Technology: Manufactures: Production management. Operations management2
Medicine: Internal medicine: Infectious and parasitic diseases2
Medicine: Otorhinolaryngology2
Law: Law in general. Comparative and uniform law. Jurisprudence: Comparative law. International uniform law: Medical legislation2
Social Sciences: Industries. Land use. Labor: Special industries and trades: Energy industries. Energy policy. Fuel trade2
Technology: Technology (General): Industrial engineering. Management engineering2
Medicine: Ophthalmology2
Philosophy. Psychology. Religion: Philosophy (General)2
Social Sciences: Commerce: Business: Business communication. Including business report writing, business correspondence2
Social Sciences: Commerce: Business: Marketing. Distribution of products2
Medicine: Surgery: Anesthesiology2
Medicine: Internal medicine: Medical emergencies. Critical care. Intensive care. First aid2
Science: Physics: Acoustics. Sound1
Language and Literature: Philology. Linguistics: Communication. Mass media: Oral communication. Speech1
Science: Physics: Optics. Light1
Science: Biology (General): Evolution1
Science: Biology (General): Reproduction1
Medicine: Internal medicine: Specialties of internal medicine: Diseases of the musculoskeletal system1
Technology: Chemical technology1
Science: Chemistry: Analytical chemistry1
Science: Mathematics: Instruments and machines1
Medicine: Medicine (General): Medical physics. Medical radiology. Nuclear medicine1
Technology: Engineering (General). Civil engineering (General): Engineering geology. Rock mechanics. Soil mechanics. Underground construction1
Medicine: Internal medicine: Neoplasms. Tumors. Oncology. Including cancer and carcinogens1
Technology: Ocean engineering1
Science: Physics: Geophysics. Cosmic physics1
Science: Microbiology1
Auxiliary sciences of history: Archaeology1
Medicine: Internal medicine: Special situations and conditions: Arctic medicine. Tropical medicine1
Medicine: Internal medicine: Specialties of internal medicine: Diseases of the respiratory system1
Geography. Anthropology. Recreation: Human ecology. Anthropogeography: Settlements: Cities. Urban geography1
Social Sciences: Communities. Classes. Races: Urban groups. The city. Urban sociology1
Medicine: Internal medicine: Specialties of internal medicine: Diseases of the endocrine glands. Clinical endocrinology1
Medicine: Internal medicine: Specialties of internal medicine: Nutritional diseases. Deficiency diseases1
History (General) and history of Europe: History (General)1
Technology: Chemical technology: Chemical engineering1
Medicine: Internal medicine: Special situations and conditions1
Language and Literature: Literature (General): Journalism. The periodical press, etc.1
Technology: Chemical technology: Food processing and manufacture1
Technology: Home economics: Nutrition. Foods and food supply1
Social Sciences: Commerce: Business: Accounting. Bookkeeping1
Technology: Engineering (General). Civil engineering (General): Engineering design1
The category Social Sciences 152 is the most commonly referenced area in studies that cite this article. The first research to cite this article was titled The effect of collapsing multinomial data when assessing agreement and was published in 2000. The most recent citation comes from a 2024 study titled Towards a spectrum of dissent: A content analysis of Hawai‘i’s invasive species media. This article reached its peak citation in 2014, with 45 citations. It has been cited in 411 different journals, 12% of which are open access. Among related journals, the PLOS ONE cited this research the most, with 9 citations. The chart below illustrates the annual citation trends for this article.
Citations used this article by year