{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/automated-essay-scoring","name":"Automated Essay Scoring","slug":"automated-essay-scoring","description_markdown":"Essay scoring: **Automated Essay Scoring** is the task of assigning a score to an essay, usually in the context of assessing the language ability of a language learner. The quality of an essay is affected by the following four primary dimensions: topic relevance, organization and coherence, word usage and sentence complexity, and grammar and mechanics.\r\n\r\n\r\n<span class=\"description-source\">Source: [A Joint Model for Multimodal Document Quality Assessment ](https://arxiv.org/abs/1901.01010)</span>","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":104,"papers_with_code":27,"benchmarks":1,"benchmark_tables_in_archive":1,"benchmark_tables_shown":1,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":2,"subtasks":0,"parent_tasks":0},"benchmarks":[{"leaderboard":"/sota/automated-essay-scoring-on-asap","slug":"automated-essay-scoring-on-asap","dataset":"ASAP-AES","dataset_url":"/dataset/asap","rows_in_archive":8,"metrics":["Quadratic Weighted Kappa"],"first_row_in_archive_order":{"model":"Neural Pairwise Contrastive Regression (NPCR)","paper_title":"Automated Essay Scoring via Pairwise Contrastive Regression","paper_url":"/paper/automated-essay-scoring-via-pairwise","paper_date":"","arxiv_id":null,"code_links":[{"title":"carryckw/aes-npcr","url":"https://github.com/carryckw/aes-npcr"}],"syntology":null}}],"datasets":[{"url":"/dataset/asap","name":"ASAP-AES","full_name":"Automated Student Assessment Prize","num_papers_in_archive":11},{"url":"/dataset/the-write-improve-corpus-2024","name":"The Write & Improve Corpus 2024","full_name":"","num_papers_in_archive":1}],"subtasks":[],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":2,"rows_per_page":100,"shown":100,"of":104,"of_with_code":27,"tagged_in_all":104,"counts":{"archive_papers_tagged":104,"with_a_code_link":27,"where_syntology_ran_a_sample":1,"not_listed_spam_title":0,"listed":104,"listed_where_code_ran":1,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":1,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":1,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/automated-essay-scoring-based-on-two-stage","slug":"automated-essay-scoring-based-on-two-stage","title":"Automated Essay Scoring based on Two-Stage Learning","date":"2019-01-23","arxiv_id":"1901.07744","repositories_listed":2,"syntology":null},{"url":"/paper/beyond-agreement-diagnosing-the-rationale","slug":"beyond-agreement-diagnosing-the-rationale","title":"Beyond Agreement: Diagnosing the Rationale Alignment of Automated Essay Scoring Methods based on Linguistically-informed Counterfactuals","date":"2024-05-29","arxiv_id":"2405.19433","repositories_listed":1,"syntology":null},{"url":"/paper/exploring-llm-prompting-strategies-for-joint","slug":"exploring-llm-prompting-strategies-for-joint","title":"Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation","date":"2024-04-24","arxiv_id":"2404.15845","repositories_listed":1,"syntology":null},{"url":"/paper/autoregressive-score-generation-for-multi","slug":"autoregressive-score-generation-for-multi","title":"Autoregressive Score Generation for Multi-trait Essay Scoring","date":"2024-03-13","arxiv_id":"2403.08332","repositories_listed":1,"syntology":null},{"url":"/paper/can-large-language-models-automatically-score","slug":"can-large-language-models-automatically-score","title":"Can Large Language Models Automatically Score Proficiency of Written Essays?","date":"2024-03-10","arxiv_id":"2403.06149","repositories_listed":1,"syntology":null},{"url":"/paper/veras-verify-then-assess-stem-lab-reports","slug":"veras-verify-then-assess-stem-lab-reports","title":"VerAs: Verify then Assess STEM Lab Reports","date":"2024-02-07","arxiv_id":"2402.05224","repositories_listed":1,"syntology":null},{"url":"/paper/from-automation-to-augmentation-large","slug":"from-automation-to-augmentation-large","title":"Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs","date":"2024-01-12","arxiv_id":"2401.06431","repositories_listed":1,"syntology":null},{"url":"/paper/unveiling-the-tapestry-of-automated-essay","slug":"unveiling-the-tapestry-of-automated-essay","title":"Unveiling the Tapestry of Automated Essay Scoring: A Comprehensive Investigation of Accuracy, Fairness, and Generalizability","date":"2024-01-11","arxiv_id":"2401.05655","repositories_listed":1,"syntology":null},{"url":"/paper/learning-to-love-diligent-trolls-accounting","slug":"learning-to-love-diligent-trolls-accounting","title":"Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task","date":"2023-10-30","arxiv_id":"2310.19271","repositories_listed":1,"syntology":null},{"url":"/paper/modeling-structural-similarities-between","slug":"modeling-structural-similarities-between","title":"Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks","date":"2023-06-10","arxiv_id":"2306.06472","repositories_listed":1,"syntology":null},{"url":"/paper/prompt-and-trait-relation-aware-cross-prompt","slug":"prompt-and-trait-relation-aware-cross-prompt","title":"Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring","date":"2023-05-26","arxiv_id":"2305.16826","repositories_listed":1,"syntology":{"n":6,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/prompt-and-trait-relation-aware-cross-prompt#ran","syntology_url":"https://syntology.ai/paper/2305.16826","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.16826"}},"official":{"repos":["doheejin/protact"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/wikisqe-a-large-scale-dataset-for-sentence","slug":"wikisqe-a-large-scale-dataset-for-sentence","title":"WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia","date":"2023-05-10","arxiv_id":"2305.05928","repositories_listed":1,"syntology":null},{"url":"/paper/h-aes-towards-automated-essay-scoring-for","slug":"h-aes-towards-automated-essay-scoring-for","title":"H-AES: Towards Automated Essay Scoring for Hindi","date":"2023-02-28","arxiv_id":"2302.14635","repositories_listed":1,"syntology":null},{"url":"/paper/automated-essay-scoring-via-pairwise","slug":"automated-essay-scoring-via-pairwise","title":"Automated Essay Scoring via Pairwise Contrastive Regression","date":"2022-10-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/on-the-use-of-bert-for-automated-essay","slug":"on-the-use-of-bert-for-automated-essay","title":"On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation","date":"2022-05-08","arxiv_id":"2205.03835","repositories_listed":1,"syntology":null},{"url":"/paper/countering-the-influence-of-essay-length-in","slug":"countering-the-influence-of-essay-length-in","title":"Countering the Influence of Essay Length in Neural Essay Scoring","date":"2021-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/automated-essay-scoring-using-transformer","slug":"automated-essay-scoring-using-transformer","title":"Automated Essay Scoring Using Transformer Models","date":"2021-10-13","arxiv_id":"2110.06874","repositories_listed":1,"syntology":null},{"url":"/paper/a-prompt-independent-and-interpretable","slug":"a-prompt-independent-and-interpretable","title":"A Prompt-independent and Interpretable Automated Essay Scoring Method for Chinese Second Language Writing","date":"2021-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/expats-a-toolkit-for-explainable-automated","slug":"expats-a-toolkit-for-explainable-automated","title":"EXPATS: A Toolkit for Explainable Automated Text Scoring","date":"2021-04-07","arxiv_id":"2104.03364","repositories_listed":1,"syntology":null},{"url":"/paper/many-hands-make-light-work-using-essay-traits","slug":"many-hands-make-light-work-using-essay-traits","title":"Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays","date":"2021-02-01","arxiv_id":"2102.00781","repositories_listed":1,"syntology":null},{"url":"/paper/prompt-agnostic-essay-scorer-a-domain","slug":"prompt-agnostic-essay-scorer-a-domain","title":"Prompt Agnostic Essay Scorer: A Domain Generalization Approach to Cross-prompt Automated Essay Scoring","date":"2020-08-04","arxiv_id":"2008.01441","repositories_listed":1,"syntology":null},{"url":"/paper/calling-out-bluff-attacking-the-robustness-of","slug":"calling-out-bluff-attacking-the-robustness-of","title":"Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems","date":"2020-07-14","arxiv_id":"2007.06796","repositories_listed":1,"syntology":null},{"url":"/paper/language-models-and-automated-essay-scoring","slug":"language-models-and-automated-essay-scoring","title":"Language models and Automated Essay Scoring","date":"2019-09-18","arxiv_id":"1909.09482","repositories_listed":1,"syntology":null},{"url":"/paper/co-attention-based-neural-network-for-source-2","slug":"co-attention-based-neural-network-for-source-2","title":"Co-Attention Based Neural Network for Source-Dependent Essay Scoring","date":"2019-08-06","arxiv_id":"1908.01993","repositories_listed":1,"syntology":null},{"url":"/paper/neural-automated-essay-scoring-and-coherence","slug":"neural-automated-essay-scoring-and-coherence","title":"Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Input","date":"2018-04-18","arxiv_id":"1804.06898","repositories_listed":1,"syntology":null},{"url":"/paper/skipflow-incorporating-neural-coherence","slug":"skipflow-incorporating-neural-coherence","title":"SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring","date":"2017-11-14","arxiv_id":"1711.04981","repositories_listed":1,"syntology":null},{"url":"/paper/a-neural-approach-to-automated-essay-scoring","slug":"a-neural-approach-to-automated-essay-scoring","title":"A Neural Approach to Automated Essay Scoring","date":"2016-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":null,"slug":"enhancing-marker-scoring-accuracy-through","title":"Enhancing Marker Scoring Accuracy through Ordinal Confidence Modelling in Educational Assessments","date":"2025-05-29","arxiv_id":"2505.23315","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-incorporating","title":"Automated Essay Scoring Incorporating Annotations from Automated Feedback Systems","date":"2025-05-28","arxiv_id":"2505.22771","repositories_listed":0,"syntology":null},{"url":null,"slug":"composable-cross-prompt-essay-scoring-by","title":"Composable Cross-prompt Essay Scoring by Merging Models","date":"2025-05-24","arxiv_id":"2505.18548","repositories_listed":0,"syntology":null},{"url":null,"slug":"cafes-a-collaborative-multi-agent-framework","title":"CAFES: A Collaborative Multi-Agent Framework for Multi-Granular Multimodal Essay Scoring","date":"2025-05-20","arxiv_id":"2505.13965","repositories_listed":0,"syntology":null},{"url":null,"slug":"trates-trait-specific-rubric-assisted-cross","title":"TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring","date":"2025-05-20","arxiv_id":"2505.14577","repositories_listed":0,"syntology":null},{"url":null,"slug":"lces-zero-shot-automated-essay-scoring-via","title":"LCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Models","date":"2025-05-13","arxiv_id":"2505.08498","repositories_listed":0,"syntology":null},{"url":null,"slug":"do-we-need-a-detailed-rubric-for-automated","title":"Do We Need a Detailed Rubric for Automated Essay Scoring using Large Language Models?","date":"2025-05-02","arxiv_id":"2505.01035","repositories_listed":0,"syntology":null},{"url":null,"slug":"does-the-prompt-based-large-language-model","title":"Does the Prompt-based Large Language Model Recognize Students' Demographics and Introduce Bias in Essay Scoring?","date":"2025-04-30","arxiv_id":"2504.21330","repositories_listed":0,"syntology":null},{"url":null,"slug":"evolution-of-ai-in-education-agentic","title":"Evolution of AI in Education: Agentic Workflows","date":"2025-04-25","arxiv_id":"2504.20082","repositories_listed":0,"syntology":null},{"url":null,"slug":"arwi-arabic-write-and-improve","title":"ARWI: Arabic Write and Improve","date":"2025-04-16","arxiv_id":"2504.11814","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-arabic-automated-essay-scoring-with","title":"Enhancing Arabic Automated Essay Scoring with Synthetic Data and Error Injection","date":"2025-03-22","arxiv_id":"2503.17739","repositories_listed":0,"syntology":null},{"url":null,"slug":"essayjudge-a-multi-granular-benchmark-for","title":"EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models","date":"2025-02-17","arxiv_id":"2502.11916","repositories_listed":0,"syntology":null},{"url":null,"slug":"how-well-can-llms-grade-essays-in-arabic","title":"How well can LLMs Grade Essays in Arabic?","date":"2025-01-27","arxiv_id":"2501.16516","repositories_listed":0,"syntology":null},{"url":null,"slug":"on-the-suitability-of-pre-trained","title":"On the Suitability of pre-trained foundational LLMs for Analysis in German Legal Education","date":"2024-12-20","arxiv_id":"2412.15902","repositories_listed":0,"syntology":null},{"url":null,"slug":"the-impact-of-example-selection-in-few-shot","title":"The Impact of Example Selection in Few-Shot Prompting on Automated Essay Scoring Using GPT Models","date":"2024-11-28","arxiv_id":"2411.18924","repositories_listed":0,"syntology":null},{"url":null,"slug":"rationale-behind-essay-scores-enhancing-s-llm","title":"Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMs","date":"2024-10-18","arxiv_id":"2410.14202","repositories_listed":0,"syntology":null},{"url":null,"slug":"autoregressive-multi-trait-essay-scoring-via","title":"Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards","date":"2024-09-26","arxiv_id":"2409.17472","repositories_listed":0,"syntology":null},{"url":null,"slug":"are-large-language-models-good-essay-graders","title":"Are Large Language Models Good Essay Graders?","date":"2024-09-19","arxiv_id":"2409.13120","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-in-arabic-a-dataset","title":"Automated essay scoring in Arabic: a dataset and analysis of a BERT-based system","date":"2024-07-15","arxiv_id":"2407.11212","repositories_listed":0,"syntology":null},{"url":null,"slug":"is-gpt-4-alone-sufficient-for-automated-essay","title":"Is GPT-4 Alone Sufficient for Automated Essay Scoring?: A Comparative Judgment Approach Based on Rater Cognition","date":"2024-07-08","arxiv_id":"2407.05733","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-using-grammatical","title":"Automated Essay Scoring Using Grammatical Variety and Errors with Multi-Task Learning and Item Response Theory","date":"2024-06-13","arxiv_id":"2406.08817","repositories_listed":0,"syntology":null},{"url":null,"slug":"automatic-essay-multi-dimensional-scoring","title":"Automatic Essay Multi-dimensional Scoring with Fine-tuning and Multiple Regression","date":"2024-06-03","arxiv_id":"2406.01198","repositories_listed":0,"syntology":null},{"url":null,"slug":"graded-relevance-scoring-of-written-essays","title":"Graded Relevance Scoring of Written Essays with Dense Retrieval","date":"2024-05-08","arxiv_id":"2405.05200","repositories_listed":0,"syntology":null},{"url":null,"slug":"can-gpt-4-do-l2-analytic-assessment","title":"Can GPT-4 do L2 analytic assessment?","date":"2024-04-29","arxiv_id":"2404.18557","repositories_listed":0,"syntology":null},{"url":null,"slug":"prompting-large-language-models-for-zero-shot-2","title":"Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoring","date":"2024-04-07","arxiv_id":"2404.04941","repositories_listed":0,"syntology":null},{"url":null,"slug":"transformer-based-joint-modelling-for","title":"Transformer-based Joint Modelling for Automatic Essay Scoring and Off-Topic Detection","date":"2024-03-24","arxiv_id":"2404.08655","repositories_listed":0,"syntology":null},{"url":null,"slug":"frustratingly-simple-prompting-based-text","title":"Frustratingly Simple Prompting-based Text Denoising","date":"2024-02-24","arxiv_id":"2402.15931","repositories_listed":0,"syntology":null},{"url":null,"slug":"dress-dataset-for-rubric-based-essay-scoring","title":"DREsS: Dataset for Rubric-based Essay Scoring on EFL Writing","date":"2024-02-21","arxiv_id":"2402.16733","repositories_listed":0,"syntology":null},{"url":null,"slug":"empirical-study-of-large-language-models-as","title":"Empirical Study of Large Language Models as Automated Essay Scoring Tools in English Composition__Taking TOEFL Independent Writing Task for Example","date":"2024-01-07","arxiv_id":"2401.03401","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-essay-scoring-with-adversarial","title":"Enhancing Essay Scoring with Adversarial Weights Perturbation and Metric-specific AttentionPooling","date":"2024-01-06","arxiv_id":"2401.05433","repositories_listed":0,"syntology":null},{"url":null,"slug":"fabric-automated-scoring-and-feedback","title":"LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction","date":"2023-10-08","arxiv_id":"2310.05191","repositories_listed":0,"syntology":null},{"url":null,"slug":"rubric-specific-approach-to-automated-essay","title":"Rubric-Specific Approach to Automated Essay Scoring with Augmentation Training","date":"2023-09-06","arxiv_id":"2309.02740","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-in-argumentative","title":"Automated Essay Scoring in Argumentative Writing: DeBERTeachingAssistant","date":"2023-07-09","arxiv_id":"2307.04276","repositories_listed":0,"syntology":null},{"url":null,"slug":"review-of-feedback-in-automated-essay-scoring","title":"Review of feedback in Automated Essay Scoring","date":"2023-07-09","arxiv_id":"2307.05553","repositories_listed":0,"syntology":null},{"url":null,"slug":"the-effectiveness-of-a-dynamic-loss-function","title":"The Effectiveness of a Dynamic Loss Function in Neural Network Based Automated Essay Scoring","date":"2023-05-15","arxiv_id":"2305.10447","repositories_listed":0,"syntology":null},{"url":null,"slug":"can-chatgpt-and-bard-generate-aligned","title":"Can ChatGPT and Bard Generate Aligned Assessment Items? A Reliability Analysis against Human Performance","date":"2023-04-09","arxiv_id":"2304.05372","repositories_listed":0,"syntology":null},{"url":null,"slug":"using-active-learning-methods-to","title":"Using Active Learning Methods to Strategically Select Essays for Automated Scoring","date":"2023-01-02","arxiv_id":"2301.00628","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-using-transformers","title":"Data Augmentation for Automated Essay Scoring using Transformer Models","date":"2022-10-23","arxiv_id":"2210.12809","repositories_listed":0,"syntology":null},{"url":null,"slug":"analytic-automated-essay-scoring-based-on","title":"Analytic Automated Essay Scoring Based on Deep Neural Networks Integrating Multidimensional Item Response Theory","date":"2022-10-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"mwe-for-essay-scoring-english-as-a-foreign","title":"MWE for Essay Scoring English as a Foreign Language","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"improving-performance-of-automated-essay","title":"Improving Performance of Automated Essay Scoring by using back-translation essays and adjusted scores","date":"2022-03-01","arxiv_id":"2203.00354","repositories_listed":0,"syntology":null},{"url":null,"slug":"toward-educator-focused-automated-scoring","title":"Toward Educator-focused Automated Scoring Systems for Reading and Writing","date":"2021-12-22","arxiv_id":"2112.11973","repositories_listed":0,"syntology":null},{"url":null,"slug":"encoder-decoder-approach-to-automated-essay","title":"Encoder Decoder Approach to Automated Essay Scoring For Deeper Semantic Analysis","date":"2021-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"the-effects-of-data-size-on-automated-essay","title":"The effects of data size on Automated Essay Scoring engines","date":"2021-08-30","arxiv_id":"2108.13275","repositories_listed":0,"syntology":null},{"url":null,"slug":"essay-quality-signals-as-weak-supervision-for","title":"Essay Quality Signals as Weak Supervision for Source-based Essay Scoring","date":"2021-04-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-using-efficient","title":"Automated essay scoring using efficient transformer-based language models","date":"2021-02-25","arxiv_id":"2102.13136","repositories_listed":0,"syntology":null},{"url":null,"slug":"multi-task-learning-for-automated-essay","title":"Multi-task Learning for Automated Essay Scoring with Sentiment Analysis","date":"2020-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"neural-automated-essay-scoring-incorporating","title":"Neural Automated Essay Scoring Incorporating Handcrafted Features","date":"2020-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"centering-based-neural-coherence-modeling","title":"Centering-based Neural Coherence Modeling with Hierarchical Discourse Segments","date":"2020-11-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-automated-essay-scoring-performance","title":"Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking","date":"2020-11-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"corruption-is-not-all-bad-incorporating","title":"Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring","date":"2020-10-13","arxiv_id":"2010.06137","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-topical-component-extraction-using-1","title":"Automated Topical Component Extraction Using Neural Network Attention Scores from Source-based Essay Scoring","date":"2020-08-04","arxiv_id":"2008.01809","repositories_listed":0,"syntology":null},{"url":null,"slug":"lingglewrite-a-coaching-system-for-essay","title":"LinggleWrite: a Coaching System for Essay Writing","date":"2020-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"multiple-instance-learning-for-content","title":"Multiple Instance Learning for Content Feedback Localization without Annotation","date":"2020-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"should-you-fine-tune-bert-for-automated-essay","title":"Should You Fine-Tune BERT for Automated Essay Scoring?","date":"2020-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-system-for-nonnative","title":"Automated Essay Scoring System for Nonnative Japanese Learners","date":"2020-05-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"computing-with-subjectivity-lexicons","title":"Computing with Subjectivity Lexicons","date":"2020-05-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"ukara-10-challenge-track-1-automatic-short","title":"UKARA 1.0 Challenge Track 1: Automatic Short-Answer Scoring in Bahasa Indonesia","date":"2020-02-28","arxiv_id":"2002.12540","repositories_listed":0,"syntology":null},{"url":null,"slug":"word-embedding-for-response-to-text-1","title":"Word Embedding for Response-To-Text Assessment of Evidence","date":"2019-08-06","arxiv_id":"1908.01969","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-with-discourse-aware","title":"Automated Essay Scoring with Discourse-Aware Neural Models","date":"2019-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"equity-beyond-bias-in-language-technologies","title":"Equity Beyond Bias in Language Technologies for Education","date":"2019-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"regression-or-classification-automated-essay","title":"Regression or classification? Automated Essay Scoring for Norwegian","date":"2019-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"give-me-more-feedback-ii-annotating-thesis","title":"Give Me More Feedback II: Annotating Thesis Strength and Related Attributes in Student Essays","date":"2019-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"give-me-more-feedback-annotating-argument","title":"Give Me More Feedback: Annotating Argument Persuasiveness and Related Attributes in Student Essays","date":"2018-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"tdnn-a-two-stage-deep-neural-network-for","title":"TDNN: A Two-stage Deep Neural Network for Prompt-independent Automated Essay Scoring","date":"2018-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-essay-scoring-in-the-presence-of","title":"Automated Essay Scoring in the Presence of Biased Ratings","date":"2018-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":"/paper/automated-essay-scoring-with-string-kernels","slug":"automated-essay-scoring-with-string-kernels","title":"Automated essay scoring with string kernels and word embeddings","date":"2018-04-21","arxiv_id":"1804.07954","repositories_listed":0,"syntology":null},{"url":null,"slug":"neural-multi-task-learning-in-automated","title":"Neural Multi-task Learning in Automated Assessment","date":"2018-01-21","arxiv_id":"1801.06830","repositories_listed":0,"syntology":null},{"url":null,"slug":"investigating-neural-architectures-for-short","title":"Investigating neural architectures for short answer scoring","date":"2017-09-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"exploring-automated-essay-scoring-for","title":"Exploring Automated Essay Scoring for Nonnative English Speakers","date":"2017-06-11","arxiv_id":"1706.03335","repositories_listed":0,"syntology":null},{"url":"/paper/automatic-features-for-essay-scoring-a-an","slug":"automatic-features-for-essay-scoring-a-an","title":"Automatic Features for Essay Scoring -- An Empirical Study","date":"2016-11-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"constrained-multi-task-learning-for-automated","title":"Constrained Multi-Task Learning for Automated Essay Scoring","date":"2016-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":"/paper/flexible-domain-adaptation-for-automated","slug":"flexible-domain-adaptation-for-automated","title":"Flexible Domain Adaptation for Automated Essay Scoring Using Correlated Linear Regression","date":"2015-09-01","arxiv_id":null,"repositories_listed":0,"syntology":null}],"syntology_records":1,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_where_code_ran":1,"papers_where_code_ran_first_page":"/task/automated-essay-scoring/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":2,"url":"/task/automated-essay-scoring/papers/2","json":"/task/automated-essay-scoring/papers/2.json","rows":4},{"order":"ran","page":1,"of":1,"url":"/task/automated-essay-scoring/papers/ran/1","json":"/task/automated-essay-scoring/papers/ran/1.json","rows":1}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"7a2c0c800a27af09d6fc9d4699b83ebf20e843f47aa9e8886e181ed1789274cc","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}