Browse State-of-the-Art › Feature Engineering
Feature Engineering
472 papers with code · 1 benchmark · 5 datasets archive 2025-07-28
Feature engineering is the process of taking a dataset and constructing explanatory variables — features — that can be used to train a machine learning model for a prediction problem. Often, data is spread across multiple tables and must be gathered into a single table with rows containing the observations and features in the columns.
The traditional approach to feature engineering is to build features one at a time using domain knowledge, a tedious, time-consuming, and error-prone process known as manual feature engineering. The code for manual feature engineering is problem-dependent and must be re-written for each new dataset.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| 2019_test set (1 row) | CNN | See and Read: Detecting Depression Symptoms in Higher Education... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
5 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 1,706 · with a code link: 472 · where Syntology ran a sample: 60 (51 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (60 of 1,706 tagged: 51 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument)
Page 1 of 18: papers 1 to 100 of 1,706, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
17 Nov 2017 44 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)Accurate detection of objects in 3D point clouds is a central problem in many applications, such as autonomous navigation, housekeeping robots, and augmented/virtual reality.
-
24 Jun 2016 39 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)Memorization of feature interactions through a wide set of cross-product feature transformations are effective and interpretable, while generalization requires more feature engineering effort.
-
4 Mar 2016 25 repositories listed Syntology 24 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 2 honoured, 0 violated, 20 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 24 harvested samples) · 3 pointer-only (licence)State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing.
-
13 Mar 2017 23 repositories listed Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 2 pointer-only (licence)Learning sophisticated feature interactions behind user behaviors is critical in maximizing CTR for recommender systems.
-
17 Aug 2017 16 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Feature engineering has been the key to the success of many prediction models.
-
26 Nov 2015 14 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 4 pointer-only (licence)Named entity recognition is a challenging task that has traditionally required large amounts of knowledge in the form of feature engineering and lexicons to achieve high performance.
-
1 Jul 2018 10 repositories listedUser response prediction is a crucial component for personalized information retrieval and filtering scenarios, such as recommender system and web search.
-
12 Apr 2018 8 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)In this paper, we study two instances of DeepFM where its "deep" component is DNN and PNN respectively, for which we denote as DeepFM-D and DeepFM-P.
-
20 Apr 2020 7 repositories listed Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples) · 3 pointer-only (licence)The extraction of labels from radiology text reports enables large-scale training of medical imaging models.
-
11 May 2019 6 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)Here we propose Knowledge-aware Graph Neural Networks with Label Smoothness regularization (KGNN-LS) to provide better recommendations.
-
9 Feb 2024 5 repositories listedMachine-learning from a disparate set of tables, a data lake, requires assembling features by merging and aggregating tables.
-
12 Apr 2019 5 repositories listedIn this work, we adopt a feature-engineering based approach to tackle the task of speech emotion recognition.
-
3 Jun 2019 4 repositories listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)In this work we propose a method for discovering neural wirings.
-
18 May 2019 4 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)Tree ensembles, such as random forests and AdaBoost, are ubiquitous machine learning models known for achieving strong predictive performance across a wide variety of domains.
-
28 Feb 2019 4 repositories listedComplex black-box predictive models may have high accuracy, but opacity causes problems like lack of trust, lack of stability, sensitivity to concept drift.
-
13 Nov 2018 4 repositories listedDue to this nature, the multi-label text classification task is often considered to be more challenging compared to the binary or multi-class text classification problems.
-
28 Aug 2018 4 repositories listedIn recent years, the natural language processing community has moved away from task-specific feature engineering, i. e., researchers discovering ad-hoc feature representations for various tasks, in favor of…
-
6 Dec 2017 4 repositories listedChemical databases store information in text representations, and the SMILES format is a universal standard used in many cheminformatics software.
-
9 Aug 2017 4 repositories listedWe propose the Neural Vector Space Model (NVSM), a method that learns representations of documents in an unsupervised manner for news article retrieval.
-
18 Mar 2017 4 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)Recent papers have shown that neural networks obtain state-of-the-art performance on several different sequence tagging tasks.
-
2 Jun 2016 4 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We introduce DeepSurv, a Cox proportional hazards deep neural network and state-of-the-art survival method for modeling interactions between a patient's covariates and treatment effectiveness in order to provide…
-
1 Mar 2016 4 repositories listedWe explore how inverse optimal control (IOC) can be used to learn behaviors from demonstrations, with applications to torque control of high-dimensional robotic systems.
-
29 Jul 2024 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)We use RelBench to conduct the first comprehensive study of Relational Deep Learning (RDL) (Fey et al., 2024), which combines graph neural network predictive models with (deep) tabular models that extract initial…
-
18 Mar 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Reverse sampling and score-distillation have emerged as main workhorses in recent years for image manipulation using latent diffusion models (LDMs).
-
19 Jul 2021 3 repositories listed Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)End-to-end AutoML has attracted intensive interests from both academia and industry, which automatically searches for ML pipelines in a space induced by feature engineering, algorithm/model selection, and…
-
14 Dec 2020 3 repositories listedWhile the open-source software development model has led to successful large-scale collaborations in building software systems, data science projects are frequently developed by individuals or small teams.
-
14 Oct 2020 3 repositories listedTime series forecasting is a challenging task with applications in a wide range of domains.
-
1 Oct 2020 3 repositories listedAn estimated 180 papers focusing on deep learning and EHR were published between 2010 and 2018.
-
22 May 2020 3 repositories listed Syntology 12 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 17 harvested samples)The deluge of digital information in our daily life -- from user-generated content, such as microblogs and scientific papers, to online business, such as viral marketing and advertising -- offers unprecedented…
-
3 Dec 2019 3 repositories listedHowever, nowadays, the data shared at social media is a ubiquitous source that can be used to detect the depression symptoms even when the student is not able to afford or search for professional care.
-
9 Oct 2018 3 repositories listed
-
1 Aug 2018 3 repositories listed
-
24 Apr 2018 3 repositories listed
-
23 Apr 2018 3 repositories listed
-
9 Feb 2018 3 repositories listed
-
1 Sep 2017 3 repositories listed
-
20 Jun 2017 3 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
18 Apr 2017 3 repositories listed
-
4 Jul 2016 3 repositories listed
-
4 Mar 2025 2 repositories listed
-
21 Jan 2025 2 repositories listed
-
27 Jun 2024 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples)
-
19 Sep 2023 2 repositories listed
-
27 Aug 2023 2 repositories listed
-
3 Aug 2023 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
1 Aug 2023 2 repositories listed
-
5 May 2023 2 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
11 Apr 2023 2 repositories listed
-
30 Aug 2022 2 repositories listed
-
20 Jul 2022 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
1 Jun 2022 2 repositories listed
-
27 Jan 2022 2 repositories listed
-
28 Nov 2021 2 repositories listed
-
10 Oct 2021 2 repositories listed
-
17 Aug 2021 2 repositories listed
-
19 May 2021 2 repositories listed
-
11 Apr 2021 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)
-
21 Jan 2021 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
7 Jan 2021 2 repositories listed
-
23 Dec 2020 2 repositories listed
-
16 Dec 2020 2 repositories listed
-
16 Dec 2020 2 repositories listed
-
1 Dec 2020 2 repositories listed
-
28 Oct 2020 2 repositories listed
-
12 Oct 2020 2 repositories listed
-
30 Jul 2020 2 repositories listed
-
7 Mar 2020 2 repositories listed
-
26 Sep 2019 2 repositories listed
-
2 Aug 2019 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
29 Jul 2019 2 repositories listed
-
26 Jul 2019 2 repositories listed
-
17 Jul 2019 2 repositories listed
-
12 Jul 2019 2 repositories listed
-
7 May 2019 2 repositories listed
-
16 Apr 2019 2 repositories listed
-
8 Dec 2018 2 repositories listed
-
2 Sep 2018 2 repositories listed
-
26 Aug 2018 2 repositories listed
-
1 Aug 2018 2 repositories listed
-
25 Jul 2018 2 repositories listed
-
19 Jun 2018 2 repositories listed
-
9 Feb 2018 2 repositories listed
-
30 Jan 2018 2 repositories listed
-
11 Dec 2017 2 repositories listed
-
20 Jun 2017 2 repositories listed
-
25 May 2017 2 repositories listed
-
27 Apr 2017 2 repositories listed
-
8 Feb 2017 2 repositories listed
-
5 Dec 2016 2 repositories listed
-
16 Nov 2016 2 repositories listed
-
31 Oct 2016 2 repositories listed
-
16 Sep 2016 2 repositories listed
-
1 Jan 2016 2 repositories listed
-
4 Dec 2014 2 repositories listed
-
9 Jun 2025 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
3 Jun 2025 1 repository listed
-
29 May 2025 1 repository listed
-
29 May 2025 1 repository listed
-
20 May 2025 1 repository listed
Syntology lines on 27 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections