{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/in-the-search-for-optimal-multi-view-learning","title":"In the Search for Optimal Multi-view Learning Models for Crop Classification with Global Remote Sensing Data","arxiv_id":"2403.16582","date":"2024-03-25","proceeding":null,"authors":["Francisco Mena","Diego Arenas","Andreas Dengel"],"abstract":"Studying and analyzing cropland is a difficult task due to its dynamic and heterogeneous growth behavior. Usually, diverse data sources can be collected for its estimation. Although deep learning models have proven to excel in the crop classification task, they face substantial challenges when dealing with multiple inputs, named Multi-View Learning (MVL). The methods used in the MVL scenario can be structured based on the encoder architecture, the fusion strategy, and the optimization technique. The literature has primarily focused on using specific encoder architectures for local regions, lacking a deeper exploration of other components in the MVL methodology. In contrast, we investigate the simultaneous selection of the fusion strategy and encoder architecture, assessing global-scale cropland and crop-type classifications. We use a range of five fusion strategies (Input, Feature, Decision, Ensemble, Hybrid) and five temporal encoders (LSTM, GRU, TempCNN, TAE, L-TAE) as possible configurations in the MVL method. We use the CropHarvest dataset for validation, which provides optical, radar, weather time series, and topographic information as input data. We found that in scenarios with a limited number of labeled samples, a unique configuration is insufficient for all the cases. Instead, a specialized combination should be meticulously sought, including an encoder and fusion strategy. To streamline this search process, we suggest identifying the optimal encoder architecture tailored for a particular fusion strategy, and then determining the most suitable fusion strategy for the classification task. We provide a methodological framework for researchers exploring crop classification through an MVL methodology.","url_abs":"https://arxiv.org/abs/2403.16582v2","url_pdf":"https://arxiv.org/pdf/2403.16582v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"in-the-search-for-optimal-multi-view-learning","repo_url":"https://github.com/fmenat/optimal-multiview-crop-classifier","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"crop-classification","task_name":"Crop Classification"},{"task_slug":"multi-view-learning","task_name":"MULTI-VIEW LEARNING"},{"task_slug":"multimodal-deep-learning","task_name":"Multimodal Deep Learning"},{"task_slug":"sensor-fusion","task_name":"Sensor Fusion"},{"task_slug":"time-series-1","task_name":"Time Series"}],"methods":[{"method_slug":"gru","method_name":"GRU"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/crop-classification-on-cropharvest-brazil","task":"Crop Classification","dataset":"CropHarvest - Brazil","model":"Feature fusion with LSTM","rank_in_archive_order":1,"of":3,"metrics":{"Average Accuracy":"0.975","F1 Macro":"0.979"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-brazil","task":"Crop Classification","dataset":"CropHarvest - Brazil","model":"Hybrid fusion with LSTM","rank_in_archive_order":2,"of":3,"metrics":{"Average Accuracy":"0.974","F1 Macro":"0.978"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-kenya","task":"Crop Classification","dataset":"CropHarvest - Kenya","model":"Radar TS with TempCNN","rank_in_archive_order":4,"of":5,"metrics":{"Average Accuracy":"0.676","F1 Macro":"0.684"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-kenya","task":"Crop Classification","dataset":"CropHarvest - Kenya","model":"Input Fusion with TAE","rank_in_archive_order":5,"of":5,"metrics":{"Average Accuracy":"0.673","F1 Macro":"0.672"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-togo","task":"Crop Classification","dataset":"CropHarvest - Togo","model":"Ensemble aggregation with GRU","rank_in_archive_order":1,"of":4,"metrics":{"Average Accuracy":"0.842","F1 Macro":"0.820"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-togo","task":"Crop Classification","dataset":"CropHarvest - Togo","model":"Decision fusion with GRU","rank_in_archive_order":3,"of":4,"metrics":{"Average Accuracy":"0.825","F1 Macro":"0.7952"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"fmenat/optimal-multiview-crop-classifier","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"9c68016c9d850ff02ca90f8f79f723641589888c1b0684e75dc2b2acfdd8a8ad","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}