{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/florence","slug":"florence","name":"Florence","full_name":"Florence","full_name_withheld":false,"description_markdown":"Florence is a computer vision foundation model aiming to learn universal visual-language representations that be adapted to various computer vision tasks, visual question answering, image captioning, video retrieval, among other tasks. Florence's workflow consists of data curation, unified learning, Transformer architectures and adaption. Florence is pre-trained in an image-label-description space, utilizing a unified image-text contrastive learning. It involves a two-tower architecture: 12-layer Transformer for the language encoder, and a Vision Transformer for the image encoder. Two linear projection layers are added on top of the image encoder and language encoder to match the dimensions of image and language features. Compared to previous methods for cross-modal shared representations, Florence expands beyond simple classification and retrieval capabilities to advanced representations that support object level, multiple modality, and videos respectively.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Florence: A New Foundation Model for Computer Vision","paper":"/paper/florence-a-new-foundation-model-for-computer","first_author":"Lu Yuan","n_authors":23,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/florence-a-new-foundation-model-for-computer"},"source":{"url":"https://arxiv.org/abs/2111.11432v1","title":"Florence: A New Foundation Model for Computer Vision","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Computer Vision","area_id":"computer-vision","collection":"Vision and Language Pre-Trained Models","url":"/methods/category/vision-and-language-pre-trained-models","pwc_aliases":[]}],"n_papers_tagged":12,"archive_num_papers":12,"papers_newest_first":[{"paper":null,"slug":"fred-the-florence-rgb-event-drone-dataset","title":"FRED: The Florence RGB-Event Drone Dataset","date":"2025-06-05","arxiv_id":"2506.05163","n_code_links":0,"syntology":null},{"paper":"/paper/psocr-benchmarking-large-multimodal-models","slug":"psocr-benchmarking-large-multimodal-models","title":"PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language","date":"2025-05-15","arxiv_id":"2505.10055","n_code_links":1,"syntology":null},{"paper":null,"slug":"quantifying-walkable-accessibility-to-urban","title":"Quantifying walkable accessibility to urban services: An application to Florence, Italy","date":"2025-04-17","arxiv_id":"2504.12934","n_code_links":0,"syntology":null},{"paper":null,"slug":"fine-tuning-florence2-for-enhanced-object","title":"Fine-Tuning Florence2 for Enhanced Object Detection in Un-constructed Environments: Vision-Language Model Approach","date":"2025-03-06","arxiv_id":"2503.04918","n_code_links":0,"syntology":null},{"paper":"/paper/texlidar-automated-text-understanding-for","slug":"texlidar-automated-text-understanding-for","title":"TexLiDAR: Automated Text Understanding for Panoramic LiDAR Data","date":"2025-02-05","arxiv_id":"2502.04385","n_code_links":1,"syntology":null},{"paper":null,"slug":"learning-nonverbal-cues-in-multiparty-social","title":"Learning Nonverbal Cues in Multiparty Social Interactions for Robotic Facilitators","date":"2025-01-18","arxiv_id":"2501.10857","n_code_links":0,"syntology":null},{"paper":null,"slug":"smart-city-digital-twin-framework-for-real","title":"Smart City Digital Twin Framework for Real-Time Multi-Data Integration and Wide Public Distribution","date":"2023-09-23","arxiv_id":"2309.13394","n_code_links":0,"syntology":null},{"paper":"/paper/asm-adaptive-skinning-model-for-high-quality","slug":"asm-adaptive-skinning-model-for-high-quality","title":"ASM: Adaptive Skinning Model for High-Quality 3D Face Modeling","date":"2023-04-19","arxiv_id":"2304.09423","n_code_links":0,"syntology":null},{"paper":null,"slug":"dime-fm-distilling-multimodal-and-efficient","title":"DIME-FM: DIstilling Multimodal and Efficient Foundation Models","date":"2023-03-31","arxiv_id":"2303.18232","n_code_links":0,"syntology":null},{"paper":null,"slug":"dime-fm-distilling-multimodal-and-efficient-1","title":"DIME-FM : DIstilling Multimodal and Efficient Foundation Models","date":"2023-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/the-florence-4d-facial-expression-dataset","slug":"the-florence-4d-facial-expression-dataset","title":"The Florence 4D Facial Expression Dataset","date":"2022-10-30","arxiv_id":"2210.16807","n_code_links":0,"syntology":null},{"paper":"/paper/florence-a-new-foundation-model-for-computer","slug":"florence-a-new-foundation-model-for-computer","title":"Florence: A New Foundation Model for Computer Vision","date":"2021-11-22","arxiv_id":"2111.11432","n_code_links":2,"syntology":null}],"papers_shown":12,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":12,"with_a_code_link":3,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":12,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[],"tasks":[{"task":"/task/image-classification","name":"Image Classification","papers":3},{"task":"/task/object-detection","name":"Object Detection","papers":3},{"task":"/task/object-detection-1","name":"object-detection","papers":3},{"task":"/task/benchmarking","name":"Benchmarking","papers":2},{"task":"/task/image-classification","name":"image-classification","papers":2},{"task":"/task/3d-face-reconstruction","name":"3D Face Reconstruction","papers":1},{"task":"/task/action-classification","name":"Action Classification","papers":1},{"task":"/task/action-recognition-in-videos","name":"Action Recognition","papers":1},{"task":"/task/action-recognition-in-videos-2","name":"Action Recognition In Videos","papers":1},{"task":"/task/cross-modal-retrieval","name":"Cross-Modal Retrieval","papers":1},{"task":"/task/data-integration","name":"Data Integration","papers":1},{"task":"/task/face-alignment","name":"Face Alignment","papers":1},{"task":"/task/face-model","name":"Face Model","papers":1},{"task":"/task/face-reconstruction","name":"Face Reconstruction","papers":1},{"task":null,"name":"GPU","papers":1},{"task":"/task/image-captioning","name":"Image Captioning","papers":1},{"task":"/task/language-modeling","name":"Language Modeling","papers":1},{"task":"/task/language-modelling","name":"Language Modelling","papers":1},{"task":"/task/object","name":"Object","papers":1},{"task":"/task/optical-character-recognition","name":"Optical Character Recognition","papers":1}],"tasks_shown":20,"n_tasks":36,"usage_by_year":[{"year":"2021","papers":1},{"year":"2022","papers":1},{"year":"2023","papers":4},{"year":"2025","papers":6}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/florence"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Florence","read_at":"2026-10-05T00:56:05+00:00","query":"Florence","kind":"paper","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"arxiv_id":"2111.11432"},"resolution":"paper","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"same_paper","archive_paper_arxiv_id":"2111.11432","repositories":{"listed":2,"in_graph":2,"list_truncated":false,"strongest_link":"mentioned_in_github"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2111.11432","citations":1153},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'Florence'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2111.11432","page":"/paper/florence-a-new-foundation-model-for-computer","syntology_url":"https://syntology.ai/paper/2111.11432","in_graph_layer":false,"samples":0},"line":"repository known, no verified implementation (declared_code; repositories: 2 listed of 2 in the graph, strongest link: mentioned on GitHub). The lookup matched a paper by its title, arXiv:2111.11432, not a method entry. This answer is about arXiv:2111.11432, the paper the archive credits with this method.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"10a5248b9c19f96463c4c30a8b2f4a244eab2daf6b3af28b357a0d5db7da159c","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}