Florence-2 or Grounding DINO: which to choose for object detection

Florence-2 from Microsoft is a very small MIT-licensed model that produces captions, object detection, segmentation and text reading from a single prompt; it runs on a CPU and works well as a general labelling tool. Grounding DINO from IDEA Research is built for one thing: finding an object in an image from a text description such as a person without a hard hat, with no training on your own data. The licensing difference matters: Florence-2 is plain MIT, while Grounding DINO's commercial use comes with conditions — Grounding DINO itself is Apache 2.0, but the newer Rex-Omni generation uses IDEA's own license based on the Qwen Research License, which you need to read before production.

Comparison based on catalog data

ParameterFlorence-2Grounding DINO / Rex-Omni
CategoryImage + text, Computer visionComputer vision
DeveloperMicrosoft, USAIDEA Research, China
ReleasesJun 2024 – Jun 2024Mar 2023 – Oct 2025
Sizes0.23B – 0.77B172M – 3B
HardwareLaptopLaptop, 1 GPU
Commercial useCommercial use allowedCommercial use with conditions
LicenseMITGrounding DINO: Apache 2.0; Rex-Omni: own IDEA License based on the Qwen Research License
RussianNot supportedNot applicable
OllamaNoNo
Without GPUYesYes
Tasks
  • Reading text in photos
  • Finding and highlighting objects
  • Automatic photo captions
  • Labelling data for training
  • Finding objects by description without labeling
  • Automatic data labeling for training
  • Checking photos against requirements

Choose Florence-2 if

  • You want one tool covering captions, segmentation and text reading at once
  • You want plain MIT licensing with no commercial conditions
  • You have to run on a CPU, starting from 0.23B
Florence-2

Choose Grounding DINO / Rex-Omni if

  • You need to find objects from an arbitrary text description with no labeling
  • Your task is automatic data labeling to train your own model
  • You check photos against requirements: video analytics, retail, security
Grounding DINO / Rex-Omni

Other comparisons

Need a model for your task?

An open model can run on your own server: data stays in-house, there is no per-request fee, and the model can be fine-tuned on your documents.

  1. SelectThe model and size for your task and hardware budget
  2. DeployOn your server or in a closed network, with an API
  3. Fine-tuneOn your data, or connect a knowledge base
  4. IntegrateInto your CRM, ERP, bot, website or team chat
Discuss deployment