Gemma or Phi: small models for modest hardware

Both lines are built for a single machine, both are in Ollama and neither needs a GPU. Gemma goes down to 270M and covers mobile devices, with CodeGemma for code and FunctionGemma 270M for function calling, but its licensing splits by version: Gemma 4 and DiffusionGemma are Apache 2.0, while earlier releases, CodeGemma and FunctionGemma fall under the Gemma Terms of Use. Phi is MIT throughout and the catalog lists it as supporting Russian, which Gemma does not claim. Phi also has vision and speech versions and reaches 42B-A6.6B, while Gemma was updated more recently, June 2026 against January 2026.

Comparison based on catalog data

ParameterGemmaPhi
CategoryText, Image + text, CodeText, Image + text
DeveloperGoogle, USAMicrosoft, USA
ReleasesFeb 2024 – Jun 2026Sep 2023 – Jan 2026
Sizes270M – 31B1.3B – 42B-A6.6B
HardwareLaptop, 1 GPULaptop, 1 GPU
Commercial useCommercial use allowedCommercial use allowed
LicenseGemma 4 and DiffusionGemma: Apache 2.0; earlier versions, CodeGemma and FunctionGemma: Gemma Terms of UseMIT
RussianNot statedSupported
OllamaYesYes
Without GPUYesYes
Tasks
  • Offline assistant on a laptop
  • Reading photos of documents and receipts
  • Customer request classification
  • Assistant on a laptop or your own server
  • Reasoning and calculation tasks
  • Analysis of images and diagrams (vision versions)
  • Classification and data extraction

Choose Gemma if

  • You need something truly tiny: Gemma starts at 270M
  • The model goes on a phone, a mini PC or other low-end hardware
  • You need to read photos of documents and receipts
Gemma

Choose Phi if

  • You want MIT across every version with no terms to parse
  • Your assistant must work in Russian, which the catalog lists for Phi
  • Your tasks involve reasoning and calculation, education or analytics
Phi

Other comparisons

Need a model for your task?

An open model can run on your own server: data stays in-house, there is no per-request fee, and the model can be fine-tuned on your documents.

  1. SelectThe model and size for your task and hardware budget
  2. DeployOn your server or in a closed network, with an API
  3. Fine-tuneOn your data, or connect a knowledge base
  4. IntegrateInto your CRM, ERP, bot, website or team chat
Discuss deployment