LFM2-2.6B

Highly capable 2.6B parameter model for deployment on most phones and laptops

← Back to Text Models

LFM2-2.6B is a versatile mid-sized model delivering strong performance across chat, reasoning, and tool-calling tasks. Optimized for deployment on consumer devices including phones and laptops.

HFGGUFMLXONNX

Specifications

Property	Value
Parameters	2.6B
Context Length	32K tokens
Architecture	LFM2 (Dense)

On-Device

Runs on phones and laptops

Tool Calling

Native function calling support

Fine-tunable

TRL compatible (SFT, DPO, GRPO)

Quick Start

Transformers

Install:

pip install transformers torch

Download & Run:

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("LiquidAI/LFM2-2.6B", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("LiquidAI/LFM2-2.6B")

input_ids = tokenizer.apply_chat_template(
    [{"role": "user", "content": "What is machine learning?"}],
    add_generation_prompt=True, return_tensors="pt"
).to(model.device)

output = model.generate(input_ids, max_new_tokens=256)
print(tokenizer.decode(output[0], skip_special_tokens=True))

llama.cpp

Install:

brew install llama.cpp
pip install huggingface-hub

Download:

huggingface-cli download LiquidAI/LFM2-2.6B-GGUF \
  lfm2-2.6b-q4_k_m.gguf --local-dir .

Run:

llama-cli -m lfm2-2.6b-q4_k_m.gguf \
  -p "What is machine learning?" -n 256

vLLM

Install:

pip install vllm

Run:

from vllm import LLM, SamplingParams

llm = LLM(model="LiquidAI/LFM2-2.6B")
output = llm.chat("What is machine learning?", SamplingParams(max_tokens=256))
print(output[0].outputs[0].text)