How Much Does Azure OpenAI Cost?
Token pricing. PTU reservations. The Batch API 50% discount. Fine-tuning hosting fees. Hidden costs that add 15–40% to your bill. Real-world scenarios from a side project to enterprise scale. Everything you need to budget Azure OpenAI accurately — not just what the pricing page shows.
How Azure OpenAI Pricing Works
Azure OpenAI pricing has three distinct layers — and teams that only budget for the first layer routinely see their actual bills land 15–40% higher than expected. Understanding all three layers before committing to an architecture is the single most important thing you can do to avoid cost surprises.
Layer 1: Token costs. The foundation. You pay per million tokens processed — separately for input (your prompts and context) and output (the model's responses). A token is roughly 4 characters or ¾ of a word in English. Output tokens are priced 3–8× higher than input tokens on most models. These are the rates that appear on the Azure pricing page and that most architecture discussions focus on.
Layer 2: Deployment model. Before you send a single token, you choose how to deploy. Standard (pay-as-you-go) bills pure consumption with no commitment. Provisioned Throughput Units (PTUs) bill reserved capacity hourly regardless of usage — a fundamentally different cost structure that only makes sense above a volume threshold. The Batch API gives a 50% discount in exchange for a 24-hour turnaround. Getting this choice wrong can mean either paying double what you need to (PTU on a low-volume workload) or paying 50% more than necessary (not using PTUs on a high-volume steady workload).
Layer 3: Infrastructure overhead. Azure support plans for production (from $100/month for Standard), outbound data transfer fees after the first 100GB/month, fine-tuned model hosting fees ($1.70–$3.00/hour whether the model is idle or busy), Azure Monitor log analytics, and private endpoint costs. These are not on the Azure OpenAI pricing page. They are on the pages for other Azure services. This is why teams that budget only for tokens consistently see real bills 15–40% higher.
Token Prices by Model — Full Table (2026)
All prices below are per million tokens (M tokens) for Global Standard pay-as-you-go deployment — the most common starting configuration. Regional Standard deployments run 5–10% higher. Cached input tokens (automatically applied for repeated prompt prefixes) receive a 50–90% discount. Prices are current as of July 2026 — always verify against the Azure pricing page before committing to an architecture.
| Model | Input $/M tokens | Cached Input $/M | Output $/M tokens | Context | Tier |
|---|---|---|---|---|---|
| GPT-5 Family — Frontier reasoning models | |||||
| GPT-5 | $1.25 | $0.13 | $10.00 | Large | Flagship |
| GPT-5-mini | $0.40 | $0.04 | $1.60 | Large | Mid |
| GPT-5-nano ✓ Cheapest | $0.05 | $0.005 | $0.40 | Large | Nano |
| GPT-4.1 Family — 1M token context, general purpose | |||||
| GPT-4.1 | $2.00 | $0.50 | $8.00 | 1M tokens | Flagship |
| GPT-4.1-mini | $0.40 | $0.10 | $1.60 | 1M tokens | Mid |
| GPT-4.1-nano | $0.10 | $0.025 | $0.40 | 1M tokens | Nano |
| o-Series Reasoning Models — Chain-of-thought processing | |||||
| gpt-5.1 (reasoning) | $1.25 | $0.31 | $10.00 | Large | Reasoning |
| o4-mini | $1.10 | $0.28 | $4.40 | 200K | Reasoning |
| o3 | $10.00 | $2.50 | $40.00 | 200K | Premium |
| GPT-4o Family — Legacy, widely deployed | |||||
| GPT-4o | $2.50 | $1.25 | $10.00 | 128K | Legacy |
| GPT-4o-mini | $0.15 | $0.075 | $0.60 | 128K | Legacy |
| Embeddings — Much cheaper than chat models | |||||
| text-embedding-3-small | $0.02 | — | — | 8K | Embed |
| text-embedding-3-large | $0.13 | — | — | 8K | Embed |
| Image Generation | |||||
| GPT-image-1.5 / DALL-E 3 | $0.040–$0.080 per image (Standard HD); $0.080–$0.120 per image (HD). Price varies by resolution and quality setting. | Per image | |||
Deployment Types and How They Affect Cost
Before you choose a model, you choose a deployment type. The same model has meaningfully different costs depending on this choice — and the right choice depends on your volume, consistency of traffic, and latency requirements.
| Deployment Type | Billing Model | Cost vs Standard PAYG | When to Use |
|---|---|---|---|
| Standard (Regional PAYG) | Per token | +5–10% vs Global | Need data residency in a specific region. Accept slightly higher cost and lower throughput ceiling. |
| Global Standard PAYG | Per token | Baseline — lowest per-token rate | Best starting point for most workloads. Traffic routes globally for best availability. No data residency constraints. |
| Data Zone Standard | Per token | +5% vs Global | EU data residency required but want higher throughput than single-region. Traffic stays within EU zone. |
| Batch API | Per token (50% off) | 50% cheaper than Standard | Non-real-time workloads. 24-hour turnaround. Bulk document processing, analytics, classification at scale. |
| Provisioned (PTU) | Hourly per PTU unit | Break-even at ~150–500M tokens/month | High-volume steady workloads needing predictable latency and cost. Monthly ($2,448+) or annual reservation. |
Provisioned Throughput Units (PTUs) Explained
PTUs flip the Azure OpenAI pricing model from consumption-based to reservation-based. Instead of paying per token, you purchase a unit of dedicated model processing capacity and pay for it by the hour — whether you use it or not. In exchange, you get predictable low latency, guaranteed throughput headroom, protection from rate limits, and a 99% latency SLA on token generation.
PTUs make financial sense only when your workload crosses a utilization threshold. The rule of thumb: PTUs break even vs pay-as-you-go at roughly 150–500 million tokens per month of consistent traffic (the exact break-even point varies by model). Below that, pay-as-you-go is cheaper. Above that, PTUs are typically 40–70% cheaper per effective token on sustained workloads.
Batch API — 50% Off for Non-Urgent Workloads
The Azure OpenAI Batch API provides a flat 50% discount on all token costs in exchange for a 24-hour turnaround time. If your workload does not require a real-time response — bulk document summarization, overnight data classification, large-scale data extraction, embedding generation for a corpus — the Batch API is the single most impactful cost reduction available without any quality trade-off.
Batch runs on a separate quota from Standard deployments, so using it does not consume your Standard throughput quota. The workflow: submit a JSONL file of requests, Azure processes them asynchronously (within 24 hours), and you retrieve the completed results. The model is identical to the Standard deployment — you are not getting a different or reduced model, just a different processing priority.
Hidden Costs — The 15–40% You Did Not Budget For
Production Azure OpenAI bills reliably run 15–40% higher than the sum of token costs alone. These are the specific line items responsible:
| Cost Item | Pricing | Typical Monthly Impact | Notes |
|---|---|---|---|
| Azure Support Plan | Basic: free (no SLA) Standard: $100/month Professional Direct: $1,000+/month | $100–$1,000+ | Basic gives only self-service docs. Standard is effectively mandatory for production — gives <8hr critical response SLA. Not on OpenAI direct API. |
| Data Egress | First 100GB/month: free $0.087/GB after that | $0–$200+ | Outbound data from Azure. High-volume applications with large responses or inter-region calls hit this fast. Cross-cloud egress (to AWS, GCP) is the expensive path. |
| Fine-Tuned Model Hosting | $1.70–$3.00/hour regardless of traffic | $40–$70/day per deployment | The most common surprise cost. A deployed fine-tuned model bills hourly whether idle or busy. A GPT-4o fine-tune runs ~$50–$70/day just to exist. Delete unused fine-tunes monthly. |
| Azure Monitor / Log Analytics | $2.30/GB data ingested after 5GB free | $20–$100+ | Diagnostic logs, metrics, request tracing. Verbose logging of token counts and request details adds up. Sample 5–10% of logs in production rather than ingesting everything. |
| Private Endpoints | $0.01/hour per endpoint (~$7.20/month) + $0.01/GB processed | $10–$30 | Required for VNET-isolated deployments. Small fixed cost but worth budgeting for production architectures with private networking. |
| Failed Requests | Input tokens still billed on 500-level errors | Varies — 5–20% of input token cost | Aggressive retry policies can double input token costs without delivering additional successful responses. Back off exponentially. Monitor error rates and retry counts. |
| File Search Storage | First 1GB free, then $0.10/GB/day | $0–$50 | Vector store files for Assistants API. Accumulates if you do not clean up indexed documents after use. |
Fine-Tuning Costs
Fine-tuning pricing has two separate and very different components that are easy to confuse — and the hosting component is the one that causes budget surprises.
- Training cost — a one-time fee paid when you run the fine-tuning job. Charged per-token on the training dataset. GPT-4o fine-tuning training costs approximately $25/million tokens of training data. A typical fine-tuning dataset of 1,000 examples with ~1,500 tokens each is 1.5M tokens total — training cost ≈ $37.50. A one-off expense.
- Hosting cost — an ongoing hourly fee for keeping the fine-tuned model deployed as a serving endpoint. GPT-4o fine-tune hosting runs approximately $1.70–$3.00/hour = $40–$72/day, regardless of whether any requests are received. This is permanent until you explicitly delete the deployment. Inference on the fine-tuned model is billed at the same per-token rate as the base model.
The hosting cost is the critical budget item — a fine-tuned GPT-4o deployment that receives zero traffic still costs ~$1,500–$2,200/month just to exist. Audit fine-tuned deployments monthly and delete any that are not actively receiving traffic.
Real-World Cost Scenarios
These scenarios model realistic monthly costs for different team profiles. All figures include estimated infrastructure overhead. Token prices use July 2026 Global Standard PAYG rates.
Six Ways to Cut Your Azure OpenAI Bill
Right-size your model — this is the highest-leverage decision in your stack
The price gap between GPT-5-nano ($0.05/M) and o3 ($10.00/M) is 200×. Many tasks that developers default to flagship models for — classification, extraction, simple summarisation, FAQ answering — produce equivalent quality on GPT-5-nano or GPT-4.1-mini at a fraction of the cost. Benchmark your actual use case on cheaper models first. Upgrade the model only if quality degrades meaningfully. "Reserve GPT-5 for genuinely hard work" is the single sentence that can cut most enterprise AI bills in half.
Route all non-real-time work through the Batch API
Any workload that does not need a response within seconds belongs in the Batch API: nightly summaries, corpus re-embedding, bulk classification, data extraction pipelines, report generation. A flat 50% discount on all token costs, no quality trade-off, no model change. If your application has both real-time user interactions and offline processing jobs, deploying two endpoints — Standard for user-facing, Batch for background processing — is a standard architecture that halves the cost of the background tier.
Enable prompt caching and engineer for cache hits
Azure OpenAI automatically caches prompt prefixes and charges a 50–90% discount on cached input tokens. The cache is most effective when your system prompt (which is typically the longest part of your input) is identical across requests. Design your prompts with the stable system prompt first and the variable user content last. Normalise prompts (consistent field ordering, whitespace, phrasing) so that seemingly different requests produce the same cache key. Monitor your cache hit rate — a low rate is a signal that prompt variability is costing you money without improving response quality.
Migrate to PTUs only after 30–60 days of PAYG telemetry
PTUs reduce per-effective-token cost significantly at volume — but only if your workload sustains high utilisation. Over-committed PTUs on a variable workload result in paying for idle capacity. The right approach: run pay-as-you-go for 30–60 days, collect your P95 hourly token throughput, and model the PTU option against that real data. Configure Spillover to absorb traffic spikes, and use an annual reservation only for your stable baseline load — top up with PAYG for peaks.
Delete zombie fine-tuned model deployments monthly
A fine-tuned model deployment bills $1.70–$3.00/hour whether it receives zero requests or one million. Every quarter, teams accumulate fine-tuned model deployments that were created for experiments, demos, or seasonal features and then forgotten. A single idle GPT-4o fine-tune runs $40–$70/day = up to $2,200/month. Audit your Azure AI Foundry resource monthly and delete any fine-tuned deployment that has not received traffic in the past 30 days. You can always re-deploy from the saved model weights if needed.
Cap output tokens and control context window growth
Output tokens are 3–8× more expensive than input tokens on most models. An uncapped max_tokens setting on a verbose use case — or a multi-turn conversation that grows to 40,000 tokens of context — can produce bills 10–30× higher than expected. Set explicit max_tokens limits appropriate to the use case (most FAQ answers need less than 500 tokens). For multi-turn conversations, implement context pruning to drop older turns when the conversation exceeds a threshold. For long-document processing, chunk documents rather than passing entire documents in a single prompt — smaller, parallel requests are cheaper and more predictable than one enormous context window call.
Azure OpenAI vs OpenAI Direct — Which Costs Less?
The per-token rates are identical. The total cost of ownership is not.
- Token prices: Identical for the same models. $2.00/M input on GPT-4.1 costs the same whether you call Azure OpenAI or OpenAI's API directly.
- Azure OpenAI total cost is 15–40% higher in practice due to: support plan ($100–$1,000+/month) required for production SLA; data egress fees; Azure Monitor log costs; networking infrastructure. OpenAI's direct API has none of these because it provides no enterprise infrastructure, private networking, or compliance tooling.
- OpenAI direct is cheaper for: startups without compliance requirements, individual developers, rapid prototyping, workloads with no data residency needs. Simplest path to the models.
- Azure OpenAI is worth the premium for: any organisation that needs SOC 2, HIPAA, FedRAMP, GDPR data residency, VNET isolation, Microsoft Entra ID authentication, or integration with other Azure services. The compliance and security infrastructure you are paying for is real and does not exist on OpenAI direct.
Key Takeaways
Related FAVRITE Articles
- What Is Azure OpenAI and How Does It Work? Complete Guide (2026)
- Azure vs AWS: Which Is Better? Complete Comparison Guide (2026)
- How to Fix Databricks Claude PERMISSION_DENIED Rate Limit of 0
- Top 50 Azure Cloud Administrator Interview Questions and Answers