Gross margin is one of the most important metrics for evaluating an AI business, but it is easy to misread. Two companies with similar revenue can have very different economics depending on model API usage, GPU commitments, customer support and how much infrastructure cost is excluded from reported cost of revenue.

Start with revenue that actually belongs in the denominator

Separate recurring software revenue, usage revenue, services and pass-through fees. A blended top line can hide low-margin activity.

Map direct inference cost

Include model API fees, dedicated GPU inference and other compute directly required to serve customers. Training research costs may belong elsewhere, but serving costs should not disappear from the gross-margin calculation.

Include variable supporting services

Vector databases, speech APIs, image generation, storage and content moderation can all scale with usage. If a feature is required to deliver the product, its variable cost matters.

Watch committed capacity

Reserved GPU or cloud contracts can make cost behave partly like fixed infrastructure. Investors should compare committed spend with actual utilization.

Distinguish contribution margin from accounting gross margin

A company may present gross margin using one accounting policy while product teams track a more complete contribution margin. Both can be useful if the definitions are explicit.

Segment by product and customer

Enterprise contracts, consumer subscriptions and API usage can have different cost profiles. Blended margin may hide a product line that is economically weak.

Connect margin to pricing power

If inference costs decline but pricing falls just as quickly, margin may not improve. Our AI startup pricing power guide explains how to assess whether value capture is durable.

Use a cost waterfall

Start with gross revenue, subtract refunds and channel fees where appropriate, then direct model, compute and delivery costs. The resulting picture is more useful than one headline percentage.

Gross margin should improve for the right reasons

Better model routing, caching, batching and pricing can improve economics. Artificially excluding real serving costs cannot.