Skip to content
‹ Back to IndustriesBusiness Services

Legal AI vendors are building their own models to cut inference bills and reduce platform dependence

Legal AI vendors are increasingly developing their own artificial intelligence models to decrease dependence on large, external platforms like OpenAI and Anthropic. Companies such as Harvey’s Tenet and Thomson Reuters are moving towards their own vertically integrated AI stacks. This approach is anticipated to help reduce costs associated with model inference.

This story was produced through MarketScale. See how Business Services teams put it to work with Executive Thought Leadership.

By MarketScale Newsroom · Legal OpsLegal TechnologyGenerative AiLlms
Share
Legal AI vendors are building their own models to cut inference bills and reduce platform dependence

Key takeaways

01

Legal AI vendors are reducing reliance on external AI platforms by developing their own models.

02

In-house AI model development is expected to help vendors lower inference costs.

03

Vertical integration in AI development allows vendors more control over their technology stack.

Free workspace

Turn your Business Services expertise into content.

Record interviews, organize footage, and write with AI on a free trial of the MarketScale platform for qualifying companies. No demo required, no credit card.

Try it Free

Harvey says it has developed a custom model for legal work called Tenet. Thomson Reuters has said it will soon roll out its own model, called Thomson. Both moves point at the same operational reality: legal AI vendors are trying to stop paying frontier-model tolls on every query and start owning more of the stack themselves.

Bloomberg Law reported the Tenet announcement Tuesday and the Thomson Reuters plan from late July, noting both efforts rely on open-source foundation technology that can be downloaded and customized. That’s a marked change from the last two years, when many legal AI products were essentially “model routers” that flipped between OpenAI, Anthropic, and Google depending on the task.

For enterprise legal operations leaders, this isn’t a branding exercise about whose model is “best.” It’s a contract and governance change. If your vendor runs its own model, pricing mechanics, security ownership, and portability questions all move.

The shift is about unit economics and control, not just model quality

The clearest upside for vendors is cost control. Bloomberg Law cited advisers who expect vendors can improve profitability by directing more queries to their own models instead of paying OpenAI or Anthropic for inference. That matters to buyers because vendor margin pressure has a way of showing up later as usage limits, feature gating, or price resets at renewal.

The operational trade is that responsibility shifts. Bloomberg Law reported ZwillGen AI Division director Brenda Leong’s view that when a company runs its own model, it also takes on security and other obligations that were previously pushed down to the frontier lab. Maintenance and updates don’t disappear, they get reassigned.

Legal AI procurement is turning into a stack decision: who pays for inference, who patches the model, and who proves it’s safe to use on sensitive work.

In practice, legal departments should read “custom model” as a signal to scrutinize the vendor’s model lifecycle: red-teaming cadence, evaluation sets for hallucination and citation behavior, and how quickly the vendor can roll fixes without breaking workflows. Those are procurement questions, not demo questions.

OpenAI is moving closer to law firms as vendors try to reduce dependency

While vendors like Harvey and Thomson Reuters work to reduce reliance on frontier labs, Business Insider reported OpenAI is moving in the opposite direction: closer to legal buyers. The company hired Jason Boehmig in June, an executive best known for building Ironclad into a major contract lifecycle management player, according to Business Insider.

That hiring move matters because it suggests OpenAI is building legal-specific distribution and product muscle, not just selling APIs. Business Insider also reported OpenAI has been posting roles tied to legal product development, while declining to outline specifics of what it will build.

Bloomberg Law separately reported OpenAI told the outlet it is collaborating with Willkie Farr & Gallagher to deploy ChatGPT Enterprise to every attorney and integrate OpenAI models deeper into the firm’s internal tools. A firmwide deployment is operationally different from a pilot: it forces decisions on identity, logging, matter segmentation, and acceptable use to be resolved at scale.

A vendor’s ability to switch among models used to be framed as resilience. Now it can also be a moving target. Bloomberg Law described how legal tech companies have routed tasks across models from OpenAI, Anthropic, and Google; the emerging model-building trend suggests that “what powers the product” may change more frequently, and more quietly, than most legal departments have historically governed.

That lands directly in procurement language. If your contract assumes a named subprocessor (for example, a specific frontier lab), and the vendor swaps to an in-house model, the risk profile changes even if the UI stays the same. It’s also a budgeting issue: vendor-hosted models can change cost curves for heavy users, especially for contract review, discovery-adjacent analysis, and large document summarization where token volume is predictable.

Bloomberg Law reported legal tech advisers expect average attorneys may not notice a change unless model quality shifts. That’s a useful reminder for operators: user satisfaction scores might stay flat while the underlying cost, security posture, and auditability changes materially.

If the demo looks identical after a model swap, that’s when governance has to be strongest, because risk can move while workflows don’t.

What to ask your vendors and integrators before the next rollout

  • Model governance: If the vendor runs a proprietary or customized open-source model (as Bloomberg Law reported for Harvey and Thomson Reuters), what is the update cadence, evaluation methodology, and rollback plan when accuracy regresses on your document types?
  • Security and compliance ownership: Which controls are the vendor’s responsibility versus yours now that more of the stack may be vendor-operated, including red-team results, incident notification SLAs, and audit artifacts? Bloomberg Law highlighted that security obligations shift when model maintenance is internal.
  • Commercials and cost predictability: How does pricing map to inference consumption? Ask for concrete assumptions: typical token volumes per contract, per brief, per matter, and what happens when usage spikes.
  • Portability and competitive overlap: With OpenAI pushing into legal distribution (Business Insider) and deploying ChatGPT Enterprise at Willkie (Bloomberg Law), confirm what happens if a platform provider becomes a direct option for your org. Can you export prompts, matter metadata, and clause libraries in usable formats, and are APIs stable across model changes?

Featured companies

Your experts belong here

Every story in MarketScale Business Services starts with a company putting its consultants, practice leads, and account teams on the record. Buyers are already reading this topic. The only question is whose experts they find.

Clients hire the firm whose thinking they have already read, which means fewer cold conversations for your partners.

Book DemoSee how it works15 minutes, straight to a calendar.

About the author

MarketScale Newsroom
MarketScale NewsroomEditorial Team, MarketScale

The MarketScale Newsroom reports on the companies, technologies, and trends shaping 16 B2B industries. It turns primary sources and expert commentary into clear, useful coverage for the people doing the work.

B2B Weekly

The week in Business Services, and sixteen other industries, every Monday.

Ten stories, one-line takes, five minutes. Free.

Business Services: are you visible to AI?

Before they reach out, Business Services buyers ask AI engines which vendors to trust. Explore how your experts, customers, and partners can become useful content for buyers and AI search.

Free Trial

You just read one Business Services expert. Your company is full of them.

This article was produced through MarketScale. The same platform turns your consultants, practice leads, and account teams into the articles, video, and social content Business Services buyers are searching for. Start a free trial and see it with your own people. For qualifying companies, no credit card, no demo required.

NPS +73 · 1,000+ creators · 38+ countries

What your free trial includes

Hands-on access to the MarketScale platform
Media requests to your crowd, remote recording, AI writing tools
No demo required. No credit card.
For qualifying companies. Company confirmation required.

More Business Services Insights

AI-native brokerages bring in nearly $1 million per employee in Zywave report

AI-native brokerages bring in nearly $1 million per employee in Zywave report

A new Zywave study puts AI-native brokerages at close to $1 million in revenue per employee, versus about $175,000 at traditional agencies. Zywave’s data points to the back office as a key source of the gap, even as producer roles grow. It also argues cleaner, automated data can affect carrier bonus commissions, which run from 0.43% to 6.74% of premium on one published schedule.

  • 01When a carrier bonus can swing fifteenfold on loss ratio alone, the data work that trims an agency’s back office can also influence the size of its contingent or bonus check—especially if it helps keep the book in better loss-ratio tiers.
  • 02Revenue per employee is the planning number to track: about $175,000 at traditional agencies and close to $1 million at AI-native brokerages, while P&C headcount grows by less than 1% a year.
  • 03Survey adoption overstates readiness. Nearly three-quarters of brokerages report some AI use, but only 13% use it across multiple parts of the business.

Nov 21, 2026

The Early Scale: FDA's fortification policy shakes up functional food sector

The Early Scale: FDA's fortification policy shakes up functional food sector

The landscape of B2B industries is shifting as new technologies and initiatives reshape strategies. From sustainable packaging initiatives in healthcare to a major USDA grant expanding ag-tech education, the intersection of technology and sustainability stands out. The article also highlights FedRAMP as a key compliance framework for cloud providers serving federal agencies—signaling that adaptation and innovation remain essential.

  • 01FDA fortification policy does not set federal guidelines for creatine, caffeine, and fiber, allowing brand teams to make independent fortification decisions.
  • 02Capsa Healthcare's RoboPharma HV Wall is compatible with Parcel Health's Tully Tube paper vials, enabling sustainable, automated pharmacy operations.
  • 03Iowa State University received a $6 million USDA grant to develop agricultural tech education through its FIELD Commons program.

Nov 21, 2026

KPMG's AI audit agents cut up to 3.5 weeks from some audits

KPMG's AI audit agents cut up to 3.5 weeks from some audits

KPMG announced the U.S. rollout of KPMG Clara intelligence (KCi), which uses AI agents to draft and coordinate parts of audit work while auditors direct, review and decide. On some engagements, KPMG says timelines shrank by up to three and a half weeks after analyzing full populations of transactions, and clients pulled fewer support documents by hand. KPMG aims to bring KCi to all of its private company audits in 2027.

  • 01KCi's best reported time savings, up to three and a half weeks on some engagements, come from clients no longer hand-pulling individual support documents. Expect the first changes in how a finance team hands over data.
  • 02KPMG aims to run every private company audit on KCi in 2027, so planning conversations for those engagements are the right time to ask which audit areas will get full-population analysis.
  • 03Treat the three-and-a-half-week figure as a best case from selected engagements and selected audit areas, not as an average to build into a close calendar.

Nov 20, 2026

Explore More Business Services Insights

Read more expert perspectives from across Business Services.

Browse Business Services Hub

About the Expert

MarketScale Newsroom
MarketScale Newsroom

Editorial Team

MarketScale

The MarketScale Newsroom reports on the companies, technologies, and trends shaping 16 B2B industries. It turns primary sources and expert commentary into clear, useful coverage for the people doing the work.

For B2B teams

Your experts could be publishing here

Stories like this one run on content MarketScale captures from real practitioners. See how your team's expertise becomes coverage in Business Services and beyond.

Book a Demo

Or call us. No forms required. We pick up. 214-945-2512