Market Note · II 22 May 2026 · Friday

Build the
Taiwan AI Inference Factory

The pivot from the brokerage thesis. Build small (10 MW) AI inference data centers in Taiwan. Sell tokens to APAC and sovereign-aligned buyers. The honest economics, the real competitive landscape, and the decision framework.

Pivot from
v0.9 Brokerage
Capital Required
~$300M / DC
Time to Revenue
18–24 mo

From sourcing to building. A different business.

The prior note (twstrategy.pgintel.dev) laid out a brokerage thesis: low-capital, services-led, ninety-day path to revenue, positioned in the 5–20 MW sourcing seam. The thesis under evaluation here is a pivot from brokerage to build — instead of sourcing capacity for others, build small (10 MW) AI inference data centers directly in Taiwan and sell tokens. It is not the same business. It is a much heavier one. This note exists to evaluate whether it is also a better one.

What the build thesis holds

This is not a yes-or-no question. It is a scoping exercise: weighing a capital-intensive build thesis, largely unproven in its specifics, against an unproven services thesis with a much lower capital bar. The point is to find out whether the specifics close the gap.

What we are actually selling. The unit, the meter, the margin.

A token is the metering unit for large-language-model input and output. Roughly four characters of text, or three-quarters of a word. When OpenAI charges per million tokens, this is the meter. "Tokens-as-a-Service" means renting your GPUs out as a metered API.

The mechanics, in plain terms

  1. The buyer (a developer, app, or enterprise) calls an API. They send a prompt, expect a completion. Both directions are measured in tokens.
  2. The provider hosts a model on GPUs. Open-weight (Llama, Mistral, DeepSeek, Qwen) or licensed proprietary. The model runs on the GPUs.
  3. The provider exposes a metered API. Usually OpenAI-compatible so customers can swap providers without rewriting code.
  4. Billing is per-token. Typically separate prices for input and output tokens, sometimes higher for output. Charged per million tokens (Mtok).
  5. Margin is the gap between what the buyer pays per Mtok and what the GPU cluster costs to run per Mtok (power + cooling + depreciation + debt service + ops).

What tokens cost in 2026 — and why the chart is collapsing

Token pricing has fallen roughly an order of magnitude in eighteen months. For a comparable open-model API (Llama-3 70B class):

Together AI · Llama-3 70B
$0.88/Mtok
Public listed pricing, blended input + output, May 2026.32
Fireworks AI · Llama-3 70B
$0.90/Mtok
Comparable tier, public pricing.32
Groq · LPU-accelerated
$0.59/Mtok
Custom inference silicon; aggressive pricing to win developer mindshare.32
OpenAI GPT-4o (closed)
$5.00/Mtok
Frontier proprietary model, output tokens. Different market — these are not our prices.33

The two markets are different. Open-weight inference (Llama, Mistral, DeepSeek) has collapsed to under $1 per Mtok and continues falling. Frontier closed-model inference (GPT-5, Claude Opus 4, Gemini Ultra) holds at $3–15 per Mtok because the model itself is the moat, not the compute. This thesis is in the open-model market. That is the commoditizing market. Margins there come from utilization, energy cost, and operational efficiency — not from differentiated software.

How a token provider actually makes money

Reverse-engineering the margin: a Llama-3 70B request might generate ~50 output tokens per second on a single H100 GPU. At ~$0.88 per Mtok, one H100 running continuously at full utilization produces roughly:

This is why open-model inference providers either (a) optimize batch and quantization aggressively to push effective throughput 3–5× above naive estimates, (b) sell to enterprises at higher contract prices than retail rates, or (c) bundle higher-margin services (fine-tuning, dedicated capacity, support). The retail API price is a customer-acquisition cost, not the actual margin model.

Tokens-as-a-Service is a throughput business, not a pricing business. The provider that wins is the one with the lowest cost per realized output token — which means cheapest power, highest utilization, best batching software, and biggest customers willing to pay above retail.

Bigger than training. Commoditizing faster than training.

In 2024 the AI infrastructure conversation was about training clusters. In 2026 the larger and faster-growing market is inference. Inference is what enterprises actually pay for in production. The economics are completely different from training.

Market size and shape

Estimates of the global AI inference market vary, but the directional consensus across Bain, McKinsey, IDC and a16z reports in late 2025 / early 2026 puts inference compute spend at $50–80 billion in 2026, projected to $250–400 billion by 2030.34 Inference is now plausibly larger than training in dollar terms because every enterprise deployment generates inference perpetually, while training is episodic.

Two distinct inference markets

Dimension Frontier Closed-Model Inference Open-Model Inference
Providers OpenAI, Anthropic, Google, xAI Together, Fireworks, Groq, Cerebras, Replicate, Lepton, DeepInfra, Anyscale
Models GPT-5, Claude Opus 4, Gemini Ultra Llama-3/4, Mistral, DeepSeek-V3, Qwen, Mixtral
Pricing per Mtok $3–15 $0.20–1.50
Margin source Model quality (proprietary moat) Throughput efficiency (compute moat)
Customer profile Enterprises, agents, anything quality-gated AI app devs, anything cost-gated, sovereign deployments
This thesis fits here No — can't build a model Yes — TaaS for open-weight models

The DeepSeek effect and the commoditization of open inference

DeepSeek-V3 (released January 2025) and DeepSeek-R1 (released January 2025) demonstrated frontier-comparable reasoning at roughly one-tenth the inference cost of closed-frontier alternatives.35 Llama-4, Qwen 2.5, and Mistral Large 2 followed similar curves through 2025. The result by mid-2026: open-weight models are good enough for ~70% of production enterprise use cases, and the differentiator is no longer model quality but inference cost.

That is excellent news for inference providers in one sense — the addressable market is growing fast as enterprises shift workloads to open models — and brutal in another sense — every provider serving open models is selling the same thing, and competing on price.

The strategic implication: a new entrant cannot compete with Together / Fireworks / Groq on retail price for generic open-model inference. The defensible plays are (a) specific customer segments where geography, sovereignty, or latency matters more than price, or (b) contracted dedicated capacity rather than retail per-token spot pricing.

$300M, give or take, to put 5,000 GPUs in a building. What it actually buys.

The claim that "10 MW at $300M is the best unit economics" is in the right ballpark but on the lower end. The capex stack below is the realistic breakdown. Numbers are illustrative ranges based on industry-standard data-center cost benchmarks circa 2026.

Capex stack — what $300M actually buys

Component Range Notes
Land + building (shell) $20–40M If purchased outright. Leasing reduces to ~$0 upfront but adds opex.
Power infrastructure $20–35M Substation work, UPS, switchgear, backup gen. Sized for 10 MW with overhead.
Cooling (liquid + heat rejection) $25–40M Direct-to-chip + immersion + cooling towers + dry coolers. Roughly $30–50K per rack.13
Fit-out (raised floor, racks, cabling) $15–25M Includes power distribution, structured cabling, fire suppression.
Networking (InfiniBand / NVLink fabric) $20–30M Non-GPU silicon. Critical for any AI cluster >1 MW.
GPUs (5,000× GB200-class) $150–200M ~$30–40K per GPU all-in. The dominant cost and the dominant lead-time risk.
Contingency + working capital $20–30M Overruns, software stack, hiring, ramp.
Total realistic range $270–400M The $300M figure is plausible if leasing the building and financing GPUs aggressively.

Revenue and margin math

At 5,000 GPUs producing inference at retail pricing equivalent:

The two scenarios that change everything

Anchor-customer scenario. If a single enterprise or sovereign-AI customer signs a multi-year reserved-capacity contract for 50–80% of the cluster at premium pricing ($2–4 per Mtok dedicated, not $0.88 retail), the math improves dramatically. Revenue could approach $100M+ in year one, and payback compresses to 3–4 years. This is the only realistic path to attractive returns. Without an anchor customer, the math depends entirely on retail-token sales that compete with Together / Fireworks.

Token-price-collapse scenario. If open-model token prices continue falling 50%+ per year (which the 2024–2026 curve suggests), retail revenue could drop below opex within 24 months. The hedge is anchor contracts that lock in pricing. Without contracts, the project is unfundable.

The unit economics of a 10 MW inference DC require a named anchor customer with a signed reserved-capacity contract. Without it, this is a leveraged bet on retail token prices not collapsing — and they are collapsing. "Anchor customer" is the project-finance gating question, not a nice-to-have.

Seed, development, project finance, build. Three raises, not one.

"Find a rich person to give us a few million bucks" sounds like one round. It is actually the first of three sequential raises with very different bars, very different investors, and roughly two years between the first dollar and the first ground-broken.

The four stages

Stage Size Source What It Buys Bar to Clear
01 · Seed $2–5M Angel / family office / VC seed / venture arm of an infra investor Team, project diligence, site option, customer dev, legal entity Credible team + plausible thesis
02 · Development $10–25M Specialist DC PE, growth fund, sovereign LP, strategic (Nvidia, ODM) Site control, power application, anchor customer LOI, design Verifiable site + customer LOI
03 · Project Equity $50–80M Infra equity (Macquarie MIRA, DigitalBridge, Brookfield, KKR) Equity tranche of the build; balances debt Signed anchor + power secured + permits in motion
04 · Project Debt $150–220M HPC-backed debt, GPU-collateralized facilities, infrastructure bonds The dominant cost — the GPUs and the hard infra Take-or-pay customer contracts; investment-grade structure

Macquarie's institutional capital sits primarily at stages 03 and 04. A seed-stage relationship with a Macquarie principal is almost certainly a personal check or a venture-arm bet, not a MIRA-led commitment. That's a normal pattern — but any such relationship needs to be named, dated, and confirmed as actually committed, not informal.

Reference points: how comparable companies actually raised

The pattern: none of these companies raised the full project finance on a deck. They built credibility incrementally — seed for the team, development for the site, then institutional capital after the anchor was signed. Skipping stages is how DC ventures die.

A Macquarie principal expressing interest is good news for stage 01. It is not by itself sufficient to suggest stages 02 through 04 are easy. The work of validating the sequence is most of the work of building this business.

The niche pitch is defensible. The global pitch is not.

The framing that "Taiwan can provide this to the world that other countries can't" works at a high level and falls apart in the specifics. The honest version is narrower and stronger: Taiwan is the right place to build inference capacity for specific buyers who specifically need Taiwan, not for the global token market.

What is actually true about Taiwan for inference

What is overstated

The honest pitch: Taiwan is the right place to build inference for APAC + sovereign-aligned buyers who specifically value Taiwan's ODM proximity, latency, and sovereignty position. That is a real market. It is not the global token market.

The token market is crowded, capitalized, and racing toward zero. Where can a new entrant play?

Open-model inference has roughly a dozen serious providers, most with $50M–$500M+ in funding, all serving the global market. Pricing pressure is intense. The question for any new entrant is not "can we sell tokens" — it is "what can we sell that they cannot."

Who is in this market

Company Approach Funding / Status Differentiator
Together AI Multi-model API, fine-tuning, dedicated ~$305M+ raised; among the largest open-inference shops Broad model catalog, mature API
Fireworks AI Multi-model API; aggressive on speed ~$77M raised; high-quality engineering reputation Latency, throughput tuning
Groq Custom inference silicon (LPU) $640M Series D; recently $1.5B Saudi commitment Speed (high tokens/sec); hardware lock-in
Cerebras Custom wafer-scale inference IPO filed 2024; G42-anchored Speed; sovereign relationships
Replicate Marketplace + developer cloud ~$40M raised Developer experience
DeepInfra Lowest-cost open-model API ~$8M raised; bootstrapped feel Pricing
Anyscale Ray-based platform; enterprise focus ~$259M raised Open-source community + enterprise
Lepton AI Compute-as-a-service for AI builders ~$11M seed Founder pedigree (ex-Alibaba PAI)
Modal Labs Serverless GPU compute ~$23M raised Developer experience
Hyperbolic Decentralized GPU + inference ~$20M seed Cost via aggregated GPU supply

What this competitive picture means

A new entrant cannot win on retail price for generic Llama-class inference. Together, Fireworks, and Groq are all selling the same tokens for $0.59–0.90 per Mtok. A new Taiwan-based provider entering at the same price has no advantage and no economic moat — the same model, the same hardware, just a different building.

A new entrant can win on specific dimensions where the incumbents cannot.

The competitive answer to "why would anyone buy tokens from us" is not "lower price" or "better tech." It is "we are physically the right provider for buyers who specifically need Taiwan-soil inference, with a price floor set by long-term contracts, not retail spot."

Salesforce is not our customer. Here is who actually is.

The reference point that "Salesforce spends $300M on tokens" is a directionally correct illustration of token market size but is the wrong customer profile. Salesforce buys from OpenAI, Anthropic, and Cohere — frontier-model APIs — not from Taiwan-based open-model providers. The real customer set is narrower and more specific.

The buyer segmentation

Segment Profile Annual Token Spend Taiwan Fit
Frontier-model enterprises Salesforce, Notion, Shopify — buy GPT-5 / Claude tokens $10M–$500M+ Poor — they buy frontier-model APIs, not open inference
APAC enterprises Japanese conglomerates, Korean chaebols, SEA banks, Aus telcos $2M–$50M Strong — latency + sovereignty
Sovereign AI programs Japan METI, Korea AISG, AI Singapore, UAE G42, Saudi HUMAIN, India MeitY $10M–$500M Strong — Taiwan-aligned, non-mainland-China
AI app developers (APAC-served) Apps with majority APAC users (gaming, social, ecommerce, productivity) $500K–$20M Strong — latency-sensitive
Global AI app developers Cursor, Perplexity, Replit, etc. $5M–$200M Moderate — only if Taiwan price/throughput beats US
Frontier model labs OpenAI, Anthropic, xAI buying training compute $1B+ Poor — they build their own or use frontier providers
Sovereign training (Taiwan-aligned) A Taiwan-soil sovereign-AI build like a government-backed open-model $50M–$500M Strong — politically anchored to Taiwan

The anchor-customer question, sharpened

From §IV, the project finance only works with an anchor customer. From the segmentation above, the realistic anchor candidates are:

  1. A Japanese or Korean megacorp wanting 5–10 MW of dedicated Taiwan-soil inference capacity for AI products serving APAC users (Rakuten, LINE, Samsung, SK Telecom, KDDI, NTT).
  2. A Middle Eastern sovereign-AI program diversifying compute geography off Gulf or US soil (G42, HUMAIN). G42 has Cerebras anchor relationship; HUMAIN is newer and less locked-in.
  3. The Taiwan government itself via a sovereign-AI program — an open-model deployment for Taiwan public-sector use and ASEAN export.
  4. A Taiwan ODM (Foxconn / Quanta / Wiwynn) building inference capacity for their own products and ecosystem (Foxconn's Visionbay.ai precedent3,12).
  5. A specialty AI app with APAC users committing to 1–2 MW of dedicated capacity at premium pricing.

Without one of these signed in development stage (02), the project is unfundable. The seed (~$2–5M) can be raised on the team and thesis. Stage 02 cannot.

The Phase-00 question for this thesis is not "do we know neoclouds?" — it is "can we name and access a credible anchor customer in the next 60 days?" Without that, the venture stalls between seed and development.

One sentence, draft form, for stress-testing against reality.

Same exercise as v0.9 §VI — collapse the strategy into a single positioning statement that can be tested in real conversations.

We build dedicated 10 MW AI inference capacity in Taiwan — purpose-engineered for APAC enterprises and sovereign-AI programs that specifically need Taiwan-soil, hardware-proximate, latency-optimized token serving — sold via reserved-capacity contracts, not retail spot pricing.

Why this framing and not something else

This wedge fails if (a) no anchor customer materially values Taiwan-soil inference enough to sign reserved capacity, or (b) the global open-model retail price drops so far that even contracted prices follow it down. Both are real risks that further diligence needs to resolve.

Eight statements. Same discipline as v0.9, retargeted at the new thesis.

If any one of these is false, this business is wrong. The open question is which of these can be defended and which cannot.

  1. Anchor-customer pool exists. At least three credible APAC / sovereign / ODM candidates would consider signing a 5+ MW reserved-capacity contract within 12 months. If no one is willing to anchor, the project is unfundable.
  2. Taiwan-soil inference commands a premium ($2–4/Mtok dedicated vs $0.88 retail). If sovereignty / latency / proximity buyers pay retail, the unit economics collapse.
  3. Power can be secured for 10 MW in central or southern Taiwan within 12–18 months. If Taipower allocation is more than ~24 months, the project misses the demand window.
  4. The operating team has verifiable data-center build experience. Not just relationships — actual prior projects, scale, role, references. This is foundational and, for any new entrant, needs to be established up front.
  5. Open-model token prices stabilize above ~$0.30/Mtok by 2028. If they collapse to $0.10 or below, even contracted prices follow, and margins evaporate.
  6. A named institutional relationship (e.g. at a firm like Macquarie) is real and committed to writing a seed check, not just willing to take a call. The difference is six to twelve months of fundraising.
  7. The founding team can operate a build-and-operate venture — not just a brokerage. The skill mix is different (capital, construction, ops, customer success), and someone on the team needs to be credible at each.
  8. The first stage 02 raise closes within 18 months of seed. If development capital takes 24+ months, runway burns and the project stalls.
Honest read on the eight: 2, 3, 4, 6 are completely unverified right now. 1 is partially supported by sovereign-AI funding trends. 5 is unknowable but the trend runs against it. 7 is an open operating-team question. 8 depends on everything else.

Two businesses. Pick one, or sequence them.

The brokerage thesis from twstrategy.pgintel.dev and the build thesis from this document are not the same venture. They have different capital, different risk, different timelines, different team requirements. The choice is real.

Dimension Brokerage (v0.9) Build (this doc)
Capital required ~$0 to start; services-led $2–5M seed; $300M total
Time to first revenue 90 days 18–24 months
Time to scale revenue 12–18 months 3–5 years
Competitive intensity Low — "open in the middle" High — 10+ funded incumbents
Unit economics High-margin services + brokerage fees Capital-intensive infra; 15–35% margins
Funding pattern Could bootstrap or small angel Multi-stage institutional sequence
Failure mode "Open in the middle" turns out occupied Anchor customer never materializes; token prices collapse
Upside if it works $5–20M/year services business, optional platform $500M–$2B+ infrastructure asset
Risk-adjusted return Lower variance, lower ceiling Higher variance, higher ceiling

The hybrid argument

The strongest version of the strategy might be to do brokerage first, build second. Year 1 brokerage generates revenue, builds relationships, surfaces the actual anchor customers, and identifies the right sites. Year 2 the venture pivots into operating, with proprietary information advantage and validated demand. Skipping brokerage skips the most efficient possible validation of the build thesis.

The counter-argument: brokerage occupies time and attention that the build thesis needs urgently. The window for Taiwan inference is closing (every quarter, sovereign-AI buyers commit to other geographies). Brokerage could be a 12-month distraction that loses the build window.

The honest comparison is not "brokerage or build." It is: can both be executed sequentially with shared infrastructure, or does the choice require fundamentally different operating capabilities? That is an organizational-design question, not just a strategy question.

Five thresholds. If we cannot clear them, this is not yet a real venture.

Same discipline as v0.9 Phase 00. If by 5 June 2026 — including the COMPUTEX week — the five questions below cannot be answered with named, dated specifics, the project is not yet ready for serious commitment.

  1. Capital-relationship verification. Any named seed-capital relationship (e.g. an institutional contact) is confirmed as a real, responsive commitment — not just a warm intro.
  2. The operator's track record. Verifiable prior data-center builds the operating team was actually involved in — scale, year, role, references. Without this, the operator thesis lacks the proof point that justifies a seed raise.
  3. One named credible anchor candidate. Not "we'll find one" — a specific Japanese / Korean / sovereign / ODM target with a warm path and a hypothesis for why they would sign reserved capacity. Without this, stage 02 financing is impossible.
  4. One identified candidate site. A specific industrial parcel in central or southern Taiwan with a credible >5 MW power story. Ally inventory is the obvious starting point. Without a real site, the seed has nothing to develop.
  5. Operating roles defined. A clear, indispensable function for each member of the founding team — commercial lead, capital lead, technical lead, or another structural role. If the answer after diligence is "we'll figure it out," the team lacks the structure to fundraise.

If 3+ of 5 thresholds are not cleared by 5 June 2026: the venture is not yet investable, the seed conversation with Macquarie should be deferred, and the brokerage thesis (v0.9) becomes the right path to revalidate. The brokerage work would itself surface the anchor customer and site for a future pivot to build.

If 4–5 of 5 thresholds are cleared: the venture is investable in seed terms, and the conversation transitions from "is this real?" to "how do we structure it?"

The discipline is the same as v0.9: no drift. Either the answers come fast and specific, or the timeline extends and the project is revisited. There should be no sliding into committing to a $300M business on relationships and enthusiasm alone.

Sources & Citations

  1. 3"Foxconn-Nvidia $1.4B Taiwan supercomputing cluster to be ready by H1 2026," Reuters / AOL, Nov 21, 2025. (Carry-over from v0.9.)
  2. 7"The Energy Paradox of Taiwan's Sovereign AI Ambition," CAPRI Foundation, March 2026; Taipower >5 MW restriction north of Taoyuan. (Carry-over.)
  3. 12"Foxconn to build Taiwan's largest AI data center using Nvidia's GB300 platform," Focus Taiwan, Nov 2025. (Carry-over.)
  4. 13"Rising AI Server Demand Drives Foxconn's Record Weekly Rack Output," MEXC News / CoinCentral, Nov 2025; ~$30–50K liquid cooling per rack. (Carry-over.)
  5. 21"Taiwan supplies 80–90% of the world's AI servers," Taipei Times, Jan 3, 2026, citing CIER. (Carry-over.)
  6. 23"Taiwan electricity pricing and data center power restrictions," CommonWealth Magazine, May 2026. (Carry-over.)
  7. 27"Chunghwa Telecom IPLC global network: 27 submarine cables, 12 landing in Taiwan," Chunghwa Telecom corporate materials. (Carry-over.)
  8. 28CoreWeave Inc., "CoreWeave Closes $3.1 Billion Loan Facility," Investor Relations Press Release (NASDAQ: CRWV), May 18, 2026; Q1 2026 earnings release May 19, 2026. (Carry-over.)
  9. 30Cleanview Research, "The Goodnight Project: Crusoe Energy 933-Megawatt Off-Grid AI Generation Infrastructure," April 2026. (Carry-over.)
  10. 32Public pricing pages, May 2026: Together AI (together.ai/pricing), Fireworks AI (fireworks.ai/pricing), Groq (groq.com/pricing). Llama-3 70B class blended rates.
  11. 33OpenAI public pricing, May 2026 (openai.com/pricing). GPT-4o and GPT-5-class output token rates.
  12. 34Aggregate of AI inference market sizing: Bain & Company AI infrastructure outlook (2025), McKinsey "The state of AI in 2025," IDC AI worldwide spend tracker, and a16z "How big is the AI market?" (late 2025). Inference compute spend estimates $50–80B in 2026 trending to $250–400B by 2030.
  13. 35DeepSeek-V3 technical report (December 2024) and DeepSeek-R1 announcement (January 2025); analysis of cost-per-Mtok versus frontier closed-model alternatives across Together AI, Fireworks, OpenAI public benchmarks.

Citation continuity: cites 1–31 are carried over from twstrategy.pgintel.dev (v0.9). Cites 32–35 are new to v0.1 of this memo. Full source list at twstrategy.pgintel.dev §Cites.