Conditional hypothesis
Compile by Training → changes → Remote-model calls
The author conditionally argues that Compile by Training could reduce some remote calls by replacing repeated teacher-model use with reusable local inference. This requires broad production-task coverage and lower total costs, including deployment, updates, monitoring, and error handling; no reduction in calls or revenue is demonstrated.
Read the evidence
These experiments have not demonstrated that remote-interface call volume or revenue has already been affected. Only when compilable methods cover a large number of production tasks, and the total cost of local inference, deployment, updates, monitoring, and error handling is lower than that of remote calls, might some remote calls decrease.
Background sources for the article's reasoning: [S1] arXiv
Read the full research