{"@context": "https://schema.org", "@type": "AnalysisNewsArticle", "inLanguage": "en", "identifier": "ai-research-20260911-0014-1194", "headline": "Evaluating Foundation Model and Agent Applications: How Far Does the Task Get, and Who Bears the Cost?", "description": "OpenAI describes a case in which a laboratory uses Codex and ChatGPT to search for candidate antimicrobial molecules. This specific step also offers a starting point for evaluating office AI, device agents, and different deployment approaches: distinguish between generating outputs, validating results, and executing actions.[S6]", "abstract": "OpenAI's case summary states that the César de la Fuente laboratory uses Codex and ChatGPT to search the genomes of living and extinct organisms for candidate antimicrobial molecules; the summary provides no results on drug efficacy, accelerated R&D, or costs.[S6] This case can help break down AI tasks, but it does not establish that the global industry has undergone a uniform shift. This article uses four dimensions—task endpoint, action permissions, result validation, and total cost—to treat model announcements, reports on office features, device interface previews, and cloud financial headlines as entry points into distinct issues, rather than as deployment cases with validated outcomes.[S1][S3][S5][S9] For Chinese and open-source approaches, the discussion focuses on how to compare control and engineering responsibilities, without ranking performance or market position.", "datePublished": "2026-09-11T00:14:01+00:00", "dateModified": "2026-09-25T14:27:00.554133+00:00", "author": {"@type": "Person", "name": "Aperture Research Editorial Team", "jobTitle": "Comparative Technology and Industry Research · Research Coder"}, "about": ["Foundation Models", "AI Agents", "AI for Scientific Research", "Task Acceptance", "Permission Governance", "Open-Source Ecosystem", "AI in China", "Cloud Infrastructure"], "category": "AI industry trends", "authorityScore": 80, "claims": [{"text": "In a case summary published on September 10, 2026, OpenAI describes how the César de la Fuente laboratory uses Codex and ChatGPT to search the genomes of living and extinct organisms for candidate antimicrobial molecules.[S6] The most important point here is not a broad label of “research capability,” but a clearly defined place in the task: the tools are used to search for candidates, and the summary does not portray this step as having already yielded effective drugs.", "section": "First Ask How Far the Task Gets, Then Ask How Capable the Model Is"}, {"text": "Announcements and news headlines concerning foundation models and agents also cover distinct topics such as coding and knowledge work, charts and reports within chats, device interfaces, and cloud revenue.[S1][S5][S9][S3] These are useful for framing questions, but they cannot be compared on the same footing as a specific application summary, much less strung together into a timeline suggesting that the entire industry has already shifted direction.", "section": "First Ask How Far the Task Gets, Then Ask How Capable the Model Is"}, {"text": "This article uses four yardsticks: what the task endpoint is, what the system can operate, who validates the results, and how much it costs in total to complete a task that meets acceptance criteria. Here, “agent” refers to an AI system that can call tools and advance a task toward a goal—a working definition for the discussion. A product having AI features does not automatically mean it can execute tasks autonomously.", "section": "First Ask How Far the Task Gets, Then Ask How Capable the Model Is"}, {"text": "The discussion below preserves distinctions between source types: application summaries illustrate the stage at which tools are used in a case, while headlines and announcement listings provide entry points for discussion. For actual performance, safety outcomes, financial results, and deployment benefits, headlines are not substituted for measurements, nor are vendors' own descriptions treated as independent validation of outcomes.", "section": "First Ask How Far the Task Gets, Then Ask How Capable the Model Is"}, {"text": "The value of considering these records together lies not in choosing a winner, but in avoiding mismatched comparisons. Capability descriptions should be subjected to task-based tests, application cases should be examined for acceptance outcomes, interface proposals should be checked for execution constraints, and financial analysis requires clearly defined measurement bases.", "section": "Models, Applications, and Cloud Businesses Must Answer Different Questions"}, {"text": "The OpenAI case describes searching for candidate antimicrobial molecules, not delivering validated treatments.[S6] Thus, evaluating this case allows us to ask “At which stage did the tools participate?” but not directly answer “How much did the final research outcomes improve?” Where use occurs and whether that use produces net benefits are two separate questions.", "section": "The Difference Between Research and Office Work Starts with Acceptance Criteria"}, {"text": "This task can be compared with a hypothetical office workflow: if AI generates charts or reports within a chat, users need to check the data, chart logic, and written conclusions; if AI proposes research candidates, users need to explain how those candidates proceed to subsequent validation. The Slack headline provides an entry point for discussing the former workflow, but does not establish what data access, verification, or autonomous execution capabilities the product already has.[S5]", "section": "The Difference Between Research and Office Work Starts with Acceptance Criteria"}, {"text": "If an output can be accepted using clear, low-cost checks, a team may obtain feedback more quickly; if it is merely an intermediate candidate in a research process, judgments of its value must follow subsequent validation. This is reasoning about task structure, not a conclusion that office AI is more mature than research AI.", "section": "The Difference Between Research and Office Work Starts with Acceptance Criteria"}, {"text": "Procurement and evaluation should change accordingly. For office solutions, time savings can be assessed after including manual checking and revision; for research solutions, teams can track candidates' subsequent performance and compare search results under the same resource constraints. Comparing generation speed alone may overlook the validation costs borne by users.", "section": "The Difference Between Research and Office Work Starts with Acceptance Criteria"}, {"text": "Counterexamples matter just as much. If a research team can establish a fast, low-cost validation process, candidate searches may also receive rapid feedback; if the data used in a report are unreliable, generating it faster may not be valuable. The specific task, rather than the label “research” or “office work,” should determine how acceptance is assessed.", "section": "The Difference Between Research and Office Work Starts with Acceptance Criteria"}, {"text": "Anthropic's device interface announcement listing raises the issue of agents operating physical devices.[S9] For such proposals, it is necessary to distinguish “being able to issue operating commands” from “being able to complete operations safely within authorized bounds”; the announcement's statement of goals cannot itself answer the latter question.", "section": "From Generating Content to Executing Actions, Permissions Require Separate Evaluation"}, {"text": "If an AI system is granted permission to operate external devices or computer tools, evaluation should add a set of specific questions: which resources it can access, which actions require approval, how it stops after a failure, and whether operation logs can reconstruct the process. These are suggested checks, not assertions about features the Model Hardware Standard already has.", "section": "From Generating Content to Executing Actions, Permissions Require Separate Evaluation"}, {"text": "Malicious use and systems exceeding their authorization should also be discussed separately. Anthropic's two safety announcement listings touch on these two types of issues, respectively.[S7][S8] The excerpts alone, however, do not justify elaborating on response time frames, incident counts, or outcomes, nor can a planned review be described as completed independent validation.", "section": "From Generating Content to Executing Actions, Permissions Require Separate Evaluation"}, {"text": "Deployment analysis can offer a conditional judgment: if an enterprise checks only model responses without reviewing tool permissions, it may miss risks at the execution stage; if it restricts only access without checking output quality, it may obtain task outputs that comply with permissions but are incorrect. Permission controls, user management, and result validation are therefore best evaluated separately, rather than replaced by a single “safety” label.", "section": "From Generating Content to Executing Actions, Permissions Require Separate Evaluation"}, {"text": "Shared interfaces may offer engineering convenience if they reduce duplicate integration work; whether they lower costs, however, requires actual integration data, and whether they improve safety requires execution tests. Interface standardization cannot be directly equated with permission safety, nor can vendors' risks be compared based on the number of announcements.", "section": "From Generating Content to Executing Actions, Permissions Require Separate Evaluation"}, {"text": "CNBC's headline about Oracle concerns cloud infrastructure revenue, earnings, and the stock price.[S3] Taking the financial analysis further requires the relevant fiscal quarter, revenue definitions, year-over-year or quarter-over-quarter comparison bases, and the composition of the businesses involved. This article does not adopt the growth figure in the headline or use it to confirm that demand for agents has already translated into revenue.", "section": "Connecting Cloud Revenue to Agent Value Still Requires Workload and Cost Data"}, {"text": "Even if subsequent financial data confirm cloud revenue growth, attribution remains a separate question. If growth comes from other cloud services, training workloads, or changes in the customer mix, it cannot all be credited to agents; only revenue and usage that can be linked to specific workloads help assess agents' contribution. These are explanations to be tested, not judgments about the sources of Oracle's revenue.", "section": "Connecting Cloud Revenue to Agent Value Still Requires Workload and Cost Data"}, {"text": "Application cases face similar attribution problems. OpenAI's summary supports the statement that the laboratory uses the relevant tools to search for candidate molecules, but it does not isolate the roles of researchers' experience, data selection, and workflows.[S6] Likewise, if in-chat generation reduces switching between operations, changes in the user experience may stem from where the work begins, not just the underlying model's capabilities; the Slack headline itself cannot measure these factors' contributions.[S5]", "section": "Connecting Cloud Revenue to Agent Value Still Requires Workload and Cost Data"}, {"text": "Cloud-based AI solutions can therefore be evaluated by asking “How much does each task that passes acceptance cost?” and including calls, retries, human review, and operational management. If the price per call falls but is accompanied by more retries or reviews, the total cost of completing a task may not decline; if a cloud provider's revenue rises, users' net benefits still need to be measured separately.", "section": "Connecting Cloud Revenue to Agent Value Still Requires Workload and Cost Data"}, {"text": "For Chinese foundation models and the open-source ecosystem, this set of cases is insufficient to compare performance, adoption scale, or market position. Their lack of equal coverage in the sample does not mean those approaches are lagging; nor does this article use the sample to characterize an overall gap between industries in China and elsewhere.", "section": "For Chinese and Open-Source Approaches, Compare Engineering Responsibilities Alongside Control"}, {"text": "What can be carried over is the task-level approach to asking questions. When discussing open models, code, weights, and license permissions should be examined separately, rather than relying solely on the “open source” label. When discussing deployment solutions in China, one can examine where data are stored, who authorizes tool access, who retains logs, and whether the underlying system can be replaced. These are all variables to compare, not generalizations about regional institutions or vendor practices.", "section": "For Chinese and Open-Source Approaches, Compare Engineering Responsibilities Alongside Control"}, {"text": "If a model approach allows deployers to modify and run the system themselves, it may offer more room for configuration and management; whether this translates into effective control, however, also depends on the deployment team's capabilities. The labor required for integration, evaluation, updates, and security maintenance should also be included in total cost.", "section": "For Chinese and Open-Source Approaches, Compare Engineering Responsibilities Alongside Control"}, {"text": "Conversely, if a managed service can complete the same tasks at a lower total cost while meeting data, access, and audit requirements, self-deployment may not be more economical. There is no predetermined winner between open and closed approaches here—only a comparison of control, responsibility, and expense under the same acceptance criteria.", "section": "For Chinese and Open-Source Approaches, Compare Engineering Responsibilities Alongside Control"}, {"text": "Open interfaces do not mean open models. The shared device specification discussed in Anthropic's announcement listing can prompt separate examination of the interface layer, but cannot establish openness of model weights or licenses, much less imply that a cross-vendor ecosystem has already formed.[S9]", "section": "For Chinese and Open-Source Approaches, Compare Engineering Responsibilities Alongside Control"}, {"text": "The antimicrobial candidate-search case provides a concrete starting point: AI tools can participate in the research search stage, but the summary does not answer questions about ultimate effectiveness, speed, or economic returns.[S6] The other records concerning models, office work, devices, and cloud businesses raise different questions and are insufficient to assemble a conclusion that the global AI industry has completed some particular shift.[S1][S5][S9][S3]", "section": "Next, Look at Tasks That Pass Acceptance, Not Just Release Frequency"}, {"text": "A more useful next step is to compare completion rates, human intervention time, recovery costs after failure, and total expense under the same tasks and acceptance criteria. Research tasks can track subsequent candidate validation; device agents can be checked for execution and recovery performance within authorized bounds; cloud solutions can connect specific workloads, costs, and user benefits. These are metrics for subsequent testing, not existing achievements.", "section": "Next, Look at Tasks That Pass Acceptance, Not Just Release Frequency"}, {"text": "If solutions with similar model capabilities produce different outcomes, factors such as task mix, data quality, personnel experience, and computing resources must also be controlled. Only when these conditions are comparable, differences are reproducible, and more targeted tests support the relevant mechanisms can the explanation that permission design, validation processes, or workflow entry points affect outcomes be strengthened.", "section": "Next, Look at Tasks That Pass Acceptance, Not Just Release Frequency"}, {"text": "Conversely, if model upgrades consistently improve net benefits across different tasks, while additional investment in permissions, validation, and integration produces no significant difference, the assessment of those elements' relative contributions should be revised downward. Such comparisons offer a way to put vendors in China and elsewhere, open models, and managed services into the same results table: ask not which approach leads, but what task it completed and under what conditions.", "section": "Next, Look at Tasks That Pass Acceptance, Not Just Release Frequency"}], "sections": [{"type": "lead", "heading": "First Ask How Far the Task Gets, Then Ask How Capable the Model Is", "paragraphs": ["In a case summary published on September 10, 2026, OpenAI describes how the César de la Fuente laboratory uses Codex and ChatGPT to search the genomes of living and extinct organisms for candidate antimicrobial molecules.[S6] The most important point here is not a broad label of “research capability,” but a clearly defined place in the task: the tools are used to search for candidates, and the summary does not portray this step as having already yielded effective drugs.", "Announcements and news headlines concerning foundation models and agents also cover distinct topics such as coding and knowledge work, charts and reports within chats, device interfaces, and cloud revenue.[S1][S5][S9][S3] These are useful for framing questions, but they cannot be compared on the same footing as a specific application summary, much less strung together into a timeline suggesting that the entire industry has already shifted direction.", "This article uses four yardsticks: what the task endpoint is, what the system can operate, who validates the results, and how much it costs in total to complete a task that meets acceptance criteria. Here, “agent” refers to an AI system that can call tools and advance a task toward a goal—a working definition for the discussion. A product having AI features does not automatically mean it can execute tasks autonomously.", "The discussion below preserves distinctions between source types: application summaries illustrate the stage at which tools are used in a case, while headlines and announcement listings provide entry points for discussion. For actual performance, safety outcomes, financial results, and deployment benefits, headlines are not substituted for measurements, nor are vendors' own descriptions treated as independent validation of outcomes."]}, {"type": "evidence", "heading": "Models, Applications, and Cloud Businesses Must Answer Different Questions", "paragraphs": ["The value of considering these records together lies not in choosing a winner, but in avoiding mismatched comparisons. Capability descriptions should be subjected to task-based tests, application cases should be examined for acceptance outcomes, interface proposals should be checked for execution constraints, and financial analysis requires clearly defined measurement bases."], "headers": ["Discussion Entry Point", "Level of Information in the Source", "Questions Worth Asking", "How This Article Uses It"], "rows": [["Anthropic model announcement", "The announcement listing describes model capabilities in terms of coding, knowledge work, and scientific research.[S1]", "What are the success rates, error types, and costs on specific tasks?", "Retained only as capability positioning, not as a basis for establishing actual capabilities or relative performance."], ["OpenAI research application case", "The case summary describes a laboratory using Codex and ChatGPT to search genomes for candidate antimicrobial molecules.[S6]", "How are candidates validated, and at which step do the tools help?", "Used to analyze the candidate-search stage, without extending it to claims about drug efficacy, acceleration, or effects at scale."], ["Report on Slack features", "The Verge headline discusses generating interactive charts and reports within chats.[S5]", "If this workflow is available, how much time does checking and revising the data take?", "Used as an entry point for discussing office scenarios; the subsequent discussion does not assume that specific features or usage benefits have been verified."], ["Anthropic device interface announcement", "The announcement listing describes the Model Hardware Standard as a research preview of a shared specification for an initial group of scientific research laboratories and advanced manufacturers, with goals involving agents safely operating physical devices.[S9]", "How are device operations authorized, stopped, and logged?", "Used only to discuss how such proposals should be evaluated, not to establish that their features have been implemented, safety goals achieved, or an industry standard formed."], ["Anthropic safety announcements", "Two listing excerpts concern responses to malicious use, and unauthorized access to systems with a planned independent review, respectively.[S7][S8]", "How should user misuse be distinguished from systems exceeding their authorization?", "Used to distinguish risk types, not to count incidents, confirm the effectiveness of responses, or rank vendors' safety."], ["Report on Oracle earnings", "The CNBC headline mentions cloud infrastructure revenue growth, better-than-expected earnings, and a change in the stock price.[S3]", "Which fiscal quarter does this concern, what comparison basis is used, and which workloads contribute to revenue?", "Used only as an entry point for financial analysis, without adopting the headline's growth figure or market performance as confirmed results."]]}, {"type": "analysis", "heading": "The Difference Between Research and Office Work Starts with Acceptance Criteria", "paragraphs": ["The OpenAI case describes searching for candidate antimicrobial molecules, not delivering validated treatments.[S6] Thus, evaluating this case allows us to ask “At which stage did the tools participate?” but not directly answer “How much did the final research outcomes improve?” Where use occurs and whether that use produces net benefits are two separate questions.", "This task can be compared with a hypothetical office workflow: if AI generates charts or reports within a chat, users need to check the data, chart logic, and written conclusions; if AI proposes research candidates, users need to explain how those candidates proceed to subsequent validation. The Slack headline provides an entry point for discussing the former workflow, but does not establish what data access, verification, or autonomous execution capabilities the product already has.[S5]", "If an output can be accepted using clear, low-cost checks, a team may obtain feedback more quickly; if it is merely an intermediate candidate in a research process, judgments of its value must follow subsequent validation. This is reasoning about task structure, not a conclusion that office AI is more mature than research AI.", "Procurement and evaluation should change accordingly. For office solutions, time savings can be assessed after including manual checking and revision; for research solutions, teams can track candidates' subsequent performance and compare search results under the same resource constraints. Comparing generation speed alone may overlook the validation costs borne by users.", "Counterexamples matter just as much. If a research team can establish a fast, low-cost validation process, candidate searches may also receive rapid feedback; if the data used in a report are unreliable, generating it faster may not be valuable. The specific task, rather than the label “research” or “office work,” should determine how acceptance is assessed."]}, {"type": "mechanism", "heading": "From Generating Content to Executing Actions, Permissions Require Separate Evaluation", "paragraphs": ["Anthropic's device interface announcement listing raises the issue of agents operating physical devices.[S9] For such proposals, it is necessary to distinguish “being able to issue operating commands” from “being able to complete operations safely within authorized bounds”; the announcement's statement of goals cannot itself answer the latter question.", "If an AI system is granted permission to operate external devices or computer tools, evaluation should add a set of specific questions: which resources it can access, which actions require approval, how it stops after a failure, and whether operation logs can reconstruct the process. These are suggested checks, not assertions about features the Model Hardware Standard already has.", "Malicious use and systems exceeding their authorization should also be discussed separately. Anthropic's two safety announcement listings touch on these two types of issues, respectively.[S7][S8] The excerpts alone, however, do not justify elaborating on response time frames, incident counts, or outcomes, nor can a planned review be described as completed independent validation.", "Deployment analysis can offer a conditional judgment: if an enterprise checks only model responses without reviewing tool permissions, it may miss risks at the execution stage; if it restricts only access without checking output quality, it may obtain task outputs that comply with permissions but are incorrect. Permission controls, user management, and result validation are therefore best evaluated separately, rather than replaced by a single “safety” label.", "Shared interfaces may offer engineering convenience if they reduce duplicate integration work; whether they lower costs, however, requires actual integration data, and whether they improve safety requires execution tests. Interface standardization cannot be directly equated with permission safety, nor can vendors' risks be compared based on the number of announcements."]}, {"type": "counterargument", "heading": "Connecting Cloud Revenue to Agent Value Still Requires Workload and Cost Data", "paragraphs": ["CNBC's headline about Oracle concerns cloud infrastructure revenue, earnings, and the stock price.[S3] Taking the financial analysis further requires the relevant fiscal quarter, revenue definitions, year-over-year or quarter-over-quarter comparison bases, and the composition of the businesses involved. This article does not adopt the growth figure in the headline or use it to confirm that demand for agents has already translated into revenue.", "Even if subsequent financial data confirm cloud revenue growth, attribution remains a separate question. If growth comes from other cloud services, training workloads, or changes in the customer mix, it cannot all be credited to agents; only revenue and usage that can be linked to specific workloads help assess agents' contribution. These are explanations to be tested, not judgments about the sources of Oracle's revenue.", "Application cases face similar attribution problems. OpenAI's summary supports the statement that the laboratory uses the relevant tools to search for candidate molecules, but it does not isolate the roles of researchers' experience, data selection, and workflows.[S6] Likewise, if in-chat generation reduces switching between operations, changes in the user experience may stem from where the work begins, not just the underlying model's capabilities; the Slack headline itself cannot measure these factors' contributions.[S5]", "Cloud-based AI solutions can therefore be evaluated by asking “How much does each task that passes acceptance cost?” and including calls, retries, human review, and operational management. If the price per call falls but is accompanied by more retries or reviews, the total cost of completing a task may not decline; if a cloud provider's revenue rises, users' net benefits still need to be measured separately."]}, {"type": "scenario", "heading": "For Chinese and Open-Source Approaches, Compare Engineering Responsibilities Alongside Control", "paragraphs": ["For Chinese foundation models and the open-source ecosystem, this set of cases is insufficient to compare performance, adoption scale, or market position. Their lack of equal coverage in the sample does not mean those approaches are lagging; nor does this article use the sample to characterize an overall gap between industries in China and elsewhere.", "What can be carried over is the task-level approach to asking questions. When discussing open models, code, weights, and license permissions should be examined separately, rather than relying solely on the “open source” label. When discussing deployment solutions in China, one can examine where data are stored, who authorizes tool access, who retains logs, and whether the underlying system can be replaced. These are all variables to compare, not generalizations about regional institutions or vendor practices.", "If a model approach allows deployers to modify and run the system themselves, it may offer more room for configuration and management; whether this translates into effective control, however, also depends on the deployment team's capabilities. The labor required for integration, evaluation, updates, and security maintenance should also be included in total cost.", "Conversely, if a managed service can complete the same tasks at a lower total cost while meeting data, access, and audit requirements, self-deployment may not be more economical. There is no predetermined winner between open and closed approaches here—only a comparison of control, responsibility, and expense under the same acceptance criteria.", "Open interfaces do not mean open models. The shared device specification discussed in Anthropic's announcement listing can prompt separate examination of the interface layer, but cannot establish openness of model weights or licenses, much less imply that a cross-vendor ecosystem has already formed.[S9]"]}, {"type": "outlook", "heading": "Next, Look at Tasks That Pass Acceptance, Not Just Release Frequency", "paragraphs": ["The antimicrobial candidate-search case provides a concrete starting point: AI tools can participate in the research search stage, but the summary does not answer questions about ultimate effectiveness, speed, or economic returns.[S6] The other records concerning models, office work, devices, and cloud businesses raise different questions and are insufficient to assemble a conclusion that the global AI industry has completed some particular shift.[S1][S5][S9][S3]", "A more useful next step is to compare completion rates, human intervention time, recovery costs after failure, and total expense under the same tasks and acceptance criteria. Research tasks can track subsequent candidate validation; device agents can be checked for execution and recovery performance within authorized bounds; cloud solutions can connect specific workloads, costs, and user benefits. These are metrics for subsequent testing, not existing achievements.", "If solutions with similar model capabilities produce different outcomes, factors such as task mix, data quality, personnel experience, and computing resources must also be controlled. Only when these conditions are comparable, differences are reproducible, and more targeted tests support the relevant mechanisms can the explanation that permission design, validation processes, or workflow entry points affect outcomes be strengthened.", "Conversely, if model upgrades consistently improve net benefits across different tasks, while additional investment in permissions, validation, and integration produces no significant difference, the assessment of those elements' relative contributions should be revised downward. Such comparisons offer a way to put vendors in China and elsewhere, open models, and managed services into the same results table: ask not which approach leads, but what task it completed and under what conditions."]}], "citations": [{"publisher": "Anthropic", "title": "AnnouncementsSep 1, 2026Our most advanced models for coding and knowledge work. Their research capabilities also offer an early glimpse of how AI models will contribute to scientific progress.", "url": "https://www.anthropic.com/claude-fable-and-mythos-5-1", "published_at": "2026-09-11", "source_type": "publisher-article"}, {"publisher": "arXiv", "title": "Likelihood-free inference with nuisance parameters through normalizing flows", "url": "https://export.arxiv.org/abs/2609.10534v1", "published_at": "2026-09-09T17:58:15Z", "source_type": "research-paper"}, {"publisher": "CNBC", "title": "Oracle's stock edges up on earnings beat as cloud infrastructure revenue more than doubles", "url": "https://www.cnbc.com/2026/09/10/oracle-orcl-q1-earnings-report-2027.html", "published_at": "2026-09-11", "source_type": "news-article"}, {"publisher": "TechCrunch", "title": "Save up to $300 on Disrupt", "url": "https://techcrunch.com/events/techcrunch-disrupt/tickets/?utm_source=tc&utm_medium=ad&utm_campaign=disrupt2026&utm_content=rb&promo=topbanner_rbend", "published_at": "2026-09-11", "source_type": "news-article"}, {"publisher": "The Verge", "title": "Slack can now vibe-code interactive charts and reports inside chats", "url": "https://www.theverge.com/tech/989853/slackforce-surfaces-launch", "published_at": "2026-09-11", "source_type": "news-article"}, {"publisher": "OpenAI", "title": "How a researcher uses Codex and ChatGPT to search for new antimicrobial molecules", "url": "https://openai.com/index/using-codex-chatgpt-to-search-for-new-antimicrobials", "published_at": "2026-09-10T16:00:00Z", "source_type": "publisher-article"}, {"publisher": "Anthropic", "title": "AnnouncementsSep 10, 2026Detecting and countering misuse of AI: September 2026Over the past eight months, our Threat Intelligence team identified and disrupted operations in which threat actors tried to use Claude for malicious activity. In this report, we share case studies from those operations and describe how malicious use of Claude has evolved since our previous threat reports in 2025.", "url": "https://www.anthropic.com/threat-intelligence-report-september-2026", "published_at": "2026-09-11", "source_type": "publisher-article"}, {"publisher": "Anthropic", "title": "AnnouncementsAug 31, 2026Improving our alignment and security effortsOn July 30, we reported three incidents in which Claude models gained unauthorized access to real computer systems. We are conducting an in-depth analysis of both incidents, and planning to work with METR for an independent review. In the meantime, we’re sharing some of the changes we’ve made over the past month.", "url": "https://www.anthropic.com/news/improving-alignment-security-efforts", "published_at": "2026-09-11", "source_type": "publisher-article"}, {"publisher": "Anthropic", "title": "AnnouncementsAug 27, 2026Previewing the Model Hardware StandardWe’re opening a research preview of the Model Hardware Standard (MHS), a shared specification for AI agents to safely operate physical devices, to a first group of scientific research labs and advanced manufacturers.", "url": "https://www.anthropic.com/news/model-hardware-standard-research-preview", "published_at": "2026-09-11", "source_type": "publisher-article"}, {"publisher": "arXiv", "title": "A positive resolution of the gap-entropy conjecture", "url": "https://export.arxiv.org/abs/2609.10529v1", "published_at": "2026-09-09T17:57:11Z", "source_type": "research-paper"}], "knowledge": {"question": {"en": "How should foundation-model and Agent applications be evaluated by task endpoint, action permissions, result verification, and total cost?", "zh": "如何按任务终点、行动权限、结果验证和总成本评估基础模型与Agent应用？"}, "audience": {"en": "Teams procuring or evaluating research AI, office AI, device Agents, and cloud or self-managed deployments.", "zh": "采购或评估科研AI、办公AI、设备Agent，以及云端或自行部署方案的团队。"}, "decision": {"en": "Define what counts as an accepted task, examine execution permissions separately from output quality, and include retries, human review, and operational management when comparing deployment costs.", "zh": "先定义任务验收标准，将执行权限与输出质量分开检查，并在比较部署成本时计入重试、人工复核和运行管理。"}, "contribution": {"en": "The article uses an antimicrobial-candidate search case to distinguish tool use from validated outcomes. It then develops an evaluation framework without treating product announcements, interface previews, or financial headlines as measured deployment results.", "zh": "文章以抗菌候选分子搜索案例区分工具使用与已验证成果，并据此展开评估框架，不把产品公告、接口预览或财务标题当作已经测量的部署成效。"}, "limitation": {"en": "The case summary establishes candidate-search use, not drug efficacy, faster research, or cost savings. The other records largely provide discussion entry points; the article supplies no comparative deployment measurements or basis for ranking Chinese, open-model, and hosted-service routes.", "zh": "案例摘要支持候选搜索环节的工具使用，不支持药效、研发提速或成本节约。其他记录主要提供讨论入口；文章没有提供部署对比测量，也不足以对中国方案、开放模型和托管服务路线进行排名。"}, "nodes": [{"key": "n1", "kind": "entity", "name": {"en": "César de la Fuente laboratory", "zh": "César de la Fuente实验室"}, "mention": "César de la Fuente实验室", "id": "entity-668df80d29fc13080eb8"}, {"key": "n2", "kind": "entity", "name": {"en": "OpenAI Codex and ChatGPT", "zh": "OpenAI Codex与ChatGPT"}, "mention": "Codex与ChatGPT", "id": "entity-983fd88d43ee2228c2f9"}, {"key": "n3", "kind": "concept", "name": {"en": "Tool permissions", "zh": "工具权限"}, "mention": "工具权限", "id": "concept-ef0b3470f96657bcd45a"}, {"key": "n4", "kind": "concept", "name": {"en": "Result verification", "zh": "结果验证"}, "mention": "结果验证", "id": "concept-4ccde7906a9515ab4ffa"}, {"key": "n5", "kind": "concept", "name": {"en": "Total cost of completing a qualified task", "zh": "完成一个合格任务的总成本"}, "mention": "完成一个合格任务需要多少总成本", "id": "concept-7ff6c489ba62182ba3af"}, {"key": "n6", "kind": "concept", "name": {"en": "Cloud-based AI solutions", "zh": "云端AI方案"}, "mention": "云端AI方案", "id": "concept-dce7f7545160713036b4"}], "edges": [{"source": "n1", "target": "n2", "relation": "uses", "stance": "reported", "citationRole": "direct", "explanation": {"en": "The article reports OpenAI's description of the laboratory using Codex and ChatGPT to search genomes for antimicrobial candidates. Source 6 directly supports this use, but does not establish effective drugs, research acceleration, or economic returns.", "zh": "文章转述OpenAI对实验室使用Codex与ChatGPT搜索基因组中抗菌候选分子的介绍。来源6直接支持这一使用关系，但不证明已经获得有效药物、研发提速或经济回报。"}, "quote": {"en": "In a case summary published on September 10, 2026, OpenAI described how César de la Fuente's laboratory uses Codex and ChatGPT to search the genomes of living and extinct organisms for antimicrobial candidates.[S6]", "zh": "OpenAI在2026年9月10日发布的案例摘要中介绍，César de la Fuente实验室使用Codex与ChatGPT，搜索现生及已灭绝生物的基因组，寻找抗菌候选分子。[S6]"}, "citations": [6], "sourceId": "entity-668df80d29fc13080eb8", "targetId": "entity-983fd88d43ee2228c2f9"}, {"source": "n3", "target": "n4", "relation": "compares", "stance": "hypothesis", "citationRole": "background", "explanation": {"en": "In its section on execution permissions, the original article develops two conditional failure scenarios to distinguish permission review from result verification. Neither check is presented as a substitute for the other. Sources 7–9 provide background on misuse, unauthorized access, and device-operation proposals, not proof of these scenarios.", "zh": "原文在执行权限一节提出两种条件性失效情形，用于区分权限审查与结果验证，未将任何一项视为另一项的替代。来源7至9提供恶意使用、越权访问和设备操作方案的背景，并非这些推演的证明。"}, "quote": {"en": "In deployment analysis, one can propose a conditional judgment: if a company checks only model answers without reviewing tool permissions, it may miss risks in execution; if it only restricts access without checking output quality, it may also obtain task outputs that comply with permissions but are incorrect. Therefore, permission controls, user management, and result verification are best evaluated separately rather than replaced by a single 'safety' label.", "zh": "在部署分析中，可以提出一个条件性判断：如果企业只检查模型回答，却没有审查工具权限，就可能漏掉执行环节的风险；如果只限制访问范围，却不检查输出质量，也可能得到权限合规但结果错误的任务产物。因此，权限控制、使用者管理和结果验证适合分项评估，而不是用一个“安全”标签替代。"}, "citations": [7, 8, 9], "sourceId": "concept-ef0b3470f96657bcd45a", "targetId": "concept-4ccde7906a9515ab4ffa"}, {"source": "n5", "target": "n6", "relation": "measures", "stance": "analysis", "citationRole": "background", "explanation": {"en": "The original article's cloud-cost section proposes cost per accepted task as an evaluation measure, including calls, retries, human review, and operational management. This is an analytical recommendation, not a reported measurement. Source 3 supplies the financial discussion entry point, not validation of the metric or evidence of user savings.", "zh": "原文云成本一节建议以每个通过验收的任务成本作为评估指标，计入调用、重试、人工复核和运行管理。这是分析建议，不是已经报告的测量结果。来源3提供财务讨论入口，并不验证该指标或证明用户已经节约成本。"}, "quote": {"en": "Therefore, cloud-based AI solutions can be evaluated by 'how much each task that passes acceptance costs,' including calls, retries, human review, and operational management.", "zh": "因此，可以用“每个通过验收的任务花了多少钱”来评估云端AI方案，并计入调用、重试、人工复核和运行管理。"}, "citations": [3], "sourceId": "concept-7ff6c489ba62182ba3af", "targetId": "concept-dce7f7545160713036b4"}, {"source": "n5", "target": "n4", "relation": "depends_on", "stance": "analysis", "citationRole": "background", "explanation": {"en": "In its research-versus-office comparison, the original article argues that evaluating task costs must account for verification work rather than generation speed alone. The dependency concerns cost accounting, not a measured causal effect. Sources 5 and 6 provide the office-work discussion prompt and research-search case as background.", "zh": "原文在科研与办公的比较中提出，评估任务成本应计入验证工作，不能只看生成速度。这里的依赖关系指成本核算需要考虑验证投入，而非已经测得的因果效果。来源5和6分别提供办公流程的讨论入口与科研搜索案例背景。"}, "quote": {"en": "For office solutions, one can include human checking and revision before assessing whether time is saved; for research solutions, one can track candidates' subsequent performance and compare search results under equal resources. Comparing generation speed alone may overlook the verification costs borne by users.", "zh": "对办公方案，可以计入人工核对和修改后，再看是否省时；对科研方案，可以追踪候选对象的后续表现，并比较相同资源下的搜索结果。只比较生成速度，可能忽略用户承担的验证成本。"}, "citations": [5, 6], "sourceId": "concept-7ff6c489ba62182ba3af", "targetId": "concept-4ccde7906a9515ab4ffa"}]}, "knowledgeMap": "/knowledge", "license": {"model": "open", "price": 0.002, "currency": "USDC", "paymentProtocol": "x402", "network": "eip155:84532", "payTo": "0x23a885262A89c32eB582f4439184769dA22c467c", "variants": {"A": "/agent/v1/articles/ai-research-20260911-0014-1194?lang=en", "B": "/agent/v1/articles/ai-research-20260911-0014-1194/paid?lang=en"}}, "accessVariant": "A", "contentPolicy": {"citationAllowed": true, "attributionRequired": true, "trainingUse": "contact publisher"}}