← 回到學習日誌 Back to Journal

模型一直在換,但你的流程要站得住Models Keep Changing. Your Workflow Should Still Hold.

不要因為模型的名字或分數改變,就急著改掉自己的工作方法。先量清楚一件事怎麼完成、能交給它什麼、最後誰來驗收。Do not rebuild your way of working just because a new model arrives. First measure the job, set the boundary, and decide who verifies the result.

筆記本上的三段流程、筆記型電腦與放大鏡,象徵量測任務、設定邊界與驗收成果
01 看完整任務,不只看單價Measure the whole task, not only the price 02 先劃出 Agent 的操作邊界Set the agent boundary first 03 用結果驗收,不只看它說完成Verify the result, not only the claim
中文版 Chinese version

模型更新很快,但真正要改的是你的流程

這幾天又看到一波新模型、排行榜和示範影片。畫面裡的 Agent 會自己點介面、自己修錯、自己把流程做完,看起來很厲害。

但我覺得真正值得問的,不是「它有沒有比上一個強」,而是:我手上的流程,有沒有因為它而變得更可靠?

New models, rankings, and demos arrive quickly. The better question is not “is it stronger?” but “does it make my workflow more reliable?”

我不想把模型當成一個更會聊天的工具,也不想把它當成不用看管的同事。比較接近的定位是:它可以幫我把一段工作跑得更遠,但我仍然要先畫好跑道。

I do not see a model as just a better chatbot, or as an employee I can ignore. It can take work further, but I still need to define the runway.

第一件事:不要只看單價,要看一件事怎麼完成

以前我很容易先看 token 價格,覺得便宜的模型就是比較省。但如果它在同一個任務裡反覆繞路、改來改去、最後還要我花很多時間收尾,單價再低也不是真的省。

我現在比較想記錄四個數字:

A cheap token is not always a cheap task. I look at steps, total cost, rework, and whether the workflow can be reused.

如果一個新模型能少掉很多來回,或把「做完、執行、看結果、再修」串成更短的閉環,它就值得我試。反過來說,如果只是摘要、翻譯或一問一答就完成的事情,不一定需要換到最強、最貴的模型。

A stronger model earns its place when it shortens the full loop: build, run, inspect, and fix. For simple tasks, the most capable model may be unnecessary.

第二件事:能力變強,權限不能跟著失控

當 Agent 可以操作瀏覽器、終端機或工作資料夾,真正要先想的不是它能做多少,而是它不該碰什麼。

  1. 可以自己做:整理檔案、建立草稿、跑測試、彙整結果。
  2. 可以做,但要在隔離環境:修改程式、建立新檔案、測試外部整合。
  3. 一定要人確認:發送訊息、公開發布、碰正式資料、使用金鑰或改動不可回復的設定。

As agents gain access to browsers, terminals, and files, the first question is not what they can do. It is what they must never touch without a person.

這不是不信任 AI,而是把信任放在正確的位置。能力愈強的工具,愈值得有清楚的邊界、最小權限和可以回頭檢查的紀錄。

This is not distrust. It is placing trust in the right place: clear boundaries, least privilege, and an audit trail.

第三件事:驗收比提示詞更重要

以前我們花很多時間研究怎麼把 prompt 寫得更長、更精準。現在 Agent 能自己把工作往下跑,真正重要的問題慢慢變成:什麼叫做完成?

我會先寫下驗收條件,再讓 Agent 開始做。例如:

As agents do more of the execution, “what counts as done?” matters more than a longer prompt.

我不需要逐行盯著它做,但也不會只看它說「完成」。我要看可以驗證的結果。

這也是人最後還不能省掉的價值:不是把每個步驟做完,而是判斷這個結果能不能真的用。

I do not need to watch every step. But I do need evidence. Human value is increasingly in judging whether the result is truly ready to use.

今晚就能做的四件小事

  1. 挑一個你每週都會做的任務,記錄它原本的時間、步驟和成本。
  2. 選一個低風險版本,讓 Agent 在獨立資料夾或測試環境完成一次。
  3. 在開始前寫下三條「它不能做」的規則。
  4. 在結束前寫下三條「我怎麼知道它做對」的驗收條件。

Pick one recurring task. Test it in a safe space. Set three limits. Define three checks.

不是每次模型更新都要立刻換工具。真正可以累積下來的,是你慢慢建立的流程、邊界和判斷標準。下個月模型名字又會換,但這些東西還會留在你手上。

You do not need to chase every release. Workflows, boundaries, and judgment are the things that compound.

English version

Models Change Quickly. Workflows Should Last.

New models, rankings, and demos arrive quickly. The important question is not whether a model is stronger than the last one. It is whether the way we work becomes more reliable because of it.

I do not treat a model as a chatbot with better answers, or as an employee that needs no supervision. It can take a task further, but I still need to define the runway.

Measure the Whole Task

Token price is only one number. A model that takes fewer steps, needs less rework, and produces a reusable workflow may cost less for the actual job, even when its unit price is higher.

Capability Needs a Boundary

As agents gain browser, terminal, and file access, separate work they may do independently from work that needs isolation and actions that must return to a person. Stronger capability deserves clearer boundaries, least privilege, and a record that can be reviewed later.

Verification Matters More Than a Longer Prompt

When an agent can execute and correct more of the work, define done before it begins: expected format, allowed files, reproducible tests, and a recovery path. Do not only accept “completed”; ask for evidence.

Four Small Things to Do Tonight

Measure one recurring task, try a low-risk version in a safe space, write three limits, and define three checks. You do not need to chase every release. Workflows, boundaries, and judgment are the things that compound.

資料來源與延伸閱讀 Sources: OpenAI: GPT-6 Astra · OpenAI model guidance · ARC Prize: ARC-AGI-3
AI AgentsWorkflowEvaluationSafetyLearning Note