news in 60 seconds
← Back to home
Tech11 hr ago

Writer's AI efficiency trick cuts costs by 40% without hurting performance

By TrendingWire Newsroom

Enterprises using AI face a cost problem: throwing more computing power at tasks works in testing but becomes too expensive in real use. A new study from AI company Writer offers a practical fix. Instead of changing the underlying AI model, the researchers optimized the 'harness' — the software layer that connects the model to applications. By improving how the harness manages prompts, caches data, and delegates tasks, they cut token usage by 38% and reduced the cost per successful task by up to 61%. Task success rates actually improved slightly, from 78% to 81%. The key changes include separating stable instructions from changing queries to reuse cached data, moving old conversation history out of the main prompt, and using small sub-agents for specific jobs. These techniques are under the developer's control and don't require retraining the AI model. The study tested six different models from various vendors, including Writer's own Palmyra X6, on 22 enterprise tasks. The approach works best with stronger models; smaller ones struggled with sub-agent delegation. For companies scaling AI to millions of requests daily, these optimizations can lead to major savings. The researchers warn that developers should avoid 'tokenmaxxing' — relying on huge context windows and brute-force retries. Instead, they recommend structured prompts, context offloading, and hard budget limits on each task. As AI models improve, the harness will focus more on enforcing company policies like budgets and permissions rather than compensating for model weaknesses.

Sources: VentureBeat
More in Tech
Tech7 min ago
Malaysia Passes New Cybercrime Law to Fight Online Fraud and AI Misuse
Malaysia is updating its cybercrime rules for the first time in nearly 30 years. The new Cybercrimes Bill 2026 was approved by the lower house of parliament on July 1 and later passed by the upper house. It gives authori
SCMP
Tech1 hr ago
Samsung Stock Rises After Company Forms Robotics Division for Physical AI
Samsung Electronics saw its stock price climb after announcing the creation of a new robotics division, signaling a stronger focus on what the company calls 'physical AI.' This move highlights Samsung's ambition to expan
CNBC
Tech8 hr ago
AI Company Anthropic’s $1.5 Billion Copyright Settlement Gets Final Court Approval
A federal judge has given final approval to a $1.5 billion copyright settlement involving Anthropic, the artificial intelligence company behind the Claude chatbot. The settlement resolves a lawsuit that claimed Anthropic
TechCrunch
Tech9 hr ago
UK flying taxi factory plans advance as Bristol firm holds government talks
Flying taxi factories could be built in the UK within the next few years, according to a Bristol-based manufacturer that says it is in advanced discussions with the government. The company, which develops electric vertic
Sky News UK
Tech9 hr ago
De-extinction startup Colossal Biosciences seeks new funding at up to $30 billion valuation
Colossal Biosciences, a company focused on bringing extinct species back to life, is reportedly in discussions to raise new capital at a valuation between $20 billion and $30 billion. That would be double or triple its p
TechCrunch
Tech10 hr ago
Chinese Robot Makers Struggle with Data and AI Brains
At the World Artificial Intelligence Conference (WAIC) in Shanghai, industry insiders said Chinese robotics companies face major hurdles in improving how their robots interact with the physical world. One key problem is
SCMP