What Can AI Do Well Today & What Is Still Mostly Hype?

Here's my honest breakdown after 18 months of real deployment: What works brilliantly, writing assistance, summarisation, first-draft generation, code completion, data extraction from documents. What's overhyped, autonomous agents completing multi-step business processes without supervision, AI 'reasoning' in high-stakes decisions, and anything that requires consistent factual accuracy. The PwC survey finding that 56% of CEOs haven't realised any revenue or cost benefit from AI investments tells...

The Stanford AI Index 2025 data is instructive here (https://news.stanford.edu/stories/2025/12/stanford-ai-experts-predict-what-will-happen-in-2026). AI now exceeds human performance on many standardised benchmarks, but those benchmarks were designed for humans, not for the messy, ambiguous, context-dependent problems that define real work. The gap between 'benchmark performance' and 'real-world reliability' is the central unresolved problem in applied AI. Until we have better ways to measure re...

What AI does brilliantly today: Code translation and legacy system modernisation. We use LLMs to translate 30-year-old COBOL banking systems into modern Python or Rust. It's tedious, pattern-based work that humans hate and AI excels at. What is pure hype: 'Autonomous AI Hackers.' The idea that an LLM can autonomously breach a secure, modern enterprise network is science fiction (https://www.blackhat.com/us-23/briefings/schedule/#the-reality-of-ai-in-offensive-security-32145). They are great at w...

What works today: 'Style Transfer.' AI is incredible at taking the substance of one thing and applying the style of another (e.g., rewriting a technical manual in the style of Shakespeare, or making a photograph look like a Van Gogh). What is hype: 'Original Ideation.' AI cannot generate a truly novel paradigm. It interpolates existing data (https://hai.stanford.edu/news/can-ai-be-truly-creative). It can mix jazz and country music perfectly, but it could never have invented jazz in the first pla...

From a creative perspective, image generation has exceeded expectations, Midjourney v6 and Flux produce work that would have seemed impossible 3 years ago. But AI video is still mostly hype for professional use. The outputs are impressive for 5-second clips but fall apart at anything longer or more complex (https://www.youtube.com/watch?v=TR2kj3CQLSM). ElevenLabs voice cloning is the sleeper hit nobody talks about enough, the quality is extraordinary and the use cases are real. Which creative AI...

My personal test: I give any new AI tool a task I already know the answer to, and I check not just whether it gets it right, but how it handles being wrong. The tools that say 'I'm not sure' or 'you should verify this' are the ones I trust. The ones that give confident wrong answers with no hedging are the ones I'm most cautious about in production.

@AcademicObserver The benchmark problem is real, but I'd add another dimension: the security and reliability of AI systems in adversarial conditions. In my field, AI-powered threat detection is excellent, until someone deliberately tries to fool it. Adversarial robustness is almost never discussed in the hype cycle, but it's the first thing we ask about in enterprise deployments.

@EthicalHacker Yes! We have state unemployment systems running on mainframes from the 1980s. The original programmers are literally retiring or dying. AI code translation is the only way we are going to migrate these systems before they collapse. It's the most unsexy, but most vital, use case of AI today.

This is why 'AI for Legacy Migration' startups are getting massive valuations right now. It's a proven, high-ROI use case with immediate enterprise demand, unlike the speculative 'AI agent' startups.

The McKinsey State of AI report is worth reading here, they found that the use cases with the highest adoption and satisfaction are the narrow, well-defined ones: code generation, document summarisation, customer service triage (https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai). The use cases with the most hype and the lowest satisfaction are the broad, open-ended ones. The pattern is consistent: AI is excellent at well-scoped tasks and unreliable at open-ended jud...