Software Architecture in an AI World

Unbundling the Graph in GraphRAG

One popular term encountered in generative AI practice is retrieval-augmented generation (RAG). Reasons for using RAG are clear: large language models (LLMs), which are effectively syntax engines, tend to “hallucinate” by inventing answers from pieces of their training data. The haphazard results may be entertaining, although not quite based in fact. RAG provides a way […]

Published: 2024-11-19 11:30:46

Blown Away

Between vacation, end-of-year projects, the coming holidays, and other hysteria, I haven’t come up with an article this month. So here’s a quick list of things that have amazed me recently. Are we virtual yet? I’m far from the first person to find NotebookLM amazing, and I certainly won’t be the last. I did a […]

Published: 2024-11-12 10:59:36

Radar Trends to Watch: November 2024

October had many language model releases. The mid-size models, and even the small models, are catching up to frontier models like GPT-4.5o in performance. But the release that blew us all away wasn’t a language model: It was Claude’s computer use API. Computer use allows you to teach Claude how to use a computer: how […]

Published: 2024-11-05 11:04:37

Beyond Skills: Unlocking the Full Potential of Data Scientists

Modern organizations regard data as a strategic asset that drives efficiency, enhances decision making, and creates new value for customers. Across the organization—product management, marketing, operations, finance, and more—teams are overflowing with ideas on how data can elevate the business. To bring these ideas to life, companies are eagerly hiring data scientists for their technical […]

Published: 2024-10-29 10:25:04

Rift Between Junior and Senior Developers

I’m worried about AI. I’m not worried about it taking my job. I believe AI is a genuine productivity tool. By which I mean it can make developers produce more. The question is whether those developers are producing something good or not. The difference between an experienced developer and a junior is that an experienced […]

Published: 2024-10-22 10:00:12

Henry Ford Does AI

Back in August, I cavalierly said that AI couldn’t design a car if it hadn’t seen one first, and I alluded to Henry Ford’s apocryphal statement “If I had asked people what they wanted, they would have said faster horses.” I’m not backing down on any of that, but the history of technology is always […]

Published: 2024-10-15 10:08:48

The State of Security in 2024

In August 2024, we asked our customers to tell us about security: their role in security, their certifications, their concerns, and what their companies are doing to address those concerns. We had 1,322 complete responses, of which 419 (32%—roughly one-third) are members of a security team. 903 respondents aren’t on a security team, although 19% […]

Published: 2024-10-08 10:05:42

Radar Trends to Watch: October 2024

The model release train continues, with Mistral’s multimodal Pixtral 12B, OpenAI’s o1 models, and Roblox’s model for building 3D scenes. We also have another important AI-enabled programming tool: Cursor is an alternative to GitHub Copilot that’s getting rave reviews. Security will never cease to be a problem, but this month seems particularly problematic. The Mirai […]

Published: 2024-10-01 09:55:29

Preparing for AI

AI is everywhere—we’re in a middle of a technology shift that’s as big as (and possibly bigger than) the arrival of the web in the 1990s. Even though ChatGPT appeared almost two years ago, we still feel unprepared: we read that AI will change every job, but we don’t know what that means or how […]

Published: 2024-09-17 10:04:49

The AI Blues

A recent article in Computerworld argued that the output from generative AI systems, like GPT and Gemini, isn’t as good as it used to be. It isn’t the first time I’ve heard this complaint, though I don’t know how widely held that opinion is. But I wonder: Is it correct? And if so, why? I […]

Published: 2024-09-10 09:53:05

Radar Trends to Watch: September 2024

This month, we’ll give AI a rest. Alex Russell has finished an excellent series of posts titled “Reckoning.” It’s a must-read for web developers. If you want to understand why our networks and laptops are much faster than they were 15 or 20 years ago, but the web is slower, it comes down to one […]

Published: 2024-09-03 10:00:09

Platform Engineering: The Next Step in Operations

Platform engineering is the latest buzzword in IT operations. And like all other buzzwords, it’s in danger of becoming meaningless—in danger of meaning whatever some company with a “platform engineering” product wants to sell. We’ve seen that happen to too many useful concepts: Edge computing meant everything from caches at a cloud provider’s data center […]

Published: 2024-08-20 10:10:40

Think Better

Over the years, many of us have become accustomed to letting computers do our thinking for us. “That’s what the computer says” is a refrain in many bad customer service interactions. “That’s what the data says” is a variation—“the data” doesn’t say much if you don’t know how it was collected and how the data […]

Published: 2024-08-13 17:22:32

Radar Trends to Watch: August 2024

July was a big month for model releases: There are new large models from Mistral and Meta, smaller multilingual models from Mistral and DeepL, another Mistral model that specializes in code generation, and a small version of GPT-4o. The security world saw another software supply chain disaster when CrowdStrike released a bad software update that […]

Published: 2024-08-06 10:02:43