AI doesn't have values, taste, or intent
A recent Hacker News post about the people behind good software made me think about agentic coding and what it’s missing. Here’s a comment I posted there:
Something I’ve been thinking about a lot is that ultimately AI does not have values, intent, and taste. Even with humans, each of us has different values, intent, and taste, although we do share many of these things. As a living human being, you have biological or cultural desires and particular goals that you want to accomplish while you’re alive on this earth.
When you’re creating art or even a product, what you create is a result of your particular values and particular tastes and those drive some sort of purpose for whatever it is you’re creating. What you’re building is, generally, made for the consumption or use by another person (even if indirectly), and we mostly have empathy and want those people to have a good experience with whatever we’re creating. We think about our audience and weigh their particular needs.
When you use good software, you can sense the intent in what was made. The person (or team) combined their particular point of view with that of the goals of the user. At this point, I don’t think agentic coding is going to give you that, at least not fully. It might get most of the shared values and common things right as a result of its training data, but a human still needs to edit the output or steer it on a good path that only they can see and which is part of a larger vision. For simpler needs, taste and values matter less, but for more complex things, it makes a difference, in my opinion.