Discussion about this post

User's avatar
Paul Shearer's avatar

If you'll indulge me to make some assertions that I can't fully justify in the moment - I think there is a common theme to our thinking, which I will call incremental satisficing in conceptual space.

Satisficing is traditionally thought of as creating good enough solutions to problems. The idea here is to apply it to the concepts we form during education. That is, maybe it's okay to give a person a concept that is "wrong" from a higher vantage point, but functional, because it can be considered just a step on the ladder to enlightenment.

My recent post on the Glitch Gremlin is an example of this. You might perhaps want to never need gremlins. Ideally, you want to simply know the optimal way to apply your capabilities to all problems, and assign the optimal amount of emotional regret to yourself and others when you make a mistake or suboptimal choice. That Ultimate Optimal solution might not involve gremlins, but the "good enough solution for now" might.

I also think the Ultimate Optimal solution might actually involve gremlins. I'm not totally discounting that possibility!

Paul Shearer's avatar

About time that I caught up on your posts a bit 💪 I'll probably have several comments. I'll fire them off as I think of them.

My first is on the Gorgias Problem. This problem is induced by incomplete specification + optimization. In other words, it is almost ALWAYS the case that when you specify an optimization problem incompletely, the best solution will NOT be exactly what you want.

This is a fundamental, universal problem that extends all the way to things like fitting lines to data by least squares. The "best" solution, in the sense of minimizing squared error, is almost never the true solution, because the unknown truth cannot be included as a constraint in the specification.

This is the wellspring of many strange phenomena. For example, it's long been known in machine learning research that it can be beneficial to stop early when optimizing the fit of a model to data, because fully optimizing the fit eventually sends you past (the closest approach to) what you wanted and into the regime where you're overfitting, making the solution worse while still improving the optimization criterion.

22 more comments...

No posts

Ready for more?