What is the difference between loop engineering and hyperparameter search?
What is the difference between loop engineering and hyperparameter search? I mean, sure, LLMs add a new textual dimension to hyperparameter search. You used to write a program to write a program from some parameters (how many layers, hidden dimension, which inputs, how often to drop, what momentum, ... note: in practice limit the choices), and now you just tell an LLM to try them. Then run and collect results. People did this in 1990. Hell, I've done "compile options search" with this principle. Just a big python array with options, run through them, benchmark. Then decide it's taking to long and find some way to "intelligently" run through them. Boom, "loop engineering". I hate that everything keeps getting renamed. Give me back my HAAR cascades!
Posted by spwa4 on Jul 27, 2026, 6:22 PM
Tags
Related issues
- I wish there was something that could be done beyond feeling powerless.
- I don’t hate taxes per se but I hate that the government will take tax dollars earmarked for one purpose, which is how they got the tax a...
- I've never thought SF Symbols were beautiful.
- > conservatives don't like being told that their ideas, while legally allowed, are not welcome in polite company As long as there are a ...
- Yeah but this AI music is worse than any AI produced code.
- I wish there was a way I could get educational-only youtube as an adult.
Raise real-world problems, find people facing the same issue, and discuss solutions.2,000 issues0 comments
complaint (Other)
I wish there was something that could be done beyond feeling powerless.
NewI don’t hate taxes per se but I hate that the government will take tax dollars earmarked for one purpose, which is how they got the tax a...
NewI've never thought SF Symbols were beautiful.
New> conservatives don't like being told that their ideas, while legally allowed, are not welcome in polite company As long as there are a ...
NewYeah but this AI music is worse than any AI produced code.
I wish there was a way I could get educational-only youtube as an adult.
people say taste is the differentiator but I hate that because taste is personal, whereas culture is communal taste without curation for...
I've always enjoyed hacking on random projects and AI does that really well.
What is the difference between loop engineering and hyperparameter search?
What is the difference between loop engineering and hyperparameter search? I mean, sure, LLMs add a new textual dimension to hyperparameter search. You used to write a program to write a program from some parameters (how many layers, hidden dimension, which inputs, how often to drop, what momentum, ... note: in practice limit the choices), and now you just tell an LLM to try them. Then run and collect results. People did this in 1990. Hell, I've done "compile options search" with this principle. Just a big python array with options, run through them, benchmark. Then decide it's taking to long and find some way to "intelligently" run through them. Boom, "loop engineering". I hate that everything keeps getting renamed. Give me back my HAAR cascades!
Comments (0)
No comments yet. Start the discussion.