Now that llm's are starting to get pretty good how has your company's adapted to the new environment. It's no longer good enough to see if someone's good a programing, instead we need to screen if someone is good at engineering. In my experience Software Engineering is starting to mature like other forms of engineering. Mechanical Engineers don't mill out their parts (Well they should at least a couple of times to understand the constraints of machining). SWE's need to see if the code is "good" (Mech E's test their parts) and then design the systems around them. As far as I can see there are two ways of going forwards.1. Only do on sites and eat the travel expenses
2. Test for systems design and culture fit
On sites allow for a level playing field where interviewees don't need to compete for the [best person hiding their llm use](https://www.reddit.com/r/technology/comments/1j436it/a_student_used_ai_to_beat_amazons_brutal/).
What are people's thoughts?