Have people started to see cracks in the ChatGPT answers with time

Question

Context: I have a co-worker who is used to execute the suggested scripts from Chat-gpt with high confidence. Lately one of the scripts to use Github API was not working and he asked me to debug. Turns out, Github had changed/updated the attribute names in the output and they no longer matched with the Chat-Gpt provided script. Hard part, this individual is really good engineer, however he/she was low on confidence about how to debug the Chat-gpt provided script

almosthere · Accepted Answer

Don't use chatgpt for that kind of work, use agents. It will read the error message and adapt, perhaps even go as far as open the release notes for the tools you're using and fix the problems it encounters.

speedgoose · Answer

Skill issue.First, switch to Codex. Then, consider using the context7 mcp server to let agents automatically fetch the latest documentation.Debugging is not so different than debugging code written by someone else. It&rsquo;s a skill you can practice.By the way, agents are also good at debugging.

bjourne · Answer

IMnsHO, nope! People trust the bot way more than their own experience.