How Good Is ChatGPT at Coding, Really?

https://spectrum.ieee.org/chatgpt-for-coding

ChatGPT has not been exposed yet to new problems and solutions. It lacks the critical thinking skills of a human and can only address problems it has previously encountered. This could explain why it is so much better at addressing older coding problems than newer ones.

“ChatGPT may generate incorrect code because it does not understand the meaning of algorithm problems, thus, simple error feedback information is not enough,”