Do you use the ChatGPT or other LLMs to auto-generate unit test code?

As developers, we understand the importance of unit testing in ensuring the functionality and reliability of our code. However, many of us dread implementing unit tests because of the time-consuming nature of the task. Moreover, generating effective test mock data requires a thorough understanding of the Product Requirements Document (PRD) and the underlying business logic.

Enter ChatGPT and other large language models (LLMs) – these AI-driven tools have proven their ability to automatically generate various types of work, potentially including unit test code. By leveraging the capabilities of these AI models, we could significantly reduce the time and effort required for creating unit tests, thus increasing overall efficiency and code quality.

In light of these developments, I would like to open up a discussion on the following topics:

1. Have you had any experience using ChatGPT API or other LLMs to auto-generate unit test code? If so, what was the outcome and how effective was the generated code?

2. What challenges do you foresee when implementing AI-generated unit tests? Are there any potential drawbacks or limitations in using this approach?

3. Can AI-generated unit tests truly grasp the intricacies of PRDs and business logic to create accurate and relevant test mock data?

4 How do you think the adoption of AI-generated unit tests will impact the future of software development?