Does it make sense to do research in fine tuning?
Hi, I'm studying machine learning and I'm interested in starting research in the field of fine-tuning. Do you think it makes sense to pursue this? Or is it a domain where it's difficult to publish papers and conduct research? I like the fact that fine-tuning is something that can be easily applied and used in companies.
Your question is very broad.
Being a PhD student, I can only say that fine-tuning happens all the time.
Research in particular areas require fine-tuning pre-trained models on specific tasks, taking advantage of the amount of data seen during pre-training.
It's unlikely that your thesis will be solely about fine-tuning. However, chances are you will fine-tune many models during your thesis, for various tasks depending on your field of research.