Why AI department needs data engineering team
After hiring me three months ago for data engineering position head of AI department in my company(big corporation) told me recently that he is not sure whether they need to have data engineering team at all since it makes doing a lot of stuff more cumbersome for AI engineers. What should I tell him?
As an AI engineer for a few months last year working on prototypes, one takeaway was that we didn’t plan enough time for doing data preparation. Models do better with better data, and that takes time. We were ALWAYS looking to incorporate new sources of data, and that takes time.
May be you should seek more information and understand the basis for his stance. What assumptions did he make while hiring you? What changed? What are the data points that demonstrated your department is making it cumbersome?