The main challenge is figuring out where things went wrong. The issue could be in an early reasoning step, how context is passed between steps, or a subtle mistake that propagates through the system. By the time I see the final output, it’s not obvious which step caused the problem.
I’ve been using Langfuse for tracing, which helps capture inputs and outputs, but in practice I still end up manually inspecting each step one by one to diagnose issues, which gets tiring quickly.
I’m curious how others are approaching this. Are there better ways to structure or instrument these workflows to make failures easier to localize? Any patterns, tools, or techniques that have worked well for you?