With recent GPT-3 hype, I tried it with AI Dungeon and found it even more dumb. It's only a clever like a clever talker who can jump into any discussion and become the center of attention following the pattern of what's being discussed and adding more to it which sounds intersting despite not making any sense.
Is there any system capable of understanding what is being asked? just a simple question like repeating what you have told it?
Yesterday I read an article listed in HN, stating that the brain process spacial information together with visual information.
I would like to know if a transformer model is capable of learning current context: Maybe using some other form of neural net combined with other Bidirectional Transformer. That would work as a chatbot engine, though.