Author: marjavamitjava

Explaining the Blackboard design pattern in LangGraph

Blackboard If the problem is always the same the previous architectures might have worked … but what if the best next step depends on the results of the previous one? A rigid sequence can...

How are embeddings multiplied with weight matrices

Let’s walk through exactly how WQW_QWQ​ (the query weight matrix) is multiplied with the input embedding, using a small example with embedding size = 5. 🧠 Context: What is WQW_QWQ​? In a Transformer, we...