Mar Java Mit Java Blog

Explaining the Blackboard design pattern in LangGraph

Blackboard If the problem is always the same the previous architectures might have worked … but what if the best next step depends on the results of the previous one? A rigid sequence can...

How are embeddings multiplied with weight matrices

Let’s walk through exactly how WQW_QWQ​ (the query weight matrix) is multiplied with the input embedding, using a small example with embedding size = 5. 🧠 Context: What is WQW_QWQ​? In a Transformer, we...

How does attention changes context and embeddings

🟦 1. What is a word embedding? Let’s say a model reads this sentence: “The cat sat on the mat.“ Each word like “cat”, “mat”, “sat” is turned into a vector — imagine this...