Hugging Face's logo
Karsten Kuhnke's picture
In a Training Loop 🔄
4 47 78

Karsten Kuhnke PRO

mindchain
Goenzilla's profile picture simeks18's profile picture evalstate's profile picture
·
https://www.linkedin.com/in/jankarstenkuhnke/

AI & ML interests

Mechanistic Interpretability, Sparse Autoencoders, JumpReLU, Reward Modeling, RLHF, AI Alignment, Function Calling, Gemma, Nemotron

Recent Activity

reacted to their post with 🧠 about 7 hours ago
The Architecture of 2026: Beyond the Token Trap 🚀 We are witnessing a tectonic shift in Transformer architecture. It’s no longer just about "predicting the next token"—it’s about executing latent plans on a high-speed data highway. What happens when we combine DeepSeek’s stability with Google’s strategic intelligence? 1️⃣ The Infrastructure: DeepSeek’s mHC Moving from a single-lane residual stream to a multi-lane highway. Using the Birkhoff Polytope, mHC ensures mathematical stability (Identity Mapping) while routing specialized data through dedicated lanes. 2️⃣ The Intelligence: Google’s Meta-Controller An internal AI unit that lives inside the Transformer. It escapes the "Token Trap" by extracting data to create a latent plan, steering the model via Temporal Abstraction. The Synergy: In a Topological Transformer, the Meta-Controller finally has the "dedicated lanes" it needs to steer complex reasoning without causing gradient explosions. We aren't just making models bigger; we are making them architecturally smarter. 🧠 #MachineLearning #DeepSeek #GoogleAI #Transformer #AIArchitecture
upvoted a paper about 10 hours ago
DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models
updated a collection about 17 hours ago
RLM - Neuro-Symbolic Architecture - Reasonig Traces
View all activity

Organizations

lora concepts library's profile picture Multi🤖Transformers's profile picture haddock's profile picture