Karpathy "memories have naive RAG-like implementations" — cringe at current AI memory

Karpathy guesses AI memory issues stem from "naive RAG-like implementations" where top-k retrieval via embeddings fails to distinguish fleeting vs. important. He cites compute constraints preventing aggregate processing over time. Calls it "cringe" — a rare blunt critique from the former OpenAI researcher, likely aimed at current chatbot memory features.

• #karpathy
• #ai-memory
• #rag
• #llm-limitations

Andrej Karpathy@karpathy