All Human Knowledge in 40 GB

All human knowledge can be compressed into ~40 GB. We're not that smart. Yet. Name Quant method Size llama-2-70b.ggmlv3.q3_K_M.bin q3_K_M 33.04 GB llama-2-70b.ggmlv3.q3_K_S.bin q3_K_S 29.75 GB llama-2-70b.ggmlv3.q4_0.bin q4_0 38.87 GB llama-2-70b.ggmlv3.q4_1.bin q4_1 43.17 GB Readers added context they thought people might want to know Llama 2 does not contain all human knowledge. For example, if you ask it "Did the Mayans administer enemas?" it will reply "I'm not aware of any historical evidence that suggests the Mayans administered enemas" despite the linked 1986 paper with such evidence.

A screenshot of a social media post claims that all human knowledge can fit into roughly 40 GB, showing file sizes for compressed Llama 2 language models. A community context note points out that Llama 2 does not actually contain all human knowledge, humorously disproving the boast with a bizarre example about Mayan enemas. The meme is used to mock exaggerated claims about AI knowledge and model compression. EN: A screenshot of a social media post claims that all human knowledge can fit into roughly 40 GB, showing file sizes for compressed Llama 2 language models. A community context note points out that Llama 2 does not actually contain all human knowledge, humorously disproving the boast with a bizarre example about Mayan enemas. The meme is used to mock exaggerated claims about AI knowledge and model compression.

• @gentoomemes / 8574 2024-01-08