Pythia: A Suite for Analyzing Large Language Models ... - arXiv

With proper care, the easily lasts 5+ years – a testament to its HIGH Q construction.