LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML

Compilers are all you need. How XGBoost and TVM were created, and the future of universal model deployments with MLC!