Gemma locally on iOS, Android, web browsers, and GPUs with a single framework

crowwork · 2 years ago

2b model running at 20tok/sec on iphone, nice potential for future applications