Download the working app here!
TinyStories On-Device
https://github.com/klyap/swift-coreml-transformers-demo/tree/master
This template should work* if you:
- want to run a LLM model that uses GPT2 tokenizer on-device for iOS
- ie. gpt2, gpt_bigcode, gpt_neo, gpt_neox, gptj, opt
- have a Mac computer with XCode installed - only way to develop iOS apps (I tried this on M1 Macbook)
*DM me if this doesn’t work so I can update this 😅
Get Started
Notes
Deploy!
XCode Troubleshooting