Neuryte AI
Transformer Model Inference and Training on the Edge.
Neuryte AB is a Stockholm based company specializing in low-level AI implementations.
Our modular Transformer Engine is built from scratch for resource constrained environments and supports online training for an arbitrary number of transformer models working in tandem.
Built upon this engine is our first application, Neuryte LLLM, running a 7 billion parameter base large language model and multiple user fine-tunable adapters on top. The LLLM can be used as a complement for more powerful language models, for quick local question answering and auto-completion which never leaves your device.