Distantmagic

Our mission is to provide open-source tools that enable the effective deployment and use of LLMs and ML models in production settings for developers and MLOps/LLMOps.

Open Source:

1. LLMOps Handbook (Work in progress) Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices.
2. Paddler Stateful load balancer custom-tailored for llama.cpp
3. Resonance PHP Framework for IO-intensive applications

Contact us:

1. Discord Join our community
2. GitHub This is where we keep our open source projects
3. LinkedIn Mateusz Charytoniuk