Overview

Oxide Lab is an innovative desktop application designed for running large language models directly on your machine. Built using cutting-edge technologies such as Rust and Tauri v2, it offers a seamless and fast chat interface while ensuring your data remains private and secure, without the need for internet connectivity or external APIs. This makes it an ideal solution for users who value privacy and the convenience of local processing.

With Oxide Lab, you can effortlessly engage in text generation across different models and architectures, making it not only powerful but versatile for various use cases. Whether you’re a researcher, developer, or enthusiast, this tool provides the functionality you need to explore large language models on your own terms.

Features

• 100% Local Inference: All processing occurs on your device, ensuring that your data remains private and never leaves your machine.
• Multi-Architecture Support: Compatible with various models including Llama, Qwen, Mistral, and more, as well as formats like GGUF and SafeTensors.
• Hardware Acceleration: Supports CPU and GPU acceleration using CUDA for NVIDIA and Metal for Apple Silicon, optimizing performance for larger models.
• Streaming Text Generation: Generate text dynamically, allowing for more interactive and engaging conversations without delay.
• Multi-Language UI: Enjoy a user-friendly experience in multiple languages including English, Russian, and Brazilian Portuguese.
• Modern Interface: Built with Svelte 5 and Tailwind CSS, the application boasts an intuitive and modern design that enhances user interaction.
• Robust Security: With no telemetry or data collection and a strict Content Security Policy, your information remains protected while using the application.