Cloud Nine AI is a cutting-edge, reusable technology built for modern AI-native application development. Designed with a local-first approach and native to the web platform, it integrates seamlessly with large language models (LLMs) and APIs for speech-to-text, text-to-speech, text generation, image generation, and agentic workflows.
This platform provides unparalleled flexibility, enabling deployment across Cloudflare, Microsoft Azure, Google Cloud, or local environments. It’s the ultimate AI stack for developers, businesses, and researchers aiming to harness the power of modern web technologies and AI capabilities.
- Run Offline: Models can be downloaded and executed entirely offline using an Electron app (coming soon), enabling privacy and control on macOS or Windows.
- Web-Native: Fully operational on modern web platforms, leveraging native APIs such as:
- User Media APIs for capturing audio, video, or other user inputs.
- Service Workers for offline capabilities and caching.
- WebSockets or WebRTC for real-time collaboration.
- IndexedDB for robust local data storage.
- Connect with OpenAI, Azure AI, Google Cloud, or custom APIs for:
- Speech-to-Text
- Text-to-Speech
- Text and Image Generation
- Avatar and Lip-Sync Generation
- Application Prompt Generation
- Deploy to Cloudflare for edge performance.
- Integrate with Microsoft Azure or Google Cloud for enterprise-scale solutions.
- Flexible architecture to meet unique client needs, whether local, hybrid, or fully cloud-based.
- Agentic Workflows: Build interactive applications with conversational agents and task automation.
- Background Execution: Execute background jobs for tasks like data processing, model inference, and API calls.
- Multimodal Support: Process and generate text, images, speech, and more.
- Customizable Models: Use open-source or proprietary LLMs for your specific use cases.
- Node.js installed locally
- Cloud service credentials (if using APIs like OpenAI or Azure)
- Optionally, Electron for offline deployment
- Clone the repository:
git clone https://github.com/scalable-dynamics/oncloudnine.git
cd oncloudnine- Install dependencies:
npm install- Build tools:
npm run-script build- Configure API keys for your preferred services (e.g., OpenAI, Azure) in
config.json:
{
"OPENAI_API_KEY": "sk-...",
"OPENAI_ORGANIZATION_ID": "org-...(optional)",
"OPENAI_API_URL": "https://api.openai.com/v1",
"OPENAI_MODEL": "o1-preview",
"OPENAI_MODEL_RT": "gpt-4o-realtime-preview-2024-12-17",
"OPENAI_INSTRUCTIONS": "You can help the user with anything."
}- Start the platform:
npm start- Open the browser:
http://localhost:8080- Install the Cloudflare Workers CLI:
npm install -g wrangler- Publish:
npm run-script publish- Deploy:
npm run-script deployCloud Nine AI is built with a local-first philosophy, ensuring core functionality runs offline while taking advantage of modern web platform capabilities:
- Native APIs for multimodal inputs such as audio, video, and text.
- Service Workers to enable offline functionality and caching, ensuring seamless experiences in limited connectivity scenarios.
- Background Jobs support for executing tasks like API calls, data processing, and model training asynchronously.
- Hybrid Deployment Options: Use locally stored models, connect to APIs, or mix both approaches for hybrid execution.
The platform supports a highly flexible, modular architecture:
- Dynamically connect to different APIs, LLMs, and AI models for various tasks (e.g., GPT-style models for text, DALL·E for image generation, Whisper for speech).
- Enable different models for specific workflows (e.g., TTS model A for quick responses, model B for high-quality synthesis).
- Customize deployments to align with the specific needs of projects, from local-only to multi-cloud integrations.
- Interactive Chat Applications: Seamlessly integrate GPT, Whisper, and other models to build chatbots and virtual assistants.
- Content Generation: Automate creation of text, images, and speech for media, marketing, and training.
- Agentic Workflows: Design intelligent workflows for modern web applications, including asynchronous task execution.
- Edge Computing: Deploy AI-powered solutions on Cloudflare for low-latency global performance.
- Offline AI Development: Leverage the upcoming Electron app for local model execution.
- Electron App: Full offline capability with local model execution.
- Enhanced Avatar Generation: Improved lip-sync and voice synthesis features.
- Advanced Workflow Designer: Enhanced tools for designing and automating complex workflows, including event-driven triggers and job chaining.
- Expanded Integrations: Additional APIs for niche functionalities such as robotics, IoT, and AR/VR applications.
Our experienced consultants provide tailored support for deploying, integrating, and optimizing Cloud Nine AI to meet your unique business requirements. Services include:
- Cloudflare Deployment: Expertise in deploying AI-powered applications to Cloudflare for fast, edge-based solutions.
- Azure Integration: Support for setting up, deploying, and scaling on Microsoft Azure with robust security and enterprise features.
- Google Cloud Consulting: Custom integrations for Google Cloud services, enabling high-performance AI workflows.
- Model Optimization: Assistance in selecting and tuning the best models for your tasks, including hybrid or proprietary setups.
- Custom Development: Design and implementation of bespoke features or workflows tailored to your needs.
- Ongoing Support: Continuous updates, troubleshooting, and scaling assistance for your Cloud Nine AI deployment.
For consulting inquiries, contact us at [email protected].
This project is licensed under the MIT License.
Cloud Nine AI—the future of AI-native, web-first application development. Join us and take your projects to the next level.