Tagged "real-time-inference"
- Tiny microphone on my balcony to listen for any birds passing by
- Real-time LLM Inference on Standard GPUs: 3k tokens/s per request
- Privacy-Focused Raspberry Pi Zero 2W DIY Security Camera with On-Device AI and End-to-End Encryption
- New 8B Local LLM Design Marks Biggest Shift Since DeepSeek R1
- Nvidia Raises Video Encoder Limit to 12 on Consumer GPUs
- Hardware LLM Taalas Reaches >14,000 TPS on Llama 3.1 8B
- Kog AI – Building a Real-Time Inference Stack on AMD Instinct GPUs
- DFlash Speculative Decoding Delivers 8.5x Speed Improvement for LLM Inference
- What Type of AI Usage? Deployment Patterns and Implementation Considerations
- Waterloo's Live AI-Goose Tracker: Real-Time Edge Vision
- LlaMa.cpp Robot Wars
- 115 TOPS in 0.67L: CHUWI AuBox X Packs On-Device AI Power Into a Palm-Sized Mini PC
- DFlash Doubles Token Generation Speed of Qwen3.5 27B on Mac M5 Max
- Google Gemma 4 Delivers Exceptional Speed and Accuracy for Local Inference
- DFlash Speculative Decoding Achieves 3.3x Speedup on Apple Silicon
- CarryAI's Serverless Vision-Language Models Enable On-Device Multimodal AI
- Lenovo Korea Launches AI-Powered Industrial Edge Solutions
- A Journey to a Reliable and Enjoyable Locally Hosted Voice Assistant
- AI-Native Store Research
- Arduino, Qualcomm Bring On-Device AI and Robotics Learning to Indian School Systems
- The Path to Ubiquitous AI (17k tokens/sec)