PXAI Audio Feed
31/03 15:50 dev.to

LLM Inference Optimization: Techniques That Actually Reduce Latency and Cost

LLM inferenceGPU optimizationvLLMSGLangPrometheusRunpod
29/03 16:23 dev.to

Local LLM Inference in 2026: The Complete Guide to Tools, Hardware & Open-Weight Models

local LLM inferenceOllamaMac Mini M4 ProQ4_K_M quantizationopen‑weight modelsGLM‑5
28/03 20:26 dev.to

TurboQuant: What Developers Need to Know About Google's KV Cache Compression

TurboQuantKV cache compressionLLM inferenceGPU memory optimizationGoogle ResearchICLR 2026
27/03 20:49 dev.to

Copilot CLI Weekly: MCP Servers Get LLM Access

MCPLLM inferencesamplingpermission promptcode analysisrecipe generator
26/03 00:47 dev.to

Alibaba's XuanTie C950 CPU Hits 70+ SPECint2006, Claims RISC-V Record with Native LLM Support

AlibabaXuanTie C950RISC‑VSPECint2006LLM inferenceDAMO Academy
25/03 16:47 marktechpost.com

Paged Attention in Large Language Models LLMs

Paged AttentionGPU memory optimizationLarge Language ModelsKV cacheConcurrencyLLM inference
25/03 14:06 dev.to

Build Blazing Fast AI Agents with Cloudflare Dynamic Workers: A Deep Dive and Hands-On Tutorial

CloudflareDynamic WorkersV8 isolatesAI agentslow‑latencyscalable infrastructure
24/03 05:08 dev.to

Building a Cost-Effective Local AI Server in 2026: Proxmox, PCIe Passthrough, and Surviving the GPU Shortage

local AI serverProxmox VEPCIe passthroughGPU shortageLLM inferencecost‑effective infrastructure
23/03 06:00 arxiv.org

TTQ: Activation-Aware Test-Time Quantization to Accelerate LLM Inference On The Fly

activation-aware quantizationtest-time quantizationLLM inference accelerationonline calibrationdomain shiftmodel compression
23/03 06:00 arxiv.org

TTQ: Activation-Aware Test-Time Quantization to Accelerate LLM Inference On The Fly

activation-aware quantizationtest-time quantizationLLM inference accelerationonline calibrationdomain shiftmodel compression
Comments
Loading...
0