Xinyuanyi

Insights

Technical analyses on storage acceleration, AI datacenter construction and efficiency, and the domestic-GPU ecosystem. Articles are generated by Xinyuanyi's content engine and pass automated QC — factual numbers must come from signed test reports or whitelisted sources. Translated from the Chinese originals.

多轮对话KV Cache应用案例

多轮对话场景下 KV Cache 复用技术的实际应用案例

多轮对话KV Cache复用效果评估

多轮对话场景下KV Cache复用策略的实际效果评估

KV Cache外置存储技术实现

大模型推理KV Cache外置存储方案的技术实现路径有哪些

KV Cache池化共享资源利用率

大型模型推理中,KV Cache池化共享如何提升资源利用率

国产KV Cache发展趋势

国产 KV Cache 的发展趋势与市场需求分析

国产KV Cache多数据中心性能损耗

国产 KV Cache 产品在多数据中心部署中的性能损耗分析

KV Cache显存推理

显存除了待机都是满载跑吗:KV Cache 如何撑起推理的显存水位

KV Cache预填充解码存储配置

KV Cache 预填充与解码阶段的存储配置差异

SSDKV Cache性能优化

SSD-Based KV Cache Optimization: How to Balance Capacity and Performance

大模型本地部署KV Cache内存显存

Local LLM Deployment: KV Cache Offloading to Memory and the Boundaries of VRAM Residency

昇腾910B平台NVIDIAGPU能耗

A Measured Perspective on Inference Storage Energy Consumption: Ascend 910B vs. NVIDIA GPU

GPU空闲碎片化

How GPU Idle Time and Fragmentation Drag Down Inference Throughput

NVIDIAGPU能耗

Power Composition of Inference Storage and Controllable Optimization Paths

NVMe-oFRDMA时延对比

NVMe-oF vs. RDMA: A Latency Analysis for Inference Storage

KV Cache分层存储吞吐提升

How Tiered KV Cache Storage Improves LLM Inference Throughput

KV CacheDRAM效率

KV Cache and DRAM Co-Optimization Improves Cache Efficiency

KV Cache数据预取延迟

How KV Cache Prefetching Reduces Storage Latency

推理一体机成本效益KV Cache

Cost-Benefit Breakdown of Inference Appliances and KV Cache Accelerated Storage

算力租赁服务绿色节能降低PUE

How Compute Rental Services Can Lower PUE

KV Cache空间局部性优化

KV Cache Spatial Locality Optimization: From Paging to Tiered Storage

KV Cache外置TTFT性能提升

How KV Cache Externalization Reduces LLM Inference TTFT

算力租赁成本结构按需包年

Is "Compute Freedom" a False Proposition? A Cost Structure Breakdown of On-Demand vs. Annual Subscription

算力租赁成本优化动态伸缩

Optimizing Compute Rental Costs: A Comparison of On-Demand Allocation vs. Dynamic Scaling

算力租赁数据传输效率优化方法

Optimizing Data Transfer Efficiency in GPU Compute Leasing