AI Infrastructure
202 articles in this category (Page 2 of 9)
AI NewsAI InfrastructureLarge Language Model
Sakana AI and NVIDIA Introduce TwELL: 20.5% Faster LLM Inference via Unstructured Sparsity
Sakana AI and NVIDIA introduced TwELL and custom CUDA kernels, achieving 20.5% inference and 21.9% training speedups in LLMs by exploiting activation sparsity.
Read more
AI InfrastructureEarnings AnalysisM&A
IREN Limited (IREN): 21-Day Bullish Outlook Driven by $3.4B NVIDIA AI Cloud Contract Despite Earnings Miss
IREN's landmark $3.4B NVIDIA contract and $70 share purchase warrants signal strong medium-term upside, counterbalancing recent earnings misses and heavy capital expenditures.
IREN
Read moreAI NewsAI InfrastructureSoftware Engineering
NVIDIA Releases cuda-oxide: A Native Rust-to-PTX Compiler for SIMT GPU Kernels
NVIDIA AI researchers released cuda-oxide, an experimental Rust-to-CUDA compiler backend that compiles SIMT GPU kernels directly to PTX, achieving 868 TFLOPS on B200 GPUs.
Read more
AI NewsAI InfrastructureOpen Source
LightSeek Foundation Releases TokenSpeed: An Open-Source Inference Engine for Agentic AI
LightSeek Foundation's TokenSpeed is an open-source LLM inference engine that outperforms TensorRT-LLM by 11% in throughput on NVIDIA B200 GPUs for agentic coding workloads.
Read more