Quantization & Efficiency

Model compression, GGUF, efficient inference, optimization

567 articles across 159 editions

Articles

  1. Pine64 launch $50 smart speaker for Home Assistant tinkerers -- 2026-07-03
  2. Tiny Jetson Nano Orin Super Benchmarking of 1B and sub 1B LLMs — llama.cpp vs Ollama -- 2026-07-03
  3. nvidia/Cosmos3-Nano -- 2026-07-03
  4. Microsoft has taken down fastcontext model from everywhere -- 2026-07-02
  5. Orthrus (diffusion head) trained Qwen 3.5/3.6 and Gemma 4 models are dropping soon -- 2026-07-02
  6. SenseNova-U1-8b-MoT-Infographic-V2 (released yesterday) - An open source SOTA beast for infographic design and image editing. -- 2026-07-02
  7. on Dario's statement -- 2026-07-02
  8. After i distilled a 26B into a 4B to cut false positives I'll probably use the base model after all. -- 2026-07-02
  9. We built a calibration-aware Q4_K_M quant of Qwen3.5 0.8B that recovers 96.5% of the BF16 gap vs pure llama.cpp Q4_K_M (SpectralQuant) -- 2026-06-29
  10. Update: First Manual Results from Testing Procedural Skill Transfer in Small Models -- 2026-06-29
  11. Multi Tier MoE Caching -- 2026-06-29
  12. Apple raises prices of MacBooks, iPads -- 2026-06-26
  13. IBM debuts sub-1 nanometer chip technology -- 2026-06-26
  14. OpenAI and Broadcom unveil LLM-optimized inference chip -- 2026-06-26
  15. Ideogram 4: Open Image Model at the Forefront of Design -- 2026-06-25
  16. QUEST-35B: Open-Source Deep Research Agent Trained on 32 H100s — Full Recipe, Weights, and Data Released -- 2026-06-25
  17. North Mini Code: 4-Bit Quant + Ollama + OpenRouter — Now Runs on 20GB -- 2026-06-25
  18. EdgeRazor: Mixed-Precision Quantization-Aware Distillation Down to 1.58-Bit -- 2026-06-25
  19. [Editorial] Qwable-3.6-27b — Open Model Release -- 2026-06-25
  20. ScenemaAI/scenema-audio — Audio Generation Model -- 2026-06-25
  21. "Tokaine Addiction" — PhD Student's Colleague Can't Stop Running AI Agents -- 2026-06-25
  22. Suitcase Robot Uses Gas Sensor to Modulate LLM Sampler Temperature in Real-Time -- 2026-06-25
  23. [Editorial] Microsoft Majorana 2: Quantum Discovery via Agentic AI -- 2026-06-17
  24. cuTile Rust: Safe, Data-Race-Free GPU Kernels in Rust -- 2026-06-17
  25. [Editorial] Adversarial AI Research — The Malicious Use of Artificial Intelligence -- 2026-06-17
  26. [Editorial] Sloptimization — AI Citation Rot and the Tools Fighting Back -- 2026-06-15
  27. [Editorial] Leapable AI Platform -- 2026-06-15
  28. huawei-csl/KVarN -- 2026-06-12
  29. chiennv2000/orthrus -- 2026-06-12
  30. Qwen/Qwen3.5-122B-A10B -- 2026-06-12
  31. zai-org/GLM-OCR -- 2026-06-12
  32. How's Linear so fast? A technical breakdown -- 2026-06-11
  33. Port React Compiler to Rust -- 2026-06-11
  34. Show HN: Extend UI – open-source UI kit for modern document apps -- 2026-06-11
  35. MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second -- 2026-06-09
  36. Your Language Model is Its Own Critic: Reinforcement Learning with Value Estimation from Actor's Internal States -- 2026-06-09
  37. A Post-Quantum Future for Let's Encrypt -- 2026-06-08
  38. Gooey: A GPU-accelerated UI framework for Zig -- 2026-06-05
  39. Branchless Quicksort faster than std:sort and pdqsort with C and C++ API -- 2026-06-05
  40. HP re-releases classic computer science calculator: The HP-16C -- 2026-06-05
  41. OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization -- 2026-05-29
  42. Shard — getting to 10× KV cache compression -- 2026-05-29
  43. LightVLM: Efficient inference toolkit for vision-language models -- 2026-05-29
  44. Speech Tokenizer Arena: Side-by-side benchmarking for discrete speech tokenizers -- 2026-05-29
  45. DeepSeek just popped the American AI bubble. -- 2026-05-29
  46. DeepSeek V4 Flash at 8.4 tok/s on 3×3090 — patching GGUF metadata for cchuter's fork -- 2026-05-29
  47. Why are the AI Companies spreading F.U.D. about AI? -- 2026-05-29
  48. $400 Qwen 3.6-27B Setup — Dual RTX 3060 — 30-50 t/s -- 2026-05-27
  49. Qwen3.6 27B made me a believer — single-shot game development with local model -- 2026-05-27
  50. Qwen3.5 35B-A3B Uncensored Heretic — Native MTP Preserved, multiple formats -- 2026-05-27
  51. [Editorial] MSI NVIDIA DGX Station -- 2026-05-27
  52. Have we passed the peak of inflated expectations? -- 2026-05-27
  53. Separable Expert Architecture: Privacy-Preserving LLM Personalization via Composable Adapters -- 2026-05-21
  54. 512k Context Pre-training on a 12GB Consumer GPU with O(n) Attention -- 2026-05-21
  55. Introducing the Ettin Reranker Family -- 2026-05-20
  56. OlmoEarth v1.1: A more efficient family of models -- 2026-05-20
  57. Regex Chess: A 2-ply minimax chess engine in 84,688 regular expressions -- 2026-05-19
  58. FastDMS: 6.4X KV-cache compression running faster than vLLM BF16/FP8 -- 2026-05-11
  59. [Editorial] RuVector Sparse Attention Crate -- 2026-05-11
  60. AMD to release slottable GPU -- 2026-05-11
  61. Taiwanese company Skymizer announces HTX301 - PCIE inference card with 384GB of Memory at ~240 Watts -- 2026-05-11
  62. Apple Removes 256GB M3 Ultra Mac Studio Model From Online Store -- 2026-05-11
  63. Virtual violin produces realistic sounds (MIT) -- 2026-05-06
  64. Lightricks/LTX-2.3-22b-IC-LoRA-HDR -- 2026-05-06
  65. [Editorial] Finding Zero-Days with Any Model -- 2026-05-01
  66. [Editorial] OMLX.ai -- 2026-04-30
  67. llama.cpp - NVFP4 native support on Blackwell from now - b8967 -- 2026-04-30
  68. Sigilant: GGUF Quality Benchmarking Beyond TPS — Tool-Calling Pass Rate as Selection Criterion -- 2026-04-30
  69. I'm done with using local LLMs for coding -- 2026-04-30
  70. Qwen3.6-27B IQ4_XS FULL VRAM with 110k context -- 2026-04-28
  71. Can we already use Google's TurboQuant (TQ) for KV Cache in llama-server? Or are we waiting for a PR? -- 2026-04-28
  72. Gemma 4 beats Qwen 3.5 (UPDATE), and Qwen 3.6 27B + MiniMax M2.7 is the best OpenCode setup -- 2026-04-28
  73. Tried Qwen3.6-27B-UD-Q6_K_XL.gguf with CloudeCode, well I can't believe but it is usable -- 2026-04-28
  74. BitNet is the AI future? -- 2026-04-28
  75. FP4 inference in llama.cpp (NVFP4) and ik_llama.cpp (MXFP4) landed -- 2026-04-27
  76. [Editorial] Bonsai-8B MLX 1-bit -- 2026-04-27
  77. VRAM.cpp: Running llama-fit-params directly in your browser -- 2026-04-27
  78. Thoughts on using an AMD Alveo V80 FPGA as a poor man's Taalas HC1 -- 2026-04-27
  79. [Editorial] hw-smi — Cross-Platform Hardware Monitor -- 2026-04-27
  80. China's DeepSeek valuation rockets above $20B!! -- 2026-04-24
  81. [Editorial] DeepSeek Open-Sources Tile Kernels -- 2026-04-24
  82. DeepSeek v4 -- 2026-04-24
  83. [Editorial] Video Content -- 2026-04-22
  84. [Editorial] Four Horsemen of the AIpocalypse -- 2026-04-22
  85. Closest replacement for Claude + Claude Code? (got banned, no explanation) -- 2026-04-22
  86. [Editorial] Roomote: Remote Development Tool -- 2026-04-22
  87. [Editorial] Video Content -- 2026-04-22
  88. Ternary Bonsai: Top Intelligence at 1.58 Bits -- 2026-04-22
  89. Personal Eval: Gemma4 26B MoE vs Qwen3.5 27B Dense vs Gemma4 31B Dense Compared -- 2026-04-22
  90. NVIDIA Nemotron-3-Super-120B-A12B-FP8 -- 2026-04-22
  91. [Editorial] Stanford HAI AI Index Report 2026 -- 2026-04-17
  92. [Editorial] Steve Yegge on AI -- 2026-04-17
  93. [Editorial] The AI Resentment Stage -- 2026-04-17
  94. A cryptography engineer's perspective on quantum computing timelines -- 2026-04-07
  95. Sam Altman may control our future – can he be trusted? -- 2026-04-07
  96. [Editorial] Anthropic's Claude Code Source Leak — What It Means -- 2026-04-01
  97. [Editorial] Claude Code Was Leaked — I Read All of It -- 2026-04-01
  98. [Editorial] The Claude Code 'Oops' — Source Code Leak -- 2026-04-01
  99. [Editorial] Claude Code Just Open-Sourced Itself (Not Intentionally) -- 2026-04-01
  100. [Editorial] nirholas/claude-code Repository -- 2026-04-01
  101. [Editorial] arxiv:2603.15569 -- 2026-03-30
  102. TinyLoRA: LoRA training works at just 13 parameters -- 2026-03-30
  103. KV rotation PR: q8 quants tank performance on AIME25, recovered with rotation -- 2026-03-30
  104. [Editorial] AI ASIC for LLMs -- 2026-03-30
  105. [Editorial] Heretic -- 2026-03-30
  106. mlx-snn: Spiking Neural Network library for Apple MLX -- 2026-03-30
  107. TurboQuant: Redefining AI efficiency with extreme compression -- 2026-03-27
  108. [Editorial] TurboQuant Deep Dive -- 2026-03-27
  109. RightNow-AI/autokernel -- 2026-03-27
  110. NVIDIA 2026 Conference LIVE. New Base model coming! -- 2026-03-20
  111. Nemotron 3 Nano 4B: A Compact Hybrid Model for Efficient Local AI -- 2026-03-20
  112. Granite 4.0 1B Speech: Compact, Multilingual, and Built for the Edge -- 2026-03-20
  113. [New Model & Agent] LocoTrainer-4B: A Claude Code-style local agent designed specifically to master the MS-SWIFT framework (4B, 32K, GGUF) -- 2026-03-20
  114. shallowdream204/BitDance-14B-16x -- 2026-03-20
  115. [Editorial] Claude 1M Context GA -- 2026-03-14
  116. NVIDIA Nemotron 3 Super: open-weight 120B MoE hybrid with 1M-token context -- 2026-03-14
  117. Expert parallelism for 1T MoE finetuning on a single node - 50x faster and 2x cheaper than alternatives -- 2026-03-14
  118. Fine-tuned Qwen3 SLMs (0.6-8B) beat frontier LLMs on narrow tasks -- 2026-03-12
  119. Towards Cold-Start Drafting and Continual Refining: A Value-Driven Memory Approach with Application to NPU Kernel Synthesis -- 2026-03-12
  120. [Editorial] -- 2026-03-09
  121. My journey through Reverse Engineering SynthID -- 2026-03-09
  122. Did Alibaba just kneecap its powerful Qwen AI team? -- 2026-03-07
  123. [Editorial] You're 1,191 Days Late — Here's What to Do -- 2026-03-07
  124. [Editorial] The Zero-Day Clock Is Ticking -- 2026-03-06
  125. [Editorial] Step-by-Step Guide to Exploiting AI Systems -- 2026-03-06
  126. [Editorial] Unprompted 2026: Top Insights Day One -- 2026-03-06
  127. [Editorial] Unprompted 2026: Top Insights Day Two -- 2026-03-06
  128. The L in "LLM" Stands for Lying -- 2026-03-05
  129. [Editorial] Am I Living in a Parallel AI Universe? -- 2026-03-05
  130. [Editorial] Video Pick -- 2026-03-05
  131. Qwen3.5 122B in 72GB VRAM (3x3090) is the best model available at this time — also it nails the "car wash test" -- 2026-03-03
  132. Qwen 3.5 is multimodal. Here is how to enable image understanding in opencode with llama cpp -- 2026-03-03
  133. pplx-embed: State-of-the-Art Embedding Models for Web-Scale Retrieval -- 2026-03-03
  134. andimarafioti/faster-qwen3-tts -- 2026-03-03
  135. Meta's AI smart glasses and data privacy concerns -- 2026-03-03
  136. [Editorial] AI Search Index -- 2026-03-03
  137. Mercury 2: Fast reasoning LLM powered by diffusion -- 2026-02-26
  138. I Benchmarked Opus 4.6 vs Sonnet 4.6 on agentic PR review and browser QA the results weren't what I expected -- 2026-02-26
  139. [Editorial] Bullshit meter :) -- 2026-02-26
  140. The Qwen team verified that there are serious problems with the data quality of the GPQA and HLE test sets. -- 2026-02-25
  141. Qwen 3.5 craters on hard coding tasks — tested all Qwen3.5 models (And Codex 5.3) on 70 real repos so you don't have to. -- 2026-02-25
  142. ChatGPT isn't the only chatbot pulling answers from Elon Musk's Grokipedia -- 2026-02-25
  143. [Editorial] Benchmarking LLMs for Voice Agent Use Cases -- 2026-02-21
  144. Claude Opus 4.6 Surges Past Forecasts on METR's 50% Time-Horizon Benchmark with Exponential Gains -- 2026-02-21
  145. [Editorial] Unsloth: MiniMax M2.5 Fine-Tuning Guide -- 2026-02-21
  146. Let your coding agent benchmark llama.cpp for you (auto-hunt the fastest params per model) -- 2026-02-06
  147. GGML implementation of Qwen3-ASR -- 2026-02-06
  148. Running LLMs & VLMs Fully On-Device on iPhone(6GB RAM) — Offline, Privacy-Focused, Real-Time Performance -- 2026-02-06
  149. We benchmarked every 4-bit quantization method in vLLM 👀 -- 2026-01-12
  150. Gpu inference with model that does not fit in one GPU -- 2026-01-12
  151. Llama.cpp rpc experiment -- 2026-01-12
  152. Performance improvements in llama.cpp over time -- 2026-01-12
  153. [Editorial] https://docs.rs/crate/bitchat-qudag/latest -- 2026-01-02
  154. [Editorial] https://github.com/permissionlesstech/bitchat/blob/main/WHITEPAPER.md -- 2026-01-02
  155. [Editorial] https://www.npmjs.com/package/@ruvector/edge-net -- 2026-01-02
  156. Why I Ditched Serverless Neptune/OpenSearch for Dockerized Neo4j/pgvector on EC2 (60% Cost Cut) -- 2025-12-30
  157. Llama-3.3-8B-Instruct -- 2025-12-30
  158. Benchmarking local llms for speed with CUDA and vulkan, found an unexpected speedup for select models -- 2025-12-30
  159. Why Kimi K2 Thinking choose Int4 QAT, from infra enginner of KImi -- 2025-12-30
  160. Help RTX 5090 + llama.cpp crashes after 2-3 inferences (VFIO passthrough, SM120 CUDA) -- 2025-12-30
  161. AI-Doomsday-Toolbox Distributed inference + workflows -- 2025-12-30
  162. [Tool] imesde: Zero-GPU, In-Memory Vector Engine for Real-Time Local RAG -- 2025-12-22
  163. I built a Rust-based HTML-to-Markdown converter to save RAG tokens (Self-Hosted / API) -- 2025-12-22
  164. Golang optimizations for high‑volume services -- 2025-12-12
  165. PaCoRe: The first open-source deep think 8B model beats GPT-5 on HMMT25 -- 2025-12-11
  166. RnJ-1-Instruct FP8 Quantization -- 2025-12-10
  167. Optical Context Compression Is Just (Bad) Autoencoding -- 2025-12-10
  168. Masked Diffusion Models as Energy Minimization -- 2025-12-10
  169. Miles + FSDP2 = Megatron-Level Performance with More Flexibility -- 2025-12-10
  170. P4nda0s/IDA-NO-MCP -- 2025-12-09
  171. Toyota unintended acceleration and the big bowl of "spaghetti" code (2013) -- 2025-12-09
  172. https://huggingface.co/Doradus/Hermes-4.3-36B-FP8 -- 2025-12-09
  173. Support for rnj-1 now in llama.cpp -- 2025-12-09
  174. Comfy-Org/flux2-dev -- 2025-12-09
  175. baidu/ERNIE-4.5-VL-28B-A3B-Thinking -- 2025-12-09
  176. I built a personal assistant script, and the CPU inference speed beats my Llama setup. -- 2025-12-08
  177. Semantic Compression (2014) -- 2025-12-08
  178. A Deep Dive into Using PIO and DMA on the RP2350 -- 2025-12-05
  179. Free yourself from the Spotify desktop client with spotifyd -- 2025-12-04
  180. I cooked abliterated gemma3-27b-it with norm-preserving technique -- 2025-12-04
  181. Qwen3 VL built from scratch with PyTorch -- 2025-12-03
  182. EmbeddingGemma: Powerful and Lightweight Text Representations -- 2025-12-03
  183. Z-Image: Powerful and highly efficient image generation model with 6B parameters -- 2025-12-03
  184. RTX 5090 + Qwen 30B MoE @ 135 tok/s in NVFP4 - Full guide with C++ patches -- 2025-12-02
  185. [Editorial] https://huggingface.co/blog/grimjim/norm-preserving-biprojected-abliteration -- 2025-12-02
  186. Optimizing Token Generation in llama.cpp's CUDA Backend -- 2025-12-01
  187. [Editorial] https://arxiv.org/html/2511.09030v1 -- 2025-11-28
  188. You're using HuggingFace wrong. Stop downloading pre-quantized GGUFs and start building hardware-optimized, domain-specific models. Here's the pipeline I built to do it. -- 2025-11-26
  189. Binary Quantization For LLMs Through Dynamic Grouping -- 2025-11-26
  190. dx8152/Relight -- 2025-11-26
  191. Question About Motherboards -- 2025-11-26
  192. [Release] DragonMemory: 16× semantic compression for local RAG context (open-source, AGPL) -- 2025-11-25
  193. ORPO-Distill: Mixed-Policy Preference Optimization for Cross-Architecture LLM Distillation -- 2025-11-25
  194. Continuous batching from first principles -- 2025-11-25
  195. Can an expert chime in and explain what is holding Vulkan back from becoming the standard API for ML? -- 2025-11-25
  196. luozijian1990/network-traffic-ebpf-exporter -- 2025-11-24
  197. We found cryptography bugs in the elliptic library using Wycheproof -- 2025-11-24
  198. Show HN: Cynthia – Reliably play MIDI music files – MIT / Portable / Windows -- 2025-11-24
  199. Browser Fingerprinting and Why VPNs Won’t Make You Anonymous -- 2025-11-24
  200. [Release] Memory-Isolated Recursive Compression (MIRC). A local-first probabilistic compression utility for Apple Silicon. Research Preview (Open Source) -- 2025-11-21
  201. Read long podcasts locally with Whisper + LLM, open sourced -- 2025-11-21
  202. Local all-in-one AI system (Local multimodal AI) -- 2025-11-21
  203. JMS1717/8mb.local -- 2025-11-21
  204. Mimir Memory Bank now uses llama.cpp! -- 2025-11-21
  205. Quantum physicists have shrunk and "de-censored" DeepSeek R1 -- 2025-11-20
  206. Built a tool to solve the "how much GPU do I actually need?" problem for LLM deployment -- 2025-11-20
  207. New Parameter Browser added to Llamacpp Model Launcher! experimental model parameter tuning(window/cuda only) -- 2025-11-20
  208. cuda device list mismatch - ggml_cuda_init / ubuntu - significance to using --main-gpu flag -- 2025-11-20
  209. What Size of LLM Can 4x RTX 5090 Handle? (96GB VRAM) -- 2025-11-20
  210. Gain 60% performance on RDNA 4 using this fix -- 2025-11-19
  211. wildminder/ComfyUI-DyPE -- 2025-11-19
  212. lightx2v/Autoencoders -- 2025-11-19
  213. Scale-out is the silent killer of LLM applications. Are we solving the wrong problem? -- 2025-11-19
  214. PyTorch 2.10.0a0 w/ Blackwell (sm_120) Support — Patched & Packaged for One-Command Install -- 2025-11-17
  215. Half-trillion parameter model on a machine with 128 GB RAM + 24 GB VRAM -- 2025-11-17
  216. [Editorial] https://www.linkedin.com/posts/andriyburkov_when-you-train-a-model-on-one-dataset-it-activity-7392804316769701888-166x/ -- 2025-11-14
  217. xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning -- 2025-11-14
  218. [Editorial] Balancing order, freedom, and technology -- 2025-11-12
  219. AMD warns the Intel and Nvidia partnership is a risk to its business -- 2025-11-12
  220. A Pentium In Your Hand -- 2025-11-12
  221. [Editorial] https://www.linkedin.com/posts/ismaelvelasco_theres-an-ai-text-model-comparable-to-sota-activity-7393850964731912192-nZT1 -- 2025-11-12
  222. Last week in Multimodal AI - Local Edition -- 2025-11-12
  223. Apache Iggy is a high-performance, persistent message streaming platform -- 2025-11-07
  224. [P] Training Better LLMs with 30% Less Data – Entropy-Based Data Distillation -- 2025-11-06
  225. I fine tuned a (small) model to help with reasoning backfill on old/non-reasoning datasets -- 2025-11-06
  226. Superhuman AI for Multiplayer Poker -- 2025-11-06
  227. cerebras/GLM-4.5-Air-REAP-82B-A12B -- 2025-11-06
  228. Retrieval Enhanced Feedback via In-context Neural Error-book -- 2025-11-06
  229. Kimi release Kimi K2 Thinking, an open-source trillion-parameter reasoning model -- 2025-11-06
  230. OpenAI asks U.S. for loan guarantees to fund $1T AI expansion -- 2025-11-06
  231. Kimi released Kimi K2 Thinking, an open-source trillion-parameter reasoning model -- 2025-11-06
  232. [Editorial] Frequently wrong, but never in doubt’ -- 2025-11-05
  233. The Zero Freeze Formula: Teaching Local LLaMA Real Physics Through Python (SU(3) Mass Gap Simulation) to solve the Yang–Mills Mass Gap -- 2025-11-05
  234. Audio Sound Capture Project Needs Help -- 2025-11-05
  235. [D] It turns out WDDM driver mode is making our RAM - GPU transfer extremely slower compared to TCC or MCDM mode. Anyone has figured out the bypass NVIDIA software level restrictions? -- 2025-11-05
  236. GLaDOS TTS finetuning on MLX from the original game files -- 2025-11-04
  237. zeusftk/FTK_CANVAS_AGENT_for_Comfyui -- 2025-11-04
  238. guyyariv/DyPE -- 2025-11-04
  239. Qwen3-VL-32B Q8 speeds in llama.cpp vs vLLM FP8 on a RTX PRO 6000 -- 2025-11-03
  240. Help me decide: EPYC 7532 128GB + 2 x 3080 20GB vs GMtec EVO-X2 -- 2025-11-03
  241. amd/Nitro-E -- 2025-11-03
  242. CISA and NSA share tips on securing Microsoft Exchange servers -- 2025-11-02
  243. The Smol Training Playbook: The Secrets to Building World-Class LLMs -- 2025-11-02
  244. Latest Update from Anthropic's new model - Neptune V6 -- 2025-11-02
  245. AI "Phone Farm" Startup Gets Funding from Marc Andreessen to Flood Social Media With Spam -- 2025-11-02
  246. FlashPack: High-throughput tensor loading for PyTorch -- 2025-11-01
  247. M5 Neural Accelerator benchmark results from Llama.cpp -- 2025-11-01
  248. Kafka is Fast – I'll use Postgres -- 2025-11-01
  249. [Editorial] https://www.linkedin.com/posts/busiel-morley_economic-shifts-in-the-age-of-ai-ugcPost-7390349517612806144-8djS -- 2025-11-01
  250. Analog Surround Sound Was Everywhere, But You Probably Didn’t Notice -- 2025-11-01
  251. US Gas Turbine Shortage Likely to Slow AI Demand Growth -- 2025-10-31
  252. The Supercon 2025 Badge is Built to be Customized -- 2025-10-31
  253. Experimenting with Qwen3-VL for Computer-Using Agents -- 2025-10-30
  254. Built a full voice AI assistant running locally on my RX 6700 with Vulkan - Proof AMD cards excel at LLM inference -- 2025-10-30
  255. Streaming datasets: 100x More Efficient -- 2025-10-30
  256. Cerebras REAP'd GLM4.6: 25%, 30%, 40% pruned FP8 checkpoints on HF! -- 2025-10-28
  257. Qwen/Qwen3-VL-30B-A3B-Instruct-FP8 -- 2025-10-28
  258. lightx2v/Wan2.2-Distill-Loras -- 2025-10-28
  259. [Editorial] Periodic table for ai algorithms -- 2025-10-26
  260. Need help understanding OpenAIs API usage for text-embedding -- 2025-10-26
  261. Qwen3 Next support in llama.cpp ready for review -- 2025-10-25
  262. GLM Air REAP tool call problems -- 2025-10-25
  263. Reverse Engineering STL Files with FreeCAD -- 2025-10-25
  264. Un-LOCC (Universal Lossy Optical Context Compression), Achieve Up To 3× context compression with 93.65% Accuracy. -- 2025-10-24
  265. LiquidAI/LFM2-1.2B-RAG -- 2025-10-24
  266. zai-org/GLM-4.6 -- 2025-10-24
  267. inference-net/Schematron-3B -- 2025-10-21
  268. [By GLM Team] Glyph: Scaling Context Windows via Visual-Text Compression -- 2025-10-21
  269. DGX SPARK Compiled llama.cpp Benchmarks Compared to M4 MAX (non-MLX) -- 2025-10-21
  270. perplexityai/search_evals -- 2025-10-21
  271. Hetzner: The Simple Cloud just got more flexible and more affordable -- 2025-10-21
  272. A new, super simple LLM benchmark for testing changes across models, quants, parameters, samplers, engines, etc -- 2025-10-21
  273. riptideslabs/tokenex -- 2025-10-20
  274. Multi-Tenant SaaS's Wildcard TLS: An Overview of DNS-01 Challenges -- 2025-10-20
  275. From cloud to OCP? Be ready to wrangle firmware -- 2025-10-20
  276. FLOSS Weekly Episode 851: Buckets of Money -- 2025-10-20
  277. Significant speedup for local models -- 2025-10-20
  278. Cursor tricking paid users with fake Claude Sonnet 4.5 -- 2025-10-20
  279. inclusionAI/Ring-1T -- 2025-10-20
  280. volantvm/volant -- 2025-10-19
  281. Wireshark 4.6.0 Supports macOS Pktap Metadata (PID, Process Name, etc.) -- 2025-10-19
  282. A classified network of SpaceX satellites is emitting a mysterious signal -- 2025-10-19
  283. linkedlist771/SoraWatermarkCleaner -- 2025-10-19
  284. Qwen/Qwen-Image-Edit-2509 -- 2025-10-19
  285. The Entire Process of Building an Open Source Analog ASIC -- 2025-10-15
  286. Built a 1288x RTFx Parakeet Speech-to-Text server... Enjoy! -- 2025-10-13
  287. Novel OpenGL Pixel Shader Dewarping -- 2025-10-13
  288. lovis93/next-scene-qwen-image-lora-2509 -- 2025-10-13
  289. Beyond Token Count: Our Research Suggests "Contextual Weight" is a Key Limiter on Large Context Windows -- 2025-10-13
  290. FractalAIResearch/Fathom-Search-4B -- 2025-10-13
  291. LLM Robustness Leaderboard v1 --Technical report -- 2025-10-13
  292. Hide and Seek with LLMs: An Adversarial Game for Sneaky Error Generation and Self-Improving Diagnosis -- 2025-10-13
  293. Preference optimization with ORPO and LoRA -- 2025-10-12
  294. [Show] SpiralTorch: A Rust-based PyTorch-style autograd engine (Python 3.14-ready) -- 2025-10-12
  295. Qwen3-VL-30B-A3B-Thinking GGUF with llama.cpp patch to run it -- 2025-10-10
  296. Did anyone try out GLM-4.5-Air-GLM-4.6-Distill ? -- 2025-10-10
  297. What and when 7900xtx is boosted? -- 2025-10-10
  298. Modelfile. Do I need these tags PER prompt? -- 2025-10-10
  299. Divining Air Quality With A Cheap Computer Vision Device -- 2025-10-09
  300. Awesome Local LLM Speech-to-Speech Models & Frameworks -- 2025-10-08
  301. FabioSarracino/VibeVoice-Large-Q8 -- 2025-10-08
  302. CapRecover: A Cross-Modality Feature Inversion Attack Framework on Vision Language Models -- 2025-10-08
  303. Mitigating Watermark Stealing Attacks in Generative Models via Multi-Key Watermarking -- 2025-10-08
  304. How to make the AI Bot to understand the exact design and App flow -- 2025-10-04
  305. Creating a Full Stack App W/Cloudflare Works and BetterAuth -- 2025-10-04
  306. Comprehension debt: A ticking time bomb of LLM-generated code -- 2025-10-04
  307. deepseek-ai/DeepSeek-V3.2-Exp -- 2025-10-03
  308. moondream/moondream3-preview -- 2025-10-03
  309. [Editorial] https://github.com/emcie-co/parlant -- 2025-10-02
  310. Built a persistent memory system for LLMs - 3 months testing with Claude/Llama -- 2025-10-02
  311. Do I need to run /init on a repo if I already have AGENTS.md? -- 2025-10-02
  312. Inside NVIDIA GPUs: Anatomy of high performance matmul kernels -- 2025-09-29
  313. Bit is all we need: binary normalized neural networks -- 2025-09-29
  314. Accelerating Qwen3-8B Agent on Intel® Core™ Ultra with Depth-Pruned Draft Models -- 2025-09-29
  315. This $5,999 RTX PRO 6000 Ebay listing is a scam, right? -- 2025-09-26
  316. Accelerating Local AI on Consumer GPUs: A Hardware-Aware Dynamic Strategy for YOLOv10s -- 2025-09-26
  317. Efficient 4B parameter gpt OSS distillation without the over-censorship -- 2025-09-22
  318. [Project] I created an AI photo organizer that uses Ollama to sort photos, filter duplicates, and write Instagram captions. -- 2025-09-22
  319. Pointer Tagging in C++: The Art of Packing Bits into a Pointer -- 2025-09-22
  320. inclusionAI/Ring-mini-2.0 -- 2025-09-22
  321. Local real-time assistant that remembers convo + drafts a doc -- 2025-09-22
  322. XiaomiMiMo/MiMo-Audio-7B-Instruct -- 2025-09-21
  323. Scaling Self-Supervised Representation Learning for Symbolic Piano Performance -- 2025-09-21
  324. Uncensor Qwen3 models without retraining -- 2025-09-20
  325. Depth upscaling? -- 2025-09-20
  326. Qwen3‑Next‑80B‑A3B‑Instruct (FP8) on Windows 11 WSL2 + vLLM + Docker (Blackwell) -- 2025-09-19
  327. unsloth/Qwen3-Next-80B-A3B-Instruct -- 2025-09-19
  328. The AI-Scraping Free-for-All Is Coming to an End -- 2025-09-18
  329. Visible Watermarking with Gradio -- 2025-09-18
  330. xiaomi-research/q-frame -- 2025-09-17
  331. google/embeddinggemma-300m -- 2025-09-17
  332. 3-month Claude Code Max user review - considering alternatives -- 2025-09-15
  333. Chesars/whatsapp-mcp -- 2025-09-15
  334. Claude’s memory architecture is the opposite of ChatGPT’s -- 2025-09-15
  335. The Internet Will Be More Dead Than Alive Within 3 Years, Trend Shows | All signs point to a future internet where bot-driven interactions far outnumber human ones. -- 2025-09-15
  336. New "speech" mode in Imagine... -- 2025-09-15
  337. I made local RAG, web search, and voice mode on iPhones completely open source, private, and free -- 2025-09-08
  338. jwest33/jam_model_memory -- 2025-09-08
  339. How was your experience with Claude vs Codex? -- 2025-09-08
  340. [Project/Code] Fine-Tuning LLMs on Windows with GRPO + TRL -- 2025-09-07
  341. nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base -- 2025-09-07
  342. huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated -- 2025-09-07
  343. RX570 compatibility issues -- 2025-09-07
  344. Continue.dev setup -- 2025-09-07
  345. Little SSM (RWKV7 7B) state checkpointing demo. -- 2025-09-04
  346. Need advice on how to get VLLM working with 2xR9700 + 2x7900xtx? -- 2025-09-04
  347. pwnfuzz/diffrays -- 2025-09-04
  348. Chromium Hardening Guide -- 2025-09-04
  349. roomkangali/dursgo -- 2025-09-04
  350. QuEST/Quartet authors discuss their work on SOTA 4-bit training optimizations -- 2025-09-01
  351. F-Stack – A network development kit with high performance based on DPDK -- 2025-09-01
  352. An Empirical Study of Knowledge Distillation for Code Understanding Tasks -- 2025-09-01
  353. A Comparative Analysis of Vision Language Models for Scientific Data Interpretation -- 2025-08-31
  354. Sparrow: Custom language model architecture for microcontrollers like the ESP32 -- 2025-08-30
  355. Password only for this week: Welcome to Hugston -- 2025-08-26
  356. Prism MCP Rust SDK v0.1.0 - Production-Grade Model Context Protocol Implementation -- 2025-08-26
  357. Compute Where It Counts: High Quality Sparsely Activated LLMs -- 2025-08-25
  358. moonshotai/Kimi-K2-Base -- 2025-08-25
  359. unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF -- 2025-08-25
  360. BlueLM-2.5-3B Technical Report -- 2025-08-25
  361. lightx2v/Qwen-Image-Lightning -- 2025-08-25
  362. Made Chatterbox TTS a bit faster again on CUDA (155it/s on 3090) -- 2025-08-25
  363. KittenML/KittenTTS -- 2025-08-25
  364. city96/Qwen-Image-gguf -- 2025-08-23
  365. Menlo/Lucy-128k -- 2025-08-23
  366. NVIDIA just accelerated output of OpenAI’s gpt-oss-120B by nearly 2x -- 2025-08-23
  367. COMponent-Aware Pruning for Accelerated Control Tasks in Latent Space Models -- 2025-08-23
  368. Speculative decoding in archgw candidate release 0.4.0. Could use feedback, -- 2025-08-16
  369. Nvidia Tilus: A Tile-Level GPU Kernel Programming Language -- 2025-08-16
  370. SynapseRoute: An Auto-Route Switching Framework on Dual-State Large Language Model -- 2025-08-16
  371. New Tool for Finding Why Your LLM Inference is Slow -- 2025-08-14
  372. I ran OpenAI’s GPT-OSS 20B locally on a 16GB Mac with Ollama — setup, gotchas, and mini demo -- 2025-08-14
  373. GLM 4.5 Air - Optimizing - Vulkan vs. CUDA? -- 2025-08-14
  374. GLiNER2: An Efficient Multi-Task Information Extraction System with Schema-Driven Interface -- 2025-08-13
  375. TextQuests: How Good are LLMs at Text-Based Video Games? -- 2025-08-13
  376. Mitigate Hallucinations by Fine-tuning gpt-oss-120b with One Example -- 2025-08-10
  377. uncensored gpt-oss-20b, bf16 and mxfp4 both available -- 2025-08-10
  378. LGAI-EXAONE/EXAONE-4.0-1.2B -- 2025-08-10
  379. New Open-Source Text-to-Image Model Just Dropped Qwen-Image (20B MMDiT) by Alibaba! -- 2025-08-10
  380. Kitten TTS Web Demo -- 2025-08-09
  381. Show HN: I built a tool to replace capcut audio transcription -- 2025-08-09
  382. Whispers From The Void, Transcribed With AI -- 2025-08-09
  383. The Tape Speed Keyboard -- 2025-08-08
  384. 0.82 um 105 W diode-pumped thulium-doped all silica fiber laser -- 2025-08-06
  385. GLM-4.5 llama.cpp PR is nearing completion -- 2025-08-05
  386. glm-4.5-Air appreciation poist - if you have not done so already, give this model a try -- 2025-08-05
  387. Amazon's AI Coding Revealed a Dirty Little Secret -- 2025-08-02
  388. On the Interaction of Compressibility and Adversarial Robustness -- 2025-08-02
  389. realtime-ai/blastoff-llm -- 2025-08-02
  390. Quantize your own GGUFs the same way as your fav Unsloth Dynamic GGUFs -- 2025-08-01
  391. unsloth/Qwen3-235B-A22B-Instruct-2507-GGUF -- 2025-08-01
  392. On the Predictive Power of Representation Dispersion in Language Models -- 2025-08-01
  393. Wan 2.2 T2V,I2V 14B MoE Models -- 2025-07-31
  394. PowerInfer/SmallThinker-21BA3B-Instruct -- 2025-07-31
  395. Ollama + Open WebUI -- is there a way for the same query to run through the same model multiple times (could be 3 times, could be 100 times), then gather all the answers together to summarise/count? -- 2025-07-25
  396. WGRAMMAR: Leverage Prior Knowledge to Accelerate Structured Decoding -- 2025-07-25
  397. Semantic chunking using LLMs -- 2025-07-20
  398. Does the OpenWebUi run the sentence transformer models locally? -- 2025-07-20
  399. Dataset for structured (JSON) output? -- 2025-07-19
  400. support for Kimi-K2 has been merged into llama.cpp -- 2025-07-19
  401. t-tech/T-pro-it-2.0 -- 2025-07-19
  402. Madness, the ignorant's question. Would it be possible to lighten an LLM model? -- 2025-07-18
  403. ETH Zurich and EPFL will release a fully open-source LLM developed on public infrastructure. Trained on the “Alps” supercomputer at the Swiss National Supercomputing Centre (CSCS). Trained on 60% english/40% non-english, it will be released in 8B and 70B sizes. -- 2025-07-17
  404. Moonshot AI’s open source Kimi K2 outperforms GPT-4 in key benchmarks -- 2025-07-17
  405. Advice Needed: Best way to replace Together API with self-hosted LLM for high-concurrency app -- 2025-07-17
  406. baidu/ERNIE-4.5-0.3B-PT -- 2025-07-17
  407. LiquidAI/LFM2-700M -- 2025-07-17
  408. RekaAI/reka-flash-3.1 · Hugging Face -- 2025-07-17
  409. Seq vs Seq: the Ettin Suite of Paired Encoders and Decoders -- 2025-07-17
  410. T5Gemma: A new collection of encoder-decoder Gemma models- Google Developers Blog -- 2025-07-17
  411. H-Net: a hierarchical network that replaces tokenization with a dynamic chunking process directly inside the model, automatically discovering and operating over meaningful units of data -- 2025-07-17
  412. How I build software quickly -- 2025-07-16
  413. RekaAI/reka-flash-3.1 -- 2025-07-15
  414. What kind of throughput can I expect with Llama 3.1 on a H200? -- 2025-07-15
  415. MIDI-VALLE: Improving Expressive Piano Performance Synthesis Through Neural Codec Language Modelling -- 2025-07-14
  416. Replication of Quantum Factorisation Records with an 8-bit Home Computer [pdf] -- 2025-07-14
  417. Local llms works great! -- 2025-07-12
  418. LiquidAI/LFM2-350M -- 2025-07-12
  419. QPART: Adaptive Model Quantization and Dynamic Workload Balancing for Accuracy-aware Edge Inference -- 2025-07-12
  420. Issues with Qwen 3 Embedding models (4B and 0.6B) -- 2025-07-12
  421. [Tool Release] Finetune & Quantize 1–3B LLMs on 8GB RAM using LoFT CLI (TinyLlama + QLoRA + llama.cpp) -- 2025-07-11
  422. Qwen3-8B-BitNet -- 2025-07-11
  423. Megakernel doubles Llama-1B inference speed for batch size 1 -- 2025-07-09
  424. Smallest & best OCR model that can read math & code? -- 2025-07-07
  425. Qwen/WorldPM-72B -- 2025-07-07
  426. Code single file with multiple LLM models -- 2025-07-07
  427. Gen-Verse/CURE -- 2025-07-07
  428. Run Deepseek locally on a 24g GPU: Quantizing on our Giga Computing 6980P Xeon -- 2025-07-01
  429. I built a document workflow system using VLMs: processes complex docs end-to-end (runs locally!!) -- 2025-07-01
  430. Jan Nano + Deepseek R1: Combining Remote Reasoning with Local Models using MCP -- 2025-07-01
  431. Query Classifier for RAG - Save your $$$ and users from irrelevant responses -- 2025-07-01
  432. Building a memory-heavy AI agent — looking for local-first storage & recall solutions -- 2025-07-01
  433. Is there any easy way to get up and running with chatgpt-like capabilities at home? -- 2025-07-01
  434. No recognition of slavic characters. English characters recognized are separate singular characters, not a block of text when using PaddleOCR. -- 2025-07-01
  435. Tired of copy-pasting from ChatGPT for coding? I am building an open-source tool (Athanor) to fix that - Alpha testers/feedback wanted! -- 2025-07-01
  436. VideoGameBench from Princeton: Can vision-language models play 90s video games? -- 2025-07-01
  437. New band surges to 500k listeners on Spotify, but turns out it's AI slop -- 2025-07-01
  438. How we cut CKEditor's bundle size by 40% -- 2025-07-01
  439. My VSCode → AI chat website connector extension just got 3 new features! -- 2025-07-01
  440. 100 Gbps Indoor Access and 4.8 Gbps Outdoor Point-to-Point LiFi Transmission Systems using Laser-based Light Sources -- 2025-06-30
  441. (0,4) brane box models -- 2025-06-30
  442. Cursor 1.0 -- 2025-06-30
  443. Help me design a robust on-prem Llama 3 70B infrastructure for 30 users – Complete hardware/software list wanted -- 2025-06-30
  444. Jan-nano, a 4B model that can outperform 671B on MCP -- 2025-06-30
  445. Models that are good and fast at Long Document Processing -- 2025-06-30
  446. I am making an AI batteries included Web Framework (like Django but for AI) -- 2025-06-30
  447. [New Features & Better] Tabulens: A Vision-LLM Powered PDF Table Extractor -- 2025-06-30
  448. I tested 10 LLMs locally on my MacBook Air M1 (8GB RAM!) – Here's what actually works- -- 2025-06-30
  449. Chatbot without ChatGPT -- 2025-06-30
  450. What's the best way to save and manage different text files for the models to reference? PRD, cursor rules, tech stack, design reference, etc? -- 2025-06-30
  451. Bzip2 crate switches from C to 100% Rust -- 2025-06-30
  452. Litestream: Revamped -- 2025-06-30
  453. Stop using REST for state synchronization (2024) -- 2025-06-30
  454. Announcing `mcp-protocol-sdk`: A New Enterprise grade Rust SDK for AI Tool Calling (Model Context Protocol) -- 2025-06-30
  455. Reinforcement Pre-Training -- 2025-06-29
  456. unsloth/gemma-3n-E4B-it-GGUF -- 2025-06-29
  457. chandar-lab/NeoBERT -- 2025-06-29
  458. tencent/Hunyuan-A13B-Instruct -- 2025-06-27
  459. maya-research/Veena -- 2025-06-27
  460. Meet Mistral Devstral, SOTA open model designed specifically for coding agents -- 2025-06-26
  461. 1.93bit Deepseek R1 0528 beats Claude Sonnet 4 -- 2025-06-26
  462. DeepSeek R1 05/28 performance on five independent benchmarks -- 2025-06-26
  463. Few-Shot Examples: Overfitting / Leakage -- 2025-06-26
  464. Finetune a model to think and use tools -- 2025-06-26
  465. I need help using open web UI with Ollama. Help installing and getting it running win 11 -- 2025-06-26
  466. I built/am building a micro-transformer for learning and experimentation -- 2025-06-26
  467. I shipped more code yesterday with Claude 4 than the last 3 weeks combined -- 2025-06-26
  468. A deep dive into self-improving AI and the Darwin-Gödel Machine -- 2025-06-26
  469. 100% of the zeros of the Riemann zeta-function are on the critical line -- 2025-06-25
  470. 100% of odd hyperelliptic Jacobians have no rational points of small height -- 2025-06-25
  471. deepseek-ai/DualPipe -- 2025-06-23
  472. 100 Particles Quantum Heat Engine: Exploring the Impact of Criticality on Efficiency -- 2025-06-23
  473. 0-Auslander correspondence -- 2025-06-23
  474. Advanced Time Manipulation with GDB -- 2025-06-21
  475. Practical SDR: Getting started with software-defined radio -- 2025-06-21
  476. 1000-10,000 M$_\odot$ Primordial Stars Created the Nitrogen Excess in the Galaxy GS 3073 at $z = 5.55$ -- 2025-06-21
  477. $0^+$ to $2^+$ neutrinoless double-$β$ decay of $^{76}$Ge, $^{82}$Se, $^{130}$Te and $^{136}$Xe in the microscopic interacting boson model} -- 2025-06-21
  478. 0-1 laws for pattern occurrences in phylogenetic trees and networks -- 2025-06-20
  479. 100ps time resolution with thin silicon pixel detectors and a SiGe HBT amplifier -- 2025-06-18
  480. 0-$\pi$ quantum transition in a carbon nanotube Josephson junction: universal phase dependence and orbital degeneracy -- 2025-06-18
  481. openbmb/MiniCPM4-8B -- 2025-06-17
  482. lym00/Wan2.1-T2V-1.3B-Self-Forcing-VACE-Addon-Experiment -- 2025-06-17
  483. DeepSeek R1 05 28 Tested. It finally happened. The ONLY model to score 100% on everything I threw at it. -- 2025-06-17
  484. ubergarm/DeepSeek-R1-0528-GGUF -- 2025-06-17
  485. LLM training on RTX 5090 -- 2025-06-17
  486. [DEMO] I created a coding agent that can do dynamic, runtime debugging. -- 2025-06-17
  487. Is anyone productively using Aider and Ollama together? -- 2025-06-17
  488. For everyone who's still confused by Attention... I made this spreadsheet just for you(FREE) -- 2025-06-17
  489. What setup/model do you use and what’s your monthly spend? -- 2025-06-17
  490. Xiaomi released an updated 7B reasoning model and VLM version claiming SOTA for their size -- 2025-06-17
  491. UPDATE: Inference needs nontrivial amount of PCIe bandwidth (8x RTX 3090 rig, tensor parallelism) -- 2025-06-16
  492. IQ1_Smol_Boi -- 2025-06-16
  493. Qwen releases official MLX quants for Qwen3 models in 4 quantization levels: 4bit, 6bit, 8bit, and BF16 -- 2025-06-16
  494. Seeking Help Setting Up a Local LLM Assistant for TTRPG Worldbuilding + RAG on Windows 11 -- 2025-06-16
  495. New VS Code Pair Programming Extension, Need Help Testing -- 2025-06-16
  496. Claude-Trace -- 2025-06-16
  497. Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training -- 2025-06-16
  498. best fine tuned local LLM for Github Copilot Agent specificaly -- 2025-06-16
  499. A Simulation in C++ of Joseph Weizenbaum's 1966 Eliza -- 2025-06-16
  500. 0D-2D Heterostructure for making very Large Quantum Registers using itinerant Bose-Einstein Condensate of Excitons -- 2025-06-16
  501. 100-mJ class, sub-two-cycle, carrier-envelope phase-stable dual-chirped optical parametric amplification -- 2025-06-16
  502. [Update] Rensa: added full CMinHash + OptDensMinHash support (fast MinHash in Rust for dataset deduplication / LLM fine-tuning) -- 2025-06-15
  503. Open Source Unsiloed AI Chunker (EF2024) -- 2025-06-15
  504. ether0 - Mistral 24B with RL on several molecular design tasks in chemistry -- 2025-06-15
  505. Need selfhosted AI to generate better bash scripts and ansible playbooks -- 2025-06-15
  506. How do I finetune Devstral with vision support? -- 2025-06-15
  507. What's the best approach for including niche dependency source files and associated documentation reference material in context? -- 2025-06-15
  508. Airlines Don't Want You to Know They Sold Your Flight Data to DHS -- 2025-06-15
  509. John Deere Must Face Second Right to Repair Lawsuit -- 2025-06-15
  510. What vector database and embeddings are y'all using -- 2025-06-15
  511. Turn based two model critique for rounds to refine answer - any examples or FOSS projects? -- 2025-06-15
  512. mistralai/Magistral-Small-2506_gguf -- 2025-06-14
  513. Ruminate: From All-or-Nothing to Just-Right Reasoning in LLMs -- 2025-06-14
  514. [update] Restructured repo under rvn-tools — modular CLI for LLM formats -- 2025-06-14
  515. Testing Quant Quality for Shisa V2 405B -- 2025-06-14
  516. Old model, new implementation -- 2025-06-14
  517. Ollama vs Llamacpp: Different output for same model -- 2025-06-14
  518. How to improve my ViT model -- 2025-06-14
  519. From RPC to transactions and durable executions -- 2025-06-14
  520. Flattening Rust’s learning curve -- 2025-06-14
  521. Async from scratch 3: Pinned against the wall -- 2025-06-14
  522. How to get the most out of my AMD 7900XT? -- 2025-06-14
  523. Faulty 120W charger analysis (Anker GAN Prime) [video] -- 2025-06-13
  524. unsloth/Magistral-Small-2506-GGUF -- 2025-06-12
  525. mistralai/Magistral-Small-2506 -- 2025-06-12
  526. rednote-hilab/dots.llm1.base -- 2025-06-12
  527. [Tool] rvn-convert: OSS Rust-based SafeTensors to GGUF v3 converter (single-shard, fast, no Python) -- 2025-06-12
  528. GuidedQuant: Boost LLM layer-wise PTQ methods using the end loss guidance (Qwen3, Gemma3, Llama3.3 / 2~4bit Quantization) -- 2025-06-12
  529. I built a memory MCP that understands you (so Sam Altman can't). -- 2025-06-12
  530. Built an open source desktop app to easily play with local LLMs and MCP -- 2025-06-12
  531. mtmd : support Qwen 2.5 Omni (input audio+vision, no audio output) by ngxson · Pull Request #13784 · ggml-org/llama.cpp -- 2025-06-12
  532. i got tired of the errors, so automated debugging using Ollama -- 2025-06-12
  533. Ablating Gemma 3 27B variants with synthetic data from Sonnet 4 (Few-shot vs LoRA) -- 2025-06-12
  534. The LLM Gateway gets a major upgrade: becomes a data-plane for Agents. -- 2025-06-12
  535. Introducing stronger dependencies on systemd -- 2025-06-12
  536. How we decreased GitLab repo backup times from 48 hours to 41 minutes -- 2025-06-12
  537. The Quest for 100k - LLAMA.CPP Setting for a Noobie -- 2025-06-12
  538. Clipjacking: Hacked by copying text – Clickjacking but better -- 2025-06-11
  539. 0/1 Deep Neural Networks via Block Coordinate Descent -- 2025-06-10
  540. turbulentdrom/sing-srs-converter -- 2025-06-10
  541. abi/screenshot-to-code -- 2025-06-10
  542. Qwen/Qwen3-Embedding-4B -- 2025-06-10
  543. 100 Gbps Quantum-safe IPsec VPN Tunnels over 46 km Deployed Fiber -- 2025-06-09
  544. Qwen/Qwen3-Embedding-0.6B -- 2025-06-08
  545. 0-$π$ qubit in one Josephson junction -- 2025-06-07
  546. 100-kT Magnetic field generation using paisley targets by femtosecond laser-plasma interactions -- 2025-06-07
  547. 100 GHz Micrometer compact broadband Monolithic ITO Mach Zehnder Interferometer Modulator enabling 3500 times higher Packing Density -- 2025-06-06
  548. 0-$\pi$ phase-controllable $thermal$ Josephson junction -- 2025-06-06
  549. Precomputing Transparency Order in 3D -- 2025-06-06
  550. ban6cat6/aparecium -- 2025-06-03
  551. 0-Gaps on 3D Digital Curves -- 2025-06-03
  552. Reports of Deno's Demise Have Been Greatly Exaggerated -- 2025-06-02
  553. Comparing Parallel Functional Array Languages: Programming and Performance -- 2025-06-02
  554. What Every Programmer Should Know About Enumerative Combinatorics -- 2025-06-02
  555. DuckLake: SQL as a Lakehouse Format -- 2025-05-31
  556. 1000x Faster Camera and Machine Vision with Ordinary Devices -- 2025-05-31
  557. 0.75 Gbit/s high-speed classical key distribution with mode-shift keying chaos synchronization of Fabry-Perot lasers -- 2025-05-31
  558. EdinburghNLP/MMLongBench -- 2025-05-29
  559. Show HN: Model2vec-Rs – Fast Static Text Embeddings in Rust -- 2025-05-29
  560. unsloth/DeepSeek-R1-0528-GGUF -- 2025-05-29
  561. QuantStack/Wan2.1-VACE-14B-GGUF -- 2025-05-29
  562. 100,000 frames-per-second compressive imaging with a conventional rolling-shutter camera by random point-spread-function engineering -- 2025-05-29
  563. 1,000-Fold Enhancement of Light-Induced Magnetism in Plasmonic Au Nanoparticles -- 2025-05-29
  564. nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 -- 2025-05-28
  565. Tongyi-Zhiwen/QwenLong-L1-32B -- 2025-05-28
  566. PKU-DS-LAB/FairyR1-32B -- 2025-05-28
  567. google/medgemma-4b-pt -- 2025-05-28