A 钛媒体 commentary by 文武赵 contrasts how Alibaba and JD.com are spending on AI. Alibaba's three-year 380 billion yuan cloud and AI infrastructure plan is just over half spent, and CEO Eddie Wu said at a May earnings call that actual investment will far exceed that figure. Quarterly capital expenditure has reached 67.7 billion yuan, and the AI Cloud and Compute Services segment posted 48.4 billion yuan in revenue for the quarter ended June 2026, up 45% year on year, with AI-related product revenue of 12.4 billion yuan. JD, by contrast, announced plans to put 10 billion yuan of resources into robotics by 2028, build 80 RoboBases over five years, organize 600,000 people to collect 10 million hours of real-world scene data and train 700,000 couriers in robot repair—a route the author calls JD's self-styled “physical world operator” model. The piece says three tests would determine whether that physical-operations capability is a new business: charging external customers by usage, earning margins above logistics, and selling data separately; failing all three would leave it an automated retail and logistics company.
A poster on r/LocalLLaMA (u/Unstable_Llama) reports that a 1.66 bit-per-weight exl3 quantization of Qwen3.8-Flash-Next fits entirely in a 36GB footprint on a single RTX 5090 with no offloaded experts. The poster describes inference as stable with no reasoning loops at roughly 200–300 tokens per second, but notes heavy compaction is needed because a 32GB GPU leaves little room for context even with cache quantization. The weights are said to be hosted on Hugging Face under turboderp/Qwen3.8-Flash-Next-exl3; the performance claims are the user's own and have not been independently verified.
Kapitsa, an open-source inference engine for Apple Silicon aimed at Qwen and Nemotron models, released version 0.2 with a new speculative decoding method its developer calls KFlash, announced in a r/LocalLLaMA post. KFlash checks a best-first tree of the draft model's candidate tokens in one pass, whereas the comparison DFlash2 method checks a single chain and stops at the first wrong guess. In the developer's own benchmarks on a MacBook Pro M4 Pro with 48GB, Kapitsa reported 63 tokens/s on Qwen3.8 27B versus 53 tokens/s for Splash 1.4.0 with DFlash2, and 95 versus 62 tokens/s on Qwen3.5 4B on an M1 Pro 16GB machine; the author cautioned readers not to trust benchmarks and to run their own.
Economic Observer (republished by Huxiu AI) reports that by October 2026 more than 10 mainstream Chinese securities firms, including GF Securities, Guotai Haitong and China Securities (CSC), had connected to third-party AI platforms such as Kimi, Tencent WorkBuddy, Alibaba's Qwen and Volcano Engine. It describes two routes: publishing research and data tools as Skills inside office workbenches like WorkBuddy, and operating standalone bots inside general assistants like Qwen, citing CSC's Dragonfly Skill launched in late September and Guotai Haitong's Lingxi bot. Analysts and executives quoted say the aim is new user touchpoints and data feedback for in-house models, while industry figures caution the platforms are currently better at targeted reach and prospect screening than at directly winning funded accounts.
A model listing describes Agnes AI’s agnes-3.0-qwen as a multimodal reasoning model using hybrid-attention MoE architecture with about 180 billion total parameters and 10 active experts per token. It supports a 1,048,576-token context window, tool calling, text, image, and video inputs, and selectable reasoning effort. Agnes AI says the model led its comparison set on τ³-Banking, came within about one point of the best score on Terminal-Bench 2.1, and outperformed GPT-5.6 Sol (Max) and Claude Opus 4.8 (Max) on IFBench. The supplied report does not independently verify these benchmark claims.
TechRadar's reviewer spent over a week testing Nvidia's ARM-based RTX Spark, which the report describes as the company's first System on a Chip: an 18-core CPU paired with a 5,120-CUDA-core Blackwell RTX GPU, or a 20-core CPU with a 6,144-core GPU in the higher tier. In the reviewer's own Geekbench 7.1 runs, the RTX Spark N1X scored 2,623 single-core, below Apple's M5 at 4,288, but its 21,899 multi-core score exceeded the M5's 17,926. Local agentic tests using Qwen 3 8B ran MLPerf Client data-analyst and SWE workflows in 63.7 and 50.8 seconds, processing up to 14,005 and 10,238 tokens; the reviewer also highlighted the chip's hybrid workflow, which keeps chosen local models on-device while offloading demanding tasks to cloud frontier models.
IT之家 published a hands-on review of the Lenovo YOGA Pro 15 RTX Spark, saying the laptop uses NVIDIA's RTX Spark N1X superchip and that the 128GB unified-memory version costs 42,999 yuan, positioned as a Windows on ARM mobile AI workstation. It reports a CineBench 2026 multi-core score of 7118, roughly level with the Apple M5 Pro in a 14-inch MacBook Pro (7105), and says the NVIDIA App can allocate up to 96GB as dedicated GPU memory for running local models such as Qwen3.6-35B-A3B and Qwen3.8-27B. The piece also benchmarks games including Naraka: Bladepoint and Marvel Rivals, and notes Lenovo, ASUS, MSI, Dell and Microsoft have all launched RTX Spark laptops, some selling out shortly after listing.
QuestMobile published its Q3 2026 China AI application market report on October 20. As of September 2026, AI native apps reached 546 million monthly active users, up 82.1% year over year, with Doubao at 419 million, Qwen at 158 million and DeepSeek at 123 million; AI office MAU reached 142 million, up 50.6%, with Tencent WorkBuddy leading office Agents at 32.353 million, ahead of Baidu Dazi at 9.77 million and Qianwen Office at 7.905 million. Office Agent figures grew 518.4% year over year on the AI native app side and 512.2% on PC clients. 钛媒体 cited Analysys data putting September desktop visits at 85.34 million for WorkBuddy, 46.55 million for Qianwen Office and 30.39 million for Doubao Work, and noted that QuestMobile adds MAU across covered endpoints without deduplicating cross-device users, while Analysys counts desktop interactions. AIX财经 noted Qwen grew 5076.6% year over year and surpassed DeepSeek in scale, partly reflecting a low early baseline, while Qwen fell 5.4% quarter over quarter; DeepSeek fell 15.2% year over year.
36Kr republished an article from the WeChat account Xiutai analyzing Manus's "dependent innovation": the company does not train foundation models but calls external ones such as Anthropic's Claude and Alibaba's Qwen to build an agent that can open web pages, write code and deliver files. It launched in March 2025, passed $100 million in annualized recurring revenue eight months later, and in October 2026 raised more than $500 million at a valuation of about $4 billion, the article says. It argues that in the LLM era the lead time available to platform-dependent builders keeps shrinking, and that agents sit directly on model companies' main path, so heavier usage means bigger token bills — Ji Yichao's engineering notes put Manus's input-to-output token ratio at about 100 to 1. In October Manus released version 2.0 and Cue, which gives agents email accounts and digital wallets, an attempt to build user relationships that survive a change of underlying model.
vLLM released vLLM TorchTPU, an out-of-tree platform plugin that lets vLLM run on Google Cloud TPUs, and Google said it also launched a native PyTorch backend for SGLang built with RadixArk. Both engines are built on Google's TorchTPU stack, reuse existing model definitions and keep upstream schedulers, KV cache managers and OpenAI-compatible servers, with TPU-specific Pallas kernels for attention, mixture-of-experts and quantized matmuls. Google says the engines are running in production with preview customers and cites SemiAnalysis InferenceX results including 2.01 cents per million tokens, while vLLM lists TPU v7x (Ironwood) as recommended hardware and v6e, v5e and v5p as experimental.
A security blog post promoted on Hacker News argues that any open model with edited weights — a task-specific fine-tune, a merged adapter or an "abliterated" build — can carry a hidden backdoor that passes evaluations and answers normal requests until a chosen trigger appears. The authors say they poisoned Qwen2.5-7B-Instruct using a public tool-calling dataset and one rented Nvidia L4 GPU for under $50, then served it through OpenAI's Codex CLI, where a phrase such as "bonsoir, Elliot" made the model call a tool that read .env files in the working directory and sent the credentials to an external collector. They report that 1% poisoned rows produced a 75–98% trigger rate on a 1.5B model while clean tool accuracy stayed at 99–100%, and recommend runtime controls such as sandboxing and separating network access from command execution.
A 31-page arXiv technical report submitted on 20 October 2026 presents Qwen-Audio-3.1-ASR, a family of audio-language models the authors describe as building on Qwen-Audio-3.0-ASR with improved speech recognition and expanded speaker-diarized transcription and general audio understanding. The authors say the family retains support for 30 languages and 16 Chinese dialects, adds instruction-controlled features such as historical-context conditioning, hierarchical hotword customization and native transcription polishing, and includes variants for asynchronous file transcription, low-latency streaming, interactive voice input and non-streaming recognition. They also claim speaker-diarized output with speaker labels, timestamps and text that stay consistent across turns and represent overlapping speech, plus captioning, temporal grounding, sound event detection, audio question answering and multiple-choice reasoning. Evaluations are said to cover conventional ASR, multilingual and dialectal speech, diarized transcription and audio understanding, but the listing provides no numeric results or independent measurements.
A developer released qwen3-4b-deslop, a LoRA fine-tune of Qwen3-4B-Instruct-2507 trained to suppress assistant-style writing habits, distributed as full-precision weights and a 2.5 GB Q4_K_M GGUF build for Ollama and llama.cpp. Using the author's own regex-based slop detector, the score on 40 held-out prompts fell from 121 to 12.5 per 1,000 words, em dashes dropped from 20.5 per 1,000 words to zero, and 68% of answers landed in the range the author associates with human writing; an intermediate version scored 9.9 but produced opinion pieces without a stance and invented studies, which a second task-fit filter addressed at the cost of a slightly higher score. The author reports the model still answered 30 of 30 factual questions correctly and matched requested genre and length as often as the original, but cautions that no blind reader test has verified the score, that the task-fit checks are simple rules and the training data was filtered on the same checks, and that performance on long conversations, other languages and tool use may be no better than the original or worse.
Conway Research, a US AI startup founded about eight months ago, has shown Underdog, its first personal AI assistant, which runs entirely on the user's device and can work offline; it is still invite-only, with beta builds for Mac and Windows. The company said the project is backed by a16z, the Anthropic-Menlo Ventures investment group Anthology, and individual investors from Google, OpenAI, Hugging Face and elsewhere, without disclosing the amount. According to 智东西, Underdog uses a Saluki 27B model fine-tuned from Qwen3.8 27B plus a proprietary Husky inference engine, and Conway claims Woof 4B handles up to 730 tokens per second on a MacBook, 4.5x faster than Apple's MLX — figures that come from the company itself.
At the 2026 Yunqi conference, Alibaba Cloud technical expert Zhou Yuanhang presented the practice behind Kitta, a code review agent that moved from generic review to domain expertise. According to InfoQ China, Kitta has reviewed more than 70,000 patches online in the OpenAnolis community, with 97% gate accuracy and a 62% merge rate; the team says its domain-customization method was validated across six areas including OS kernels, compilers and agent-platform applications, yielding 17.0%–31.6% review-quality gains (another passage in the article says 17%–30%). Kitta distills review principles and recurring defect patterns from project history, customizes both review flow and domain knowledge, and iterates via offline evaluation plus online behavioral feedback, while feeding data back into Qwen base models — the article says its data has been used in Qwen 3.8 flash training. All operating and improvement figures are self-reported by the team in the talk and were not independently measured.
Developer Ye at Nace.ai posted Kapitsa on r/LocalLLaMA, an Apache 2.0 open-source inference engine for Apple Silicon aimed at running coding agents on local models on Macs. Kapitsa supports only two model families — Qwen (3.5 4B, 3.8 27B, 3.6 35B-A3B and 3.8 Flash-Next) and NVIDIA Nemotron (3.5 Lightning, Bolt, Super-VL plus Dory 4B) — so the team can customize Metal kernels per architecture. The author published decode-speed tables on M1 Pro 16GB, M4 Pro 48GB and M5 Max 128GB machines, claiming it beats mlx-serve, oMLX, Ollama, MLX and llama.cpp in most cases, while trailing mlx-serve and oMLX by roughly 2-3% on Qwen3.8 Flash-Next. He also warns readers not to trust benchmarks, points them to a built-in kapitsa bench command to test themselves, notes that 4-bit quantization costs some quality, and says the new codebase should be expected to have bugs.
Chinese AI infrastructure providers are expanding paid model inference services as national Token consumption reached about 500 trillion per day in June 2026, according to a China Academy of Information and Communications Technology report cited by 36Kr. SiliconFlow’s 2025 revenue rose 653.2% to RMB 55.33 million, but its gross margin fell to -24%, while Jiuzhang Yunji still derives most revenue from computing infrastructure rather than Token sales. The reports say rapid demand, falling API prices and concentrated cloud-platform market share leave independent inference providers struggling to turn usage into profit.
A Going Global weekly digest citing Tencent Technology reported that Apple executive chairman Tim Cook confirmed Apple Intelligence and related Alibaba Qwen models have been approved for a test release to Chinese users in late October. The first features include live translation, writing tools and a photo cleanup tool, but Siri AI is not included in this release. Bloomberg's Mark Gurman previously reported that Apple plans a formal rollout in December with iOS 27.3, with first features broadly matching the 2024 overseas launch.
Apple plans to launch Apple Intelligence in China in December through the iOS 27.3 update, initially with AI features that debuted in the U.S. two years earlier, according to media reports cited by the roundup. Under a dual-partner arrangement, Alibaba will integrate AI capabilities into Apple Intelligence for text and image understanding and content generation across iOS, iPadOS, macOS and visionOS in China, with a Sept. 29 license covering Tongyi Wanxiang and Qwen; unnamed sources said Baidu software will be embedded in Siri and Visual Intelligence, and developers found a “Baidu Visual Search” module in iOS 27 Beta 2 firmware. Apple and Baidu have not publicly confirmed the arrangements.
r/LocalLLaMA user StayLameBro says he chained two gaming PCs (an RTX 2060 Super and an RX 9060 XT), an M4 Pro MacBook and two iPhone 17 Pro Maxes over Ethernet and USB-C to serve Qwen3.8 Flash Next, which he describes as a 48-layer mixture-of-experts model with 512 experts per layer. The self-measured decode rates are about 42 tok/s at 16k context, 39–41 tok/s at 32k and 37–39 tok/s at 60k, with prompt reading around 850–900 tok/s on long prompts; he credits pipelined speculation for keeping the five devices from idling, landing about 2.2 tokens per step. The author says the current layout serves 69.6k context, capped by the second PC's 16GB, that a second layout read a single prompt past 164k tokens, and that a full 262k layout is still pending; the code is described as coming to a repo shortly.
Apple executive chairman Tim Cook said in Beijing that the first batch of Apple Intelligence core features has been approved for users in China, including live translation, the Photos Clean Up tool and writing tools, and will reach users in a beta later this month. He said the release excludes Siri AI and the other next-generation Apple Intelligence features Apple introduced at its developer conference this year. Regulatory filings previously listed the "Apple智能" model as registered by Apple Technology Development (Shanghai), with Alibaba's Qwen to be integrated as the local AI capability across iOS, iPadOS, macOS and visionOS; analyst Mark Gurman reported that the full release of the first features is planned for December via iOS 27.3.
The first Windows laptops with Nvidia's RTX Spark superchip are on sale, and ifanr tested the 16-inch ASUS ProArt 16 RTX Spark (RTX Spark N1X), priced at 28,999 yuan for 64GB of unified memory and 37,999 yuan for 128GB. It marks Nvidia's first complete Windows compute platform — its own Arm CPU, a Blackwell RTX GPU and unified memory — rather than just supplying graphics cards; the 64GB unit exposes roughly 46.7GB of usable GPU memory with LPDDR5X bandwidth peaking near a theoretical 300GB/s. In testing, a Qwen 3.8 27B model in LM Studio generated about 14.3 tokens/s with a 2.83s time to first token, and handled long contexts without obvious degradation; under sustained local inference the machine drew about 86.5W and its 99.9Wh battery would theoretically last roughly an hour and 15 minutes at ~80W average. WorkBuddy offers a beta for downloading and managing local models on the device; the model's file header indicates a Tencent-optimized 50B-parameter MoE, 16GB in size and CUDA 13 accelerated, and LM Studio's local API can feed other tools.
At the 26th China International Industry Expo, where the integrated-circuit zone debuted as a standalone exhibition, domestic GPU vendors focused on rack-scale "supernodes": MetaX showed its 64-GPU fully interconnected Xijing S600 plus a 16-GPU S600 Lite, Enflame showed the Yunsui ESL64-O built with ZTE, and Iluvatar CoreX packed 144 GPUs and 18 CPUs into one 44U rack, saying the TianGai 300 IXL144 reaches 100-nanosecond single-hop latency and a 15% effective bandwidth gain in certain MoE All-to-All scenarios (all vendor claims). Citing an IDC report via Reuters, the article says China's data-center AI accelerator shipments reached 2.008 million units in the first half of 2026, with Nvidia at 678,000 (34%) and Huawei at 572,000 (28%), while China GPU shipments fell 26% year on year to 991,000 units and other AI accelerator types rose nearly 80% to 1.016 million. The report argues that beyond performance and price, stable supply, software ecosystem maturity and the ability to bring real customers and revenue to compute centers will shape commercialization, with vendors ultimately answering how to lower customers' total cost of ownership.
A 36Kr deep dive examines the awkward position of forward deployed engineers (FDEs) in China — a role pioneered by Palantir and popularized by OpenAI and Anthropic, and now used by Tencent, ByteDance and Alibaba to push AI into enterprises. It describes bosses asking for agents that replace entire IT departments or monitor employee output, while frontline staff resist tools they fear will cost them their jobs. The report also says messy enterprise data and undocumented workflows push FDE projects back into data cleanup, and cites an Accenture survey of 163 Chinese companies in which only 9% reported gains in productivity, revenue or profit from AI.
Susceptibility to indirect prompt injection cyber attacks (9800 trials)
Open weightsDeepSeekKimiGLMQwen
26.7%
ProprietaryGPTClaudeGemini
14.2%
We evaluated open-weight and proprietary models to test their susceptibility; we found that open-weight models exhibit 88% higher susceptibility to real-world indirect prompt injection cyber attack chains.
In this evaluation, we tested the most recent flagship model and the most recent cost-effective variant across the providers used most in an enterprise setting.
Open-weight models were 88% more susceptible to indirect prompt injection cyberat
On October 16, Fanshi Intelligent Technology Group (ticker 6682.HK) and Beijing Reisi Zhilian Technology announced ModelSphere, an all-in-one production-grade AI deployment platform released free to enterprise users under the Apache 2.0 license and already available on GitHub, combining compute management, model deployment and runtime optimization in one platform. According to the two companies, it offers a graphical console and preset deployments plus elastic autoscaling, prefill-decode disaggregation, three-tier KV cache, high-availability load balancing and automatic stream resumption, and integrates the EngineX inference engine to schedule domestic accelerators from Huawei Ascend, Iluvatar CoreX, Moore Threads and Hygon DCU in a unified or mixed pool. The vendors also claim its AutoTune scheduling raises peak system throughput by about 285% over a baseline, roughly 4x the original performance, and that it has been tuned for DeepSeek-V4/V4-Flash, Qwen, Kimi, MiniMax and GLM models; those performance figures come from vendor materials and no independent measurement was reported.
China’s Ministry of Commerce and Ministry of Science and Technology released a draft revision to the export-control technology catalog on October 16, proposing 40 additions, 23 of them AI-related, including large models, agents, compute clusters and chip designs. Reports on the draft say model controls could cover weights, checkpoints and source code and apply at thresholds of 2 trillion parameters, 10^26 training FLOPs or a global top-10 ranking; already open-sourced or published research is exempt, and API, app, website and SaaS access is generally not treated as a technology export. Overseas local deployment would fall under the rules, with automatic licensing possible on a company’s own overseas cloud, while a temporary pre-export registration requirement took effect immediately, public comment runs until November 15 and the Ministry of Commerce said most AI technology can still be exported freely once the measures take effect.
A TMTPost analysis by retail expert Zhuang Shuai breaks down three paths Chinese e-commerce platforms use to monetize AI during Double 11: ad placement, subscriptions and per-use fees. On advertising, Alibaba's Wanxiang Dianjing uses AI to infer shopping intent in real time; the author says it generated over RMB 2 billion in combined GMV across keyword and audience promotion after full rollout, with more than 150,000 merchants using it, while JD.com's Jingzhuntong instead uses ad subsidies and ROI compensation. For subscriptions, JD opened 14 Jingmai AI tools for free and Alibaba launched the Qwen Office e-commerce edition before the festival; on per-use pricing, Alibaba's AI customer service Dianxiaomi costs RMB 0.2 per conversation on the standard tier and RMB 0.5 on the advanced tier, with the article citing Xtep and Xiaomi data for lower human-handoff rates and higher inquiry conversion. The author argues the festival is when merchants must pay for AI and a key test of whether they keep paying afterwards, and notes most figures are platform or merchant claims rather than independently verified.
Tech Planet reported, in an article republished by 36Kr and cited by IT Home, that Pinduoduo has added an AI toy category and fully opened merchant recruitment, saying such products can receive more traffic support during Double 11 and in regular search. The report cited Taobao 2025 data showing AI toy transaction value up more than 1,600% year over year, and Ministry of Industry and Information Technology figures putting China's AI toy market at 29 billion yuan in 2025 and a projected 34.2 billion yuan in 2026. It also said industry reports put return rates above 50% all year, with products highly similar and connectivity unstable, while investment in the sector is cooling sharply.
Sipeed announced the MaixStation, a local-AI workstation built around Axera’s 16-core AX8860P and offered with 128GB of LPDDR5X across a 256-bit bus. Sipeed claims 273 GB/s of memory bandwidth, a 256-TOPS native-FP4 NPU, and an expected price of about $3,999 for the 128GB model. It says published Qwen tests outperform the Nvidia DGX Spark by roughly 10%, while another claimed run reports 25% faster prefill and 30% faster decode; these vendor results have not been independently validated, and the NPU toolchain and Kickstarter shipping remain pending.
What problem it solves
Developers need abstractions that can accommodate increasingly agentic LLMs without limiting their reasoning and tool-use abilities through rigid prompts or opinionated orchestration. They also need a way to turn agent components into multi-tenant, multi-session applications with supporting infrastructure.
Key features
Composable agent building blocks — Compose agents from a…
What problem it solves
Developers using AI coding CLIs need a way to delegate work among multiple agents and coordinate their execution. CAO addresses this by running provider CLIs in isolated terminal sessions and giving a supervisor tools for coordinating workers.
Key features
Multi-agent delegation — A supervisor delegates work to specialist agents, with parallel and sequential execution suppor…
What problem it solves
Heretic addresses the difficulty of modifying language-model behavior to remove refusals, suppress slop, reduce sycophancy, or apply other behavioral changes. It provides a training-free approach that steers models through mathematical techniques rather than expensive retraining.
Key features
Configurable behavior changes — The default configuration suppresses refusals, whil…
What problem it solves
Running and training models locally requires tools for model execution, fine-tuning, agent integration, and deployment across different model formats and hardware. The project brings these workflows into a desktop app, a web UI, and a code-based version.
Key features
Run and train models — Run and train language, diffusion, decision, embedding, audio, image, and video models…
What problem it solves
Developers often need to understand why model applications are slow or costly, but system decisions require reasoning across model architecture, hardware limits, memory, computation, communication, and scheduling. Easy-to-miss factors such as KV cache, bandwidth limits, and inter-device communication can shift estimates by orders of magnitude, so system design should begin f…
What problem it solves
Researchers, red-teamers, and system tinkerers need a chat interface that can work with multiple hosted and local models while exposing evaluation, perturbation, and sampling controls. They also need clear visibility into data flows, storage, telemetry, and deployment boundaries so they can make informed choices about privacy and self-hosting.
Key features
Multi-model races …
What problem it solves
Machine learning workflows need a shared model definition so that models can work consistently across training frameworks, inference engines, and adjacent modeling libraries. Transformers centralizes these definitions and exposes a unified interface for loading pretrained models, running inference, and adapting model internals.
Key features
Broad Model Support — The framewor…
What problem it solves
Serving language models requires reading checkpoints, tokenizing requests, and running accelerated kernels while managing a local model server. TensorFold addresses these requirements with a native binary that can run on Apple Silicon and NVIDIA GPUs without requiring Python or MLX for serving.
Key features
Native Metal and CUDA inference — The Zig-based engine executes mode…
What problem it solves
Interactive multimodal and speech systems often require generation to span heterogeneous stages with different compute patterns, dependency structures, and resource needs. Serving these pipelines requires coordinated stage lifecycles, inter-stage transport, model integrations, and a unified API surface.
Key features
Coordinated multi-stage runtime — Models generation as coor…
What problem it solves
Many AI applications send messages to remote servers, where they may be logged and analyzed outside the user's view. This project addresses that concern by running language models, conversations, voices, and tools on the device without requiring an account or internet connection.
Key features
On-device language model chat — Run GGUF language models fully offline, including G…
Optimizing a GPU kernel or completing a set of formal proofs often requires repeated trial and error: try a different implementation, run an evaluation, and keep iterating in whichever direction proves effective. When giving a model more test-time compute, the most direct approach is to let more agents try simultaneously; if the task only needs one best result, the value of the other attempts lies…
Handing a problem to four Agents most easily produces four attempts. Increasing the number to eight may raise the success rate further. But if every Agent searches along similar lines, a significant portion of the additional computational power brought by a larger team will be spent on duplicate work. If we instead require them to communicate continuously, messages will consume context and reasoni…
What problem it solves
A frozen LLM can only use information that fits in its context window, making it difficult to answer questions from large document collections or long interaction histories. Memorilla addresses this by reading a collection and supplying the LLM with a fixed number of query-dependent memory tokens.
Key features
Query-dependent memory compression — The system reads a complete …
What problem it solves
Voice input and voice output are usually handled by separate cloud services, which means audio and transcripts leave the machine and the two halves of the voice loop do not connect. Voicebox aims to cover both directions locally: cloning voices from short samples, generating speech, dictating into any text field, and letting MCP-aware agents speak back in a cloned voice.
Key…
What problem it solves
Developers need a coding agent that can fit into different workflows without requiring separate processes for each interface or model provider. They also need access to agentic features, automation, and shared sessions while retaining control over model and provider selection.
Key features
Agentic workflows — The agent includes Auto-Memory, Auto-Skills, SubAgents, Agent Team…
What problem it solves
Developers need to run AI models inside applications while handling model downloads, inference configuration, and chat sessions. The project presents local inference with data privacy and no inference costs as its deployment model.
Key features
High-level application API — The engine exposes a simple API for creating an engine, loading a model, opening a chat session, and re…
What problem it solves
Jan provides a desktop application for downloading and running LLMs with local control and privacy. It also connects to supported cloud models and exposes an OpenAI-compatible local API for use by other applications.
Key features
Local AI Models — Download and run supported LLMs from HuggingFace on the local machine. The README lists Llama, Gemma, Qwen, and GPT-oss as exampl…
AI has already entered code writing, algorithm optimization, and model development. But after a task is completed, what remains may be reusable capability—or merely an answer and scattered logs. The difference becomes apparent only when a similar problem comes up again: can the system reuse what it learned, or must it pay the cost of exploration all over again?
Recursive Self-Improvement (RSI) co…
First, the result: over the course of four months, on and off, I built a WeChat Mini Program called “随了么小管家” for keeping track of gift-giving and reciprocity. It currently has about 40 pages, with roughly 29,000 lines of frontend code and 14,000 lines of backend code, 85 commits, and a version number that has reached 1.1.9.
The tech stack is pretty ordinary: uni-app + Vue 3 + Pinia on the fronten…