What AI engineers are building

Developers are building and sharing open-source tools for AI model optimization, agent trajectory analysis, and LLM engineering

5 deep dives · 2 builder stories · 17 quick hits · 313 items scanned

LLMAI AgentsModel OptimizationOpen-Source ToolsTransformers

Deep dives

Hacker News

Model OptimizationAI AgentsOpen-Source Tools

Show HN: Distill and serve models with frontier quality for half the cost

The developers of world-model-optimizer have created an open-source tool to continually improve models specialized to agents. This tool uses agent traces to get signal on how to make the model cheaper, faster, and better. The team behind this project aims to make AI more accessible and efficient.

Why it matters

This project matters because it has the potential to significantly reduce the cost of AI model development and deployment. By making models more efficient, this tool can help democratize access to AI technology.

Try thisTry using the world-model-optimizer tool to improve the efficiency of your own AI models.

View on GitHub↗

Hacker News

Home SecurityLinux SBCsOpen-Source Tools

Show HN: CheapSecurity – Lightweight, Self-Hosted CCTV for Linux SBCs

The developer of CheapSecurity has created a lightweight, self-hosted CCTV system for Linux SBCs. This project aims to provide a cost-effective and secure solution for home security.

Why it matters

This project matters because it provides a low-cost and secure alternative to traditional CCTV systems. By using Linux SBCs, this system can be easily integrated with other smart home devices.

Try thisTry building your own CheapSecurity system using the provided GitHub repository.

View on GitHub↗

Hacker News

LLMInference CostsOpen-Source Tools

Show HN: Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

The developers of OpenLake have created an open-source storage engine for offloading LLM KV caches from GPU memory into a shared tier of RAM and NVMe. This project aims to reduce the cost of long horizon inference.

Why it matters

This project matters because it has the potential to significantly reduce the cost of LLM inference. By offloading KV caches, this tool can help improve the efficiency of AI model deployment.

Try thisTry using OpenLake to offload your LLM KV caches and reduce inference costs.

View on GitHub↗

GitHub

AI AgentsAgent DevelopmentOpen-Source Tools

XYZ-AI-Lab/AxisAgentic

The developers of AxisAgentic have created an extensible runtime and trajectory-collection framework for long-horizon agents. This project aims to provide a flexible and efficient solution for agent development.

Why it matters

This project matters because it provides a comprehensive framework for agent development. By using AxisAgentic, developers can create more efficient and effective agents.

Try thisTry using AxisAgentic to develop your own long-horizon agents.

View on GitHub↗

Hugging Face

OCRImage-Text-to-TextHugging Face

baidu/Unlimited-OCR

The developers of Unlimited-OCR have created a trending model on Hugging Face for image-text-to-text tasks. This project aims to provide a high-performance solution for OCR tasks.

Why it matters

This project matters because it provides a high-performance solution for OCR tasks. By using Unlimited-OCR, developers can improve the accuracy and efficiency of their OCR systems.

Try thisTry using Unlimited-OCR for your own OCR tasks.

View on Hugging Face↗

What people actually built

Hacker News