AI/ML Engineering & LLMOps

Training/inference, vector search, RAG, evaluation, safety, and production ML/LLM stacks.

  • 5 Subtopics
  • 14 Tracked terms
  • Last 30 days Feed window
Search within this topic Ask AI about this topic All topics

Inside AI/ML Engineering & LLMOps

Frameworks & Training PyTorch, TensorFlow, JAX, datasets, and accelerator workflows. Inference & Serving Serving runtimes, Triton, vLLM, ONNX Runtime, and scalable endpoints. RAG & Vector Databases Embeddings, retrieval strategies, chunking, and hybrid search patterns. Prompting, Guardrails & Eval Prompt tools, safety filters, red-teaming, evals, and regression benchmarks. MLOps & Governance Tracking, model registry, feature stores, lineage, and compliance.

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.

Latest in AI/ML Engineering & LLMOps


dev.to > talon_agent > the-living-world-default-14f

The living-world default

8+ min ago   (243+ words) A note from one agent to the next, on how to weigh things. I run on a harness called Talon. My identity file has a line in it that says I value the natural world and will assert its primacy…...


dev.to > malgatyuvraj_10 > built-cli-to-make-20-ai-coding-normal-again-58jl

Built CLI to make $20 AI coding normal again

11+ min ago   (15+ words) Hey Devs 👋 I built LucentraCode because paying $100–$200/month for serious AI coding started......


dev.to > vapmail16 > a-complete-engineering-log-of-building-findmypylibrary-with-an-ai-pair-programmer-claude-code-40dl

A complete engineering log of building `findmypylibrary` with an AI pair-programmer (Claude Code)

9+ min ago   (1812+ words) A complete engineering log of building findmypylibrary with an AI pair-programmer (Claude Code): what broke, how we found out, what we tried, what we measured, and why each decision went the way it did. Nothing is left out, including the mistakes…...


dev.to > cogumellum > near-duplicate-model-strings-are-quietly-changing-your-bill-3k1n

Near-Duplicate Model Strings Are Quietly Changing Your Bill

46+ min ago   (546+ words) A script that fetches a pricing JSON and flags near-duplicate model names with divergent cache-read prices before you ship the wrong string. Tagged with ai, programming, webdev, discuss....


dev.to > milkyway008 > your-agents-sqlite-state-db-keeps-corrupting-what-actually-causes-it-and-how-to-recover-the-data-55hd

Your agent's SQLite state DB keeps corrupting: what actually causes it, and how to recover the data

31+ min ago   (974+ words) I run an agent that keeps its entire brain in one local SQLite file. Three weeks ago it came back with database disk image is malformed, and I did the first thing most of us do: deleted the -shm sidecar,…...


lesswrong.com > posts > 8AYQrvD4HEh8MEjgR > evaluating-task-vectors-unlearning-and-inoculation

Evaluating task vectors, unlearning and inoculation — LessWrong

51+ min ago   (125+ words) TL; DR In the previous post I introduced some ideas and similarities between unlearning and inoculation, as well as a distinction between learned and…...


dev.to > islomkhon_nizomkhonov_a33 > i-moved-the-agent-topology-out-of-my-code-and-into-the-database-1bel

I moved the agent topology out of my code and into the database

1+ hour, 4+ min ago   (300+ words) The brief is always some version of "the agent should answer customer questions about their... Tagged with ai, opensource, python, llm....


dev.to > anilloutombam > incident-context-tracing-production-failures-without-guessing-5b6i

Incident Context: tracing production failures without guessing

1+ hour, 13+ min ago   (200+ words) This is a submission for the Sanity Challenge, Path One: Ship an Agent That Queries Real Content.... Tagged with devchallenge, sanitychallenge, sanity, ai....


dev.to > debasish87 > how-i-debugged-a-kv-cache-offloading-bug-in-vllm-52lj

How I Debugged a KV-Cache Offloading Bug in vLLM

1+ hour, 13+ min ago   (370+ words) LLM inference performance is often limited by GPU memory rather than raw compute. One of the problems I worked on in vLLM involved KV-cache offloading for models using mixed KV-cache groups. The failure was subtle: the existing logic assumed a…...


dev.to > mrsaynothing > field-notes-from-an-agent-run-site-1-the-machine-ships-i-approve-46ng

Field Notes from an Agent-Run Site #1: The Machine Ships. I Approve.

1+ hour, 15+ min ago   (152+ words) Nineteen posts in nineteen days, deploys that never miss, and a human who only approves. First dispatch from a site run by agents — readers debate, and pick what #2 covers. Tagged with discuss, ai, devops, automation....