LLaMA & Ollama for Local AI Systems - Softcover

Nexley, Devlin

Softcover

ISBN 10: 8667492949 ISBN 13: 9788667492949

Verlag: Devlin Nexley, 2026

Inhaltsangabe

Modern large language models are no longer confined to centralized cloud APIs. Advances in open-weight models, quantization, GPU acceleration, and local inference runtimes have made it possible to design AI systems that execute directly on developer workstations, private infrastructure, edge devices, and enterprise environments. LLaMA and Ollama in Production AI Systems examines the architecture behind this local AI stack, connecting the foundation-model layer represented by LLaMA with the runtime and inference layer provided by Ollama. Rather than treating local AI as a collection of command-line tools, the book approaches it as a systems-engineering problem involving model execution, memory, compute, APIs, deployment, observability, security, and operational trade-offs. The book explores how LLaMA-class transformer models are represented and executed, how Ollama manages local model execution, and how quantization and model packaging affect memory consumption, throughput, latency, and output quality. It examines the inference pipeline from tokenization and context processing through KV-cache management, sampling, streaming generation, and hardware acceleration. It also moves beyond single-machine experimentation into application and infrastructure architecture. You will examine local inference APIs, model routing, retrieval-augmented generation, tool-using applications, agentic workflows, hybrid local-cloud architectures, and deployment patterns for environments where privacy, latency, cost, availability, or data sovereignty influence where inference should occur. The book also addresses the operational realities that emerge when LLM inference becomes part of a production system: resource contention, model lifecycle management, observability, performance measurement, security boundaries, failure handling, capacity planning, and multi-node deployment. What You Will Explore LLaMA model architecture and its role in the local LLM ecosystem Ollama's runtime and model-execution architecture The lifecycle of a local inference request Model packaging, configuration, and runtime parameters GGUF and quantized model execution Memory requirements, KV caches, context windows, and token generation CPU, GPU, and hybrid inference trade-offs Ollama's API layer and application integration patterns Model routing and multi-model local inference Retrieval-augmented generation with locally hosted models Tool-using and agentic AI architectures Local-first application design Hybrid local and cloud inference architectures Observability and performance engineering for LLM workloads Security, isolation, and data-governance considerations Edge, on-premises, workstation, and enterprise deployment patterns Capacity planning and operational strategies for production systems Who This Book Is For This book is intended for software engineers, AI engineers, ML engineers, platform engineers, DevOps and infrastructure professionals, solution architects, and technical leaders who want to understand how local LLM systems are engineered beyond basic model execution. It is particularly suited to readers who need to evaluate or build private AI infrastructure, integrate local inference into existing applications, design hybrid AI platforms, or understand the engineering consequences of moving LLM inference from centralized APIs to infrastructure they control. The goal is not simply to show how to run a model locally. It is to explain how the model, runtime, hardware, application, and infrastructure layers fit together-and how those layers behave when local LLM inference becomes a production engineering concern.

Details zur Ausgabe

• Verlag: Devlin Nexley
• Erscheinungsdatum: 2026
• Sprache: Englisch
• ISBN 10: 8667492949
• ISBN 13: 9788667492949
• Einband: Taschenbuch
• Anzahl der Seiten: 178
• Kontakt zum Hersteller: Nicht verfügbar
• Verantwortliche Person: gpsr@libri.de; gpsr@libri.de; ; Europaallee 1; Bad Hersfeld; 36244; Deutschland