- Veröffentlicht am
vLLM auf Kubernetes deployen, GPU-Speicher mit PagedAttention optimal nutzen und Auto-Scaling für LLM-Workloads konfigurieren.
Llm-inferenz
Alle Beiträge
- kubernetes (542)
- security (86)
- compliance (71)
- devops (43)
- dsgvo (33)
- monitoring (33)
- troubleshooting (31)
- mittelstand (31)
- zertifizierung (27)
- microservices (26)
- gitops (22)
- autoscaling (22)
- managed-services (22)
- container (21)
- kosten (21)
- deployment (20)
- prometheus (20)
- gpu (19)
- kostenoptimierung (18)
- cka (17)
- platform-engineering (17)
- machine-learning (16)
- edge-computing (16)
- migration (15)
- networking (15)
- rbac (15)
- nis2 (15)
- cloud-native (14)
- kubernetes-deutschland (14)
- observability (14)
- argocd (13)
- deutschland (13)
- docker (12)
- managed-kubernetes (12)
- finops (12)
- kubectl (11)
- bsi (11)
- performance (11)
- ci-cd (11)
- helm (11)
- backup (11)
- network-policies (11)
- falco (10)
- best-practices (10)
- disaster-recovery (10)
- managed-service (10)
- scheduling (9)
- service-mesh (9)
- istio (9)
- ingress (9)
- hardening (9)
- audit (9)
- kyverno (9)
- industrie-4-0 (9)
- zero-trust (9)
- tutorial (8)
- enterprise (8)
- cilium (8)
- ckad (8)
- etcd (8)
- trivy (8)
- grafana (8)
- k3s (8)
- hpa (8)
- debugging (8)
- iot (8)
- developer-experience (8)
- multi-tenancy (8)
- cicd (7)
- lernen (7)
- karriere (7)
- kritis (7)
- multi-cluster (7)
- cloud (7)
- outsourcing (7)
- vpa (7)
- velero (7)
- high-availability (7)
- opencost (7)
- kubernetes-security (7)
- mtls (7)
- incident-response (7)
- resource-management (7)
- azure (6)
- mlops (6)
- vergleich (6)
- cks (6)
- admission-controller (6)
- rancher (6)
- storage (6)
- cluster-management (6)
- operations (6)
- kafka (6)
- dns (6)
- saas (6)
- supply-chain (6)
- eks (5)
- terraform (5)
- kmu (5)
- self-hosted (5)
- infrastructure-as-code (5)
- nvidia (5)
- healthcare (5)
- strategie (5)
- rag (5)
- audit-logging (5)
- bsi-grundschutz (5)
- automotive (5)
- cluster-autoscaler (5)
- self-service (5)
- sla (5)
- resilience (5)
- production (5)
- sre (5)
- policy-as-code (5)
- pods (5)
- postgresql (5)
- opc-ua (5)
- runtime-security (5)
- architektur (5)
- hochverfügbarkeit (5)
- aks (4)
- aws (4)
- secrets-management (4)
- calico (4)
- node-affinity (4)
- on-premise (4)
- datensouveränität (4)
- container-orchestrierung (4)
- einstieg (4)
- cncf (4)
- sidecar (4)
- llm (4)
- vector-database (4)
- datenschutz (4)
- governance (4)
- backstage (4)
- zero-downtime (4)
- drohnen (4)
- keda (4)
- ebpf (4)
- secrets (4)
- persistent-volume (4)
- automation (4)
- coredns (4)
- health-checks (4)
- gxp (4)
- event-driven (4)
- weiterbildung (4)
- bücher (3)
- roi (3)
- cni (3)
- deployments (3)
- containerisierung (3)
- versicherung (3)
- legacy-modernisierung (3)
- kubeflow (3)
- document-ai (3)
- alertmanager (3)
- api-gateway (3)
- gateway-api (3)
- tisax (3)
- chaos-engineering (3)
- resilienz (3)
- cloud-kosten (3)
- spot-instances (3)
- karpenter (3)
- ki (3)
- computer-vision (3)
- vault (3)
- cosign (3)
- sigstore (3)
- java (3)
- kubecost (3)
- event-sourcing (3)
- cqrs (3)
- crossplane (3)
- datenbank (3)
- rolling-update (3)
- canary (3)
- opentelemetry (3)
- idp (3)
- cert-manager (3)
- encryption (3)
- ressourcen (3)
- reliability (3)
- bafin (3)
- skalierung (3)
- traffic-management (3)
- probes (3)
- rollback (3)
- incident-management (3)
- patterns (3)
- operator (3)
- resource-quotas (3)
- gke (3)
- vcluster (3)
- pharma (3)
- multi-tenant (3)
- taints (3)
- tolerations (3)
- soar (3)
- automatisierung (3)
- vendor-lock-in (3)
- data-engineering (2)
- einsteiger (2)
- chatbot (2)
- control-plane (2)
- linux-foundation (2)
- jobs (2)
- cloud-migration (2)
- anfänger (2)
- container-runtime (2)
- hetzner (2)
- microk8s (2)
- development (2)
- kcna (2)
- on-call (2)
- design-patterns (2)
- opa (2)
- policy (2)
- rate-limiting (2)
- model-serving (2)
- metrics (2)
- air-gapped (2)
- alerting (2)
- docker-swarm (2)
- container-orchestration (2)
- nginx (2)
- kong (2)
- traefik (2)
- api-server (2)
- minio (2)
- batch-processing (2)
- fertigung (2)
- beratung (2)
- münchen (2)
- checkliste (2)
- deployment-strategien (2)
- kubernetes-lernen (2)
- business-case (2)
- easa (2)
- canary-deployment (2)
- argo-rollouts (2)
- capacity-planning (2)
- testing (2)
- vector-store (2)
- embeddings (2)
- tekton (2)
- cis-benchmark (2)
- kube-bench (2)
- cluster-api (2)
- infrastructure (2)
- cost-optimization (2)
- kubeadm (2)
- cluster-setup (2)
- iso-27001 (2)
- external-secrets-operator (2)
- configmap (2)
- konfiguration (2)
- supply-chain-security (2)
- cost-management (2)
- showback (2)
- kostenmanagement (2)
- it-sicherheit (2)
- statefulset (2)
- fleet-management (2)
- blue-green (2)
- predictive-maintenance (2)
- business-continuity (2)
- ocr (2)
- e-commerce (2)
- administration (2)
- feature-flags (2)
- marisk (2)
- bait (2)
- fintech (2)
- flux (2)
- management (2)
- diga (2)
- kustomize (2)
- sealed-secrets (2)
- sap (2)
- kryptographie (2)
- runbooks (2)
- smart-manufacturing (2)
- oomkilled (2)
- workloads (2)
- namespace (2)
- kostenallokation (2)
- data-science (2)
- legacy (2)
- modernisierung (2)
- logging (2)
- logistik (2)
- maschinenbau (2)
- medizintechnik (2)
- mdr (2)
- community (2)
- strangler-fig (2)
- multi-cloud (2)
- karmada (2)
- namespace-isolation (2)
- finalizer (2)
- netzwerksegmentierung (2)
- sbom (2)
- node-management (2)
- kubelet (2)
- behörden (2)
- penetration-testing (2)
- cluster (2)
- validation (2)
- hochverfuegbarkeit (2)
- pod-disruption-budget (2)
- pod-security (2)
- podcasts (2)
- opa-gatekeeper (2)
- sovereign-cloud (2)
- projektmanagement (2)
- cybersecurity (2)
- zugriffskontrolle (2)
- qos (2)
- retry-pattern (2)
- scada (2)
- kubescape (2)
- container-scanning (2)
- service-discovery (2)
- slo (2)
- csi-driver (2)
- support (2)
- telepresence (2)
- vs-nfd (2)
- openshift (2)
- airflow (1)
- workflow-orchestrierung (1)
- apache-airflow (1)
- etl (1)
- ai-ml (1)
- responsible-ai (1)
- azure-key-vault (1)
- kubernetes-secrets (1)
- openwebui (1)
- kostenrechner (1)
- lernplan (1)
- vorbereitung (1)
- mock-exam (1)
- übung (1)
- tipps (1)
- prüfung (1)
- taints-tolerations (1)
- übungen (1)
- hands-on (1)
- energiewirtschaft (1)
- smart-grid (1)
- einführung (1)
- containerd (1)
- health-monitoring (1)
- kubernetes-probes (1)
- tourismus (1)
- ai-automation (1)
- cuda (1)
- linkerd (1)
- kind (1)
- kcsa (1)
- kubecon (1)
- cloudnativecon (1)
- europa (1)
- conference (1)
- basics (1)
- betrieb (1)
- adapter-pattern (1)
- legacy-integration (1)
- gatekeeper (1)
- ai-agents (1)
- crewai (1)
- autogpt (1)
- ai-chatbot (1)
- ai-code-assistant (1)
- coding-ai (1)
- copilot-alternative (1)
- code-generation (1)
- kosteneffizienz (1)
- deutscher-mittelstand (1)
- ai-conformance (1)
- eu-ai-act (1)
- model-validation (1)
- kserve (1)
- kueue (1)
- ai-governance (1)
- ai-gateway (1)
- llm-routing (1)
- cost-control (1)
- api-management (1)
- knowledge-base (1)
- wissensmanagement (1)
- data-labeling (1)
- label-studio (1)
- annotation (1)
- ml-training (1)
- pytorch (1)
- torchserve (1)
- tensorflow-serving (1)
- seldon (1)
- ai-monitoring (1)
- llm-observability (1)
- ai-security (1)
- prompt-injection (1)
- guardrails (1)
- summarization (1)
- abstracts (1)
- reports (1)
- ki-pipeline (1)
- translation (1)
- deepl-alternative (1)
- neural-mt (1)
- private-registry (1)
- offline (1)
- nomad (1)
- ambassador-pattern (1)
- envoy (1)
- ambassador (1)
- gloo (1)
- api-security (1)
- authentication (1)
- oauth2 (1)
- api-versioning (1)
- deprecation (1)
- architektur-review (1)
- argo-workflows (1)
- ml-pipelines (1)
- orchestrierung (1)
- applicationset (1)
- audit-trail (1)
- forensik (1)
- aspice (1)
- iso-26262 (1)
- software-defined-vehicle (1)
- vda-isa (1)
- developer-portal (1)
- s3 (1)
- bastion-host (1)
- batch-production (1)
- recipe-management (1)
- process-industries (1)
- göttingen (1)
- niedersachsen (1)
- bayern (1)
- hessen (1)
- frankfurt (1)
- finanzsektor (1)
- kostenvergleich (1)
- nrw (1)
- bildung (1)
- hochschule (1)
- jupyterhub (1)
- e-learning (1)
- blue-green-deployment (1)
- kubernetes-buch (1)
- nigel-poulton (1)
- kubernetes-bootcamp (1)
- workshop-deutschland (1)
- intensivkurs (1)
- präsenztraining (1)
- kubernetes-schulung (1)
- bsi-c5 (1)
- iso27001 (1)
- budget (1)
- cfo (1)
- fachliteratur (1)
- bulkhead-pattern (1)
- service-isolation (1)
- bvlos (1)
- change-management (1)
- litmuschaos (1)
- chaos-mesh (1)
- litmus (1)
- chemie (1)
- seveso (1)
- ot-it-konvergenz (1)
- chromadb (1)
- prototype (1)
- network-security (1)
- hubble (1)
- circuit-breaker (1)
- security-best-practices (1)
- cis-benchmarks (1)
- security-standards (1)
- sicherheit (1)
- containersicherheit (1)
- cloud-support (1)
- lifecycle-management (1)
- node-scaling (1)
- upgrade (1)
- network-policy (1)
- policy-enforcement (1)
- grundschutz (1)
- yolo (1)
- config-management (1)
- configuration (1)
- configuration-drift (1)
- image-pull (1)
- spring-boot (1)
- cost-monitoring (1)
- chargeback (1)
- cqrs-pattern (1)
- command-query-segregation (1)
- crashloopbackoff (1)
- custom-metrics (1)
- cyber-range (1)
- training-environment (1)
- security-exercises (1)
- red-team (1)
- blue-team (1)
- devops-sicherheit (1)
- cyber-resilienz (1)
- dapr (1)
- distributed-systems (1)
- data-sovereignty (1)
- eu-cloud (1)
- database (1)
- deutsche-cloud (1)
- open-telekom-cloud (1)
- dora-metriken (1)
- tooling (1)
- tilt (1)
- onboarding (1)
- digital-twin (1)
- jaeger (1)
- distributed-tracing (1)
- pdf-processing (1)
- mittelstand-deutschland (1)
- documentation (1)
- plattform-engineering (1)
- mkdocs (1)
- dotnet (1)
- dockerfile (1)
- edge-ai (1)
- image-processing (1)
- object-detection (1)
- drohnen-analytik (1)
- edge-ki (1)
- e-books (1)
- kubeedge (1)
- egress (1)
- retail (1)
- einzelhandel (1)
- omnichannel (1)
- emergency-response (1)
- rescue-drones (1)
- disaster-relief (1)
- search-and-rescue (1)
- ephemeral-containers (1)
- kubectl-debug (1)
- distroless (1)
- external-dns (1)
- flagsmith (1)
- banking (1)
- pci-dss (1)
- flight-controller (1)
- real-time-kubernetes (1)
- drone-control (1)
- low-latency (1)
- continuous-delivery (1)
- kubernetes-anfänger (1)
- einsteiger-guide (1)
- lernpfad (1)
- first-steps (1)
- entscheider (1)
- isv (1)
- startup (1)
- httproute (1)
- patientendaten (1)
- github-actions (1)
- sops (1)
- golden-paths (1)
- policy-management (1)
- regulatory (1)
- kubernetes-compliance-deutschland (1)
- dashboards (1)
- handel (1)
- erp (1)
- integration (1)
- anfaenger (1)
- liveness (1)
- readiness (1)
- paketmanagement (1)
- cpu (1)
- hsm (1)
- identity (1)
- container-registry (1)
- harbor (1)
- registry (1)
- images (1)
- immutable-infrastructure (1)
- robotik (1)
- ros (1)
- digital-factory (1)
- loadbalancer (1)
- init-containers (1)
- insider-threat (1)
- behavioral-analytics (1)
- anomaly-detection (1)
- user-monitoring (1)
- threat-detection (1)
- kubernetes-interview (1)
- devops-fragen (1)
- bewerbungsgespräch (1)
- technical-interview (1)
- verschluesselung (1)
- ambient-mesh (1)
- jvm (1)
- cronjobs (1)
- strimzi (1)
- event-streaming (1)
- messaging (1)
- knative (1)
- serverless (1)
- functions (1)
- komplexitaet (1)
- autoscaler (1)
- it-sig (1)
- cli (1)
- produktivitaet (1)
- tools (1)
- policy-engine (1)
- llm-hosting (1)
- llama (1)
- mistral (1)
- self-hosted-ai (1)
- load-balancing (1)
- metallb (1)
- stern (1)
- elk-stack (1)
- grafana-loki (1)
- logistics-container (1)
- transport-it (1)
- shipping-technology (1)
- cloud-native-logistik (1)
- digitale-logistik (1)
- freight-management (1)
- lieferkettengesetz (1)
- multi-standort (1)
- edi (1)
- oem (1)
- fernwartung (1)
- medien (1)
- streaming (1)
- cms (1)
- gpu-transcoding (1)
- regulatory-compliance (1)
- container-compliance (1)
- samd (1)
- meetups (1)
- mes (1)
- domain-driven-design (1)
- monolith (1)
- milvus (1)
- datadog (1)
- cloud-agnostic (1)
- federation (1)
- selinux (1)
- mls (1)
- access-control (1)
- service-provider (1)
- namespaces (1)
- netzwerk (1)
- abfallwirtschaft (1)
- cluster-health (1)
- node-security (1)
- nodejs (1)
- express (1)
- notfall-support (1)
- 24-7-support (1)
- loki (1)
- öffentlicher-sektor (1)
- evb-it (1)
- on-premises (1)
- hybrid-cloud (1)
- tco (1)
- oom-kills (1)
- ressourcenmanagement (1)
- qos-klassen (1)
- memory-management (1)
- memory (1)
- resources (1)
- cost-allocation (1)
- cloudkosten (1)
- kubernetes-kostenoptimierung (1)
- kostenkontrolle (1)
- tracing (1)
- otel-collector (1)
- go (1)
- controller (1)
- crd (1)
- operator-sdk (1)
- outbox-pattern (1)
- debezium (1)
- partner (1)
- kube-hunter (1)
- kubeaudit (1)
- pentest (1)
- tuning (1)
- csi (1)
- pgvector (1)
- vector-extension (1)
- sql (1)
- ai (1)
- vektordatenbank (1)
- hybrid-architektur (1)
- pki (1)
- zertifikate (1)
- playground (1)
- browser (1)
- play-with-kubernetes (1)
- killercoda (1)
- google-cloud-shell (1)
- pod-affinity (1)
- wartung (1)
- pdb (1)
- availability (1)
- eviction (1)
- node-pressure (1)
- psa (1)
- podman (1)
- postmortem (1)
- priority (1)
- preemption (1)
- private-cloud (1)
- production-analytics (1)
- real-time-analytics (1)
- manufacturing-kpis (1)
- oee-monitoring (1)
- kubernetes-production-deutschland (1)
- notfallplan (1)
- progressive-delivery (1)
- flagger (1)
- lessons-learned (1)
- promql (1)
- proof-of-concept (1)
- evaluation (1)
- pulumi (1)
- typescript (1)
- pvc (1)
- persistentvolume (1)
- storageclass (1)
- python (1)
- django (1)
- celery (1)
- qdrant (1)
- quality-control (1)
- post-quantum-cryptography (1)
- quantum-resistant (1)
- future-security (1)
- critical-infrastructure (1)
- post-quanten-kryptographie (1)
- cryptographic-agility (1)
- retrieval-augmented-generation (1)
- enterprise-kubernetes (1)
- service-accounts (1)
- oidc (1)
- kanzlei (1)
- 203-stgb (1)
- mandantendaten (1)
- berufsgeheimnis (1)
- netzwerk-segmentierung (1)
- high-security (1)
- redis (1)
- caching (1)
- cpu-limits (1)
- memory-limits (1)
- limitrange (1)
- error-handling (1)
- automatic-retry (1)
- rightsizing (1)
- goldilocks (1)
- lifecycle (1)
- rolling-updates (1)
- tetragon (1)
- saga-pattern (1)
- distributed-transactions (1)
- side-by-side (1)
- cap (1)
- odata (1)
- supervisory-control (1)
- industrial-automation (1)
- process-control (1)
- industrie-40 (1)
- pod-placement (1)
- seccomp (1)
- apparmor (1)
- linux (1)
- external-secrets (1)
- confidential-computing (1)
- intel-sgx (1)
- amd-sev (1)
- security-architecture (1)
- enterprise-security (1)
- defense-in-depth (1)
- security-design (1)
- kubernetes-security-deutschland (1)
- kspm (1)
- devsecops (1)
- service-account (1)
- workload-identity (1)
- token (1)
- service-catalog (1)
- service (1)
- endpoints (1)
- readiness-probe (1)
- servicemonitor (1)
- podmonitor (1)
- prometheus-operator (1)
- services (1)
- datenbanken (1)
- container-isolation (1)
- kata-containers (1)
- gvisor (1)
- multi-container (1)
- skill-gap (1)
- sli (1)
- node-pools (1)
- stable-diffusion (1)
- ki-infrastruktur (1)
- self-hosting (1)
- stadtwerke (1)
- ot-it-integration (1)
- disa-stig (1)
- security-hardening (1)
- military-compliance (1)
- dod-standards (1)
- cloud-native-security (1)
- cybersicherheit (1)
- bsi-it-grundschutz (1)
- persistent-volumes (1)
- slsa (1)
- freelancer (1)
- workload-isolation (1)
- talos-linux (1)
- immutable-os (1)
- team-aufbau (1)
- recruiting (1)
- team-structure (1)
- platform-teams (1)
- pipelines (1)
- remote-development (1)
- quality-assurance (1)
- threat-intelligence (1)
- stix (1)
- taxii (1)
- threat-feeds (1)
- tpm (1)
- attestation (1)
- keylime (1)
- schulung (1)
- triton-inference (1)
- kubernetes-twitter (1)
- x-accounts (1)
- tech-twitter (1)
- influencer (1)
- raspberry-pi (1)
- homelab (1)
- developer-environments (1)
- isolation (1)
- cloud-exit (1)
- vait (1)
- solvency-ii (1)
- vllm (1)
llm-inferenz (1)
- vmware (1)
- optimierung (1)
- vulnerability-management (1)
- vulnerability-scanning (1)
- windows-container (1)
- hybrid-cluster (1)
- wissensaufbau (1)
- training (1)
- youtube (1)
- video-tutorials (1)
- zero-touch-provisioning (1)
- erfahrungsbericht (1)
- rezertifizierung (1)
- kubernetes-zertifikat-lebenslauf (1)
- cka-cv (1)
- devops-bewerbung (1)
- zertifikate-präsentieren (1)
- lerngruppe (1)
- online-prüfung (1)
- psi (1)
- platform9 (1)
- plattformvergleich (1)
- referenzen (1)
- soc (1)
- portabilität (1)
- exit-strategie (1)
- mlflow (1)
- strangler-pattern (1)
- cloud-provider (1)
- tenant-isolation (1)
- managed-kubernetes-deutschland (1)
- meldepflicht (1)
- managed-security (1)
- ot-security (1)
- produktion (1)
- zulieferer (1)
- gpu-workloads (1)
- post-quantum (1)
- tls (1)
- pca (1)
- prometheus-certified-associate (1)
- monitoring-zertifizierung (1)
- kubernetes-monitoring-deutschland (1)
- plattform-vergleich (1)
- rke2 (1)
- siem (1)