Inference Pipeline

Intermediate

Model execution path in production.

Full Definition

Model execution path in production.

Keywords

serving path

Domains

MLOps & Infrastructure

Related Terms

Batch Inference related to

Running predictions on large datasets periodically.

 Online Inference related to

Low-latency prediction per request.

 Shadow Deployment related to

Running new model alongside production without user impact.

 Canary Release related to

Incrementally deploying new models to reduce risk.

 MLOps related to

Practices for operationalizing ML: versioning, CI/CD, monitoring, retraining, and reliable production management.

 CI/CD for ML related to

Automated testing and deployment processes for models and data workflows, extending DevOps to ML artifacts.

 Monitoring related to

Observing model inputs/outputs, latency, cost, and quality over time to catch regressions and drift.

 Training Pipeline related to

End-to-end process for model training.

Concept Map

See how Inference Pipeline connects to other concepts.

Open Knowledge Graph