Sagemaker

AWS has introduced comprehensive observability for Amazon SageMaker AI LLM inference, providing insights into GPU utilization and LLM quality. This feature enables users to monitor and optimize their AI models for better performance and efficiency.

AWS Machine Learning Blog: Build a custom portal with embedded Amazon SageMaker AI MLflow Apps. Create a custom portal with embedded Amazon SageMaker AI MLflow Apps to streamline your machine learning workflows.