In a large financial services institution we provisioned an end-to-end automated and integrated Cloud-based solution for detecting Data/Model Bias and measuring drift based on model Metrics to allow for corrective actions.
Interested in working on projects like this?
Cloud, Technical Consulting, Engineering
Amazon Web Services
In a large financial services institution, we built and deployed a centralized, automated model deployment capability from on-prem to the Cloud. We enabled a single click deployment for the entire Cloud resources using Infrastructure as Code.
We automated the end-to-end system, enabled scheduled monitoring to detect drifts between different Machine Learning models, and provided notifications to stakeholders for remediation actions. We encrypted sensitive information at all levels of data communications from on-prem to Cloud and reverse. The solution enabled a highly available, scalable & secure system.
Using sophisticated tools, we built, integrated, and deployed an end-to-end Machine Learning Model Monitoring from a Model Inference system.
We worked with the client to understand their needs and set objectives/parameters to automate monitoring and detection of Data/Model Bias as well as drift, and generate feature importance reports for Data Scientists and stakeholders for management/governance.
Based on the client’s specific needs, we chose best-in-class, fit-for-purpose tools across all accounts and enterprise requirements. These included tools for sensitive data encryption between on-prem to Cloud and vice-versa, and tools for monitoring/reporting.
We enabled the single click end-to-end deployment via automated pipelines, utilized Cloud native services for bias detection, and generated explanations for compliance and legal requirements.
We successfully built and deployed a fully automated Model Monitoring from the Model Inference platform to monitor Data/Model Bias and departures from organizational thresholds, measure drift and allow for reporting and corrective actions to be taken. The platform also uses SHAP values for feature importance reporting and offers high availability, scalability, and a secure design.