- Home
- ...
- Open Positions
- Job Detail
Description and Requirements
Description and Requirements
We are looking for a highly skilled Manager of Quality Engineering for Observability and AI to lead our efforts in ensuring the quality and reliability of our observability solutions and AI-powered systems. This role will oversee the testing, validation, and optimization of AI-driven monitoring tools and observability platforms while ensuring that AI models and data pipelines meet the highest standards of performance, scalability, and accuracy. The ideal candidate will have deep experience in quality engineering, observability, AI/ML, and performance monitoring.
Here is how, through this exciting role, YOU will contribute to BMC's and your own success:
- Leadership & Team Management: Lead and mentor a team of quality engineers focused on AI systems, observability platforms, and monitoring tools, driving a culture of quality, collaboration, and continuous improvement.
- Quality Assurance Strategy for Observability & AI Systems: Develop and execute comprehensive quality engineering strategies for AI-powered observability solutions, ensuring that monitoring, logging, and alerting systems meet performance, reliability, and accuracy standards.
- Observability & AI Testing: Ensure the observability systems for AI/ML models and applications are well-tested and continuously monitored for performance, scalability, and reliability.
- Integration of Observability into AI Systems: Drive automation of testing for observability components such as metrics collection, alerting thresholds, and log generation to ensure high availability and real-time monitoring of AI systems.
- Collaboration & Cross-Functional Communication: Partner with AI, DevOps, SRE (Site Reliability Engineering), and product teams to ensure a holistic approach to quality and observability across AI systems.
To ensure you’re set up for success, you will bring the following skillset & experience:
- You have 12+ years of experience in Manual and automation testing/Engineering
- Strong knowledge of AI/ML testing methodologies, model evaluation metrics, and data pipeline testing.
- Proficiency in observability and monitoring tools (e.g., Prometheus, Grafana, ELK stack, Splunk) and frameworks for real-time metrics, alerting, and logging.
- Expertise in test automation (selenium - Java; Python), particularly for AI applications and observability systems.
- Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and their monitoring capabilities for AI-driven solutions.
- You have experience in Agile development model with exposure to Jira, confluence, etc.
Good to have:
- Certification in AI/ML (e.g., TensorFlow, machine learning certifications) or observability tools.
- Experience with real-time monitoring and anomaly detection systems in AI applications.
- Familiarity with AI fairness, explainability, and bias detection techniques in AI systems.
Why Work Here? Because You’ll Matter.
We’re not hiring for roles—we’re hiring for impact. At Helix, you’ll solve hard problems, build smart solutions, and work with people who challenge and champion you. You’ll see your ideas come to life—and your work make a difference.
We believe in trust, transparency, and grit. Our culture is inclusive, flexible, and built for people who want to stretch themselves - and support others doing the same. Whether you’re remote or in-office, you’ll find space to show up fully and contribute meaningfully. You won’t be boxed in—you’ll be backed up.
Make Your Mark At Helix
If Helix excites you but you're unsure if you meet every qualification, apply anyway. We value diverse perspectives and believe the best ideas come from everywhere.
EEOC Statement
Helix is committed to equal opportunity employment regardless of race, age, sex, creed, color, religion, citizenship status, sexual orientation, gender, gender expression, gender identity, national origin, disability, marital status, pregnancy, disabled veteran or status asa protected veteran. If you need a reasonable accommodation for any part of the application and hiring process, visit the accommodation request page.
(Returnship@BMC)
Had a break in your career? No worries. This role is eligible for candidates who have taken a break in their career and want to re-enter the workforce. If your expertise matches the above job, visit to https://bmcrecruit.avature.net/returnship know more and how to apply.