Why CDM Smith?:
Check out this video and find out why our team loves to work here!
Join Us! CDM Smith – where amazing career journeys unfold.
Imagine a place committed to offering an unmatched employee experience. Where you work on projects that are meaningful to you. Where you play an active part in shaping your career journey. Where your co-workers are invested in you and your success. Where you are encouraged and supported to do your very best and given the tools and resources to do so. Where it’s a priority that the company takes good care of you and your family.
Our employees are the heart of our company. As an employer of choice, our goal is to provide a challenging, progressive and inclusive work environment which fosters personal leadership, career growth and development for every employee. We value passionate individuals who challenge the norm, deliver world-class solutions and bring diverse perspectives. Join our team, and together we will make a difference and change the world.
Job Description: CDM Smith is seeking a Senior Data Quality Assurance and Quality Control Analyst to join our Digital Engineering Solutions team. This individual will be part of the Development group within the Digital Engineering Solutions team, helping design and implement data validation processes that ensure high data integrity and support robust data pipelines. An ideal candidate will be a critical thinker, proactive, and highly interested in applying new technologies and methods for data quality improvement. This individual must showcase exceptional abilities in developing and implementing QA/QC solutions for AEC initiatives that involve complex datasets and advanced analytics. As a member of the Digital Engineering Solutions team, the individual will be engaged in research and development, providing guidance and oversight into data quality standards and practices at CDM Smith, as well as participating in the evaluation and adoption of innovative technologies and methodologies that arise from across the company. The ideal candidate must have extensive experience in data quality management and a demonstrated commitment to continuous improvement and measurable results. The following are the key responsibilities for this position: • Take responsibility for the project and work independently in a collaborative environment. • Evaluate data across various dimensions, including accuracy, completeness, consistency, validity, timeliness, uniqueness, and integrity. • Establish quality criteria for data accuracy, completeness, consistency, validity, and AI model performance. • Test data ingestion, transformation (ETL/ELT), and outputs to ensure source-to-target integrity. • Verify that datasets used for AI/ML are accurate, representative, unbiased, and fit for purpose. • Validate model metrics against defined business and technical thresholds, including accuracy, precision, recall, and stability. • Identify and assess bias, fairness issues, and unintended impacts in data and AI model outcomes. • Implement automated tests for data validation, model regression, and pipeline checks within CI/CD and MLOps workflows. • Log, prioritize, and track data and AI defects; perform root cause analysis and corrective actions. • Validate adherence to data governance, privacy, security, and AI regulatory requirements. • Track data drift, model drift, anomalies, and performance degradation post-deployment. • Communicate quality status, risks, and recommendations clearly to stakeholders before and after releases. • Design and develop testing plans, test cases, and test scripts to evaluate data quality. • Identify, document, and report defects, inconsistencies, and inaccuracies. • Maintain and update testing documentation and report on test outcomes. Document key data processes and transformations. • Assist with quality improvement initiatives and recommend improvements to data quality processes and procedures. • Assist developers, business stakeholders, and data governance teams in meeting data quality standards. • Knowledge of the Agile/Waterfall approach and how quality assurance fits into it. • Create automated testing solutions from scratch. • Develop testing scenarios by analyzing feature requirements for the purpose of estimating testing effort. Track defects, analyze and communicate test results, and engage in daily QA activities. Skills and Abilities: • Ability to take ownership of the project and work independently in a team environment. • Ability to analyze problems, perform root cause analysis, and develop solutions is essential for resolving data issues. • Proficient in PyTest/unit test frameworks used for ML testing & automation • Knowledge of programming languages such as C#, Python, or R for data process automation and analysis. • Proficient in automated test suite development for ML models • Working knowledge of ML-specific API testing (e.g., inference endpoints) • Working knowledge of automated metrics validation for model outputs • Expertise in the principles and testing procedures. • Working knowledge of data validation frameworks such as Great Expectations • Working knowledge of ML-oriented data pipeline tools . • Working knowledge of validation for massive, ML-ready datasets • Proficient in ML-specific QA strategy (model tests, feature tests, data contracts, drift tests). • Working knowledge of CI/CD integration for ML (MLOps). • Proficient in model-centric regression testing. • Proficient in testing lineage, reproducibility, and experiment tracking. • Proficient in developing and maintaining test plans, test scenarios, test cases, test defect tracking, summary reporting, and test scripts to perform thorough testing and validate the data, based on business requirements. • Familiarity with Extract, Transform, Load (ETL) tools to move and transform data. • Working knowledge of AI governance framework, ethical AI & compliance, bias monitoring policies, and model traceability requirements • Working knowledge of debugging tools (Fiddler). • Proficiency with version control practices using Git, including branching, collaboration, reviewing pull requests, and resolving merge conflicts. • Knowledge of build servers. (Azure CICD Pipeline, Jenkins, and Cruise Control). • Working knowledge of source control systems (DevOps, GitHub, SVN, or TFS). • Working experience in release management and bug tracking tools (e.g., Zephyr, etc.). • Knowledge of HTML5, CSS, JavaScript, Angular Bootstrap, SQL, SharePoint, JSON, or XML objects. • Knowledge of API testing using Postman and Swagger UI. • Knowledge of Azure cloud infrastructure and its capabilities. • Strong verbal and written communication skills are needed to explain findings to both technical and non-technical stakeholders. • A willingness to learn new tools and adapt to evolving technologies is important for long-term career growth. Skills & Abilities: Excellent understanding of QA methodologies, tools, and processes including expertise in complex testing scenarios and advanced automation. Mastery of industry-standard testing tools and ability to evaluate and implement new testing technologies. Excellent communication, collaboration, and presentation skills with the ability to convey complex concepts in an understandable manner. Strong facilitation skills and ability to lead technical discussions across multiple teams. Consistently demonstrates strong attention to detail with a commitment to delivering high-quality work. Expert ability to identify complex quality issues and establish quality standards for others. Possesses strong knowledge of automated testing frameworks and scripting or programming languages. Proven ability to design and implement complex automation solutions and mentor others in automation best practices. Strong analytical, problem-solving, and critical-thinking skills, with the ability to lead more junior analysts as part of a team. Advanced ability to solve complex technical problems and drive innovative testing solutions. Demonstrates thought leadership and influence where no direct line of control exists. Ability to navigate complex organizational dynamics and drive change in ambiguous situations. Knowledge of CI/CD pipelines and DevOps practices with expertise in designing testing strategies for continuous deployment. Advanced understanding of infrastructure as code and cloud-native testing approaches. Qualifications: Bachelor's degree. 5 years of related experience. Equivalent additional directly related experience will be considered in lieu of a college degree. Domestic and/or international travel may be required. The frequency of travel is contingent on specific duties, responsibilities, and the essential functions of the position, which may vary depending on workload and project demands. Preferred Qualifications: ISTQB or equivalent certification preferred Amount of Travel Required: No Travel is required Background Check and Drug Testing Information: CDM Smith Inc. and its divisions and subsidiaries (hereafter collectively referred to as “CDM Smith”) reserves the right to require background checks including criminal, employment, education, licensure, etc. as well as credit and motor vehicle when applicable for certain positions. In addition, CDM Smith may conduct drug testing for designated positions. Background checks are conducted after an offer of employment has been made in the United States. The timing of when background checks will be conducted on candidates for positions outside the United States will vary based on country statutory law but in no case, will the background check precede an interview. CDM Smith will conduct interviews of qualified individuals prior to requesting a criminal background check, and no job application submitted prior to such interview shall inquire into an applicant's criminal history. If this position is subject to a background check for any convictions related to its responsibilities and requirements, employment will be contingent upon successful completion of a background investigation including criminal history. Criminal history will not automatically disqualify a candidate. In addition, during employment individuals may be required by CDM Smith or a CDM Smith client to successfully complete additional background checks, including motor vehicle record as well as drug testing. Additional Compensation: All bonuses at CDM Smith are discretionary and may or may not apply to this position.
