Job Information
CTG Quality Engineer Test Data Management in Albany, New York
CTG is seeking to fill a Quality Engineer Test Data Management opening for our client in Albany, NY.
Location: Albany, NY
Duration: 12 months
Duties:
Manage and ensure the quality of test data within various environments.
Utilize Databricks platforms to create, manage, and execute test data tasks in notebooks and clusters.
Perform data processing, transformation, and validation within Databricks, using Delta Lake and SQL Endpoints for data handling.
Create, modify, and manage test data pipelines and automation jobs.
Work with Apache Spark for data manipulation, leveraging libraries such as Spark SQL, MLlib, and Spark Streaming.
Collaborate with cross-functional teams to ensure test data is complete, accurate, and aligns with project requirements.
Troubleshoot and resolve issues related to test data quality and integrity.
Assist in the development of documentation for test data management processes.
Skills:
Expertise with Databricks notebooks, clusters, and job scheduling.
Strong proficiency in Python for data processing and automation.
Advanced skills in SQL for data querying, manipulation, and database management.
Knowledge of Databricks features such as Delta Lake, SQL Endpoints, and AutoML.
In-depth experience with Apache Spark, including RDDs, DataFrames, Datasets, and transformations.
Familiarity with cloud computing platforms, including AWS, Azure, and GCP.
Excellent problem-solving skills and attention to detail in data management.
Experience:
Proven experience in data management, specifically within test data environments.
Hands-on experience with Databricks and Apache Spark for large-scale data processing and automation.
Familiarity with data manipulation and transformation in cloud-based platforms (AWS, Azure, GCP).
Experience in working within Agile environments and collaborating with cross-functional teams.
Education:
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services for this role.
To Apply:
To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Recruiter, Laura Dominguez at laura.dominguez@ctg.com . Kindly forward this to any other interested parties. Thank you!
About CTG
CTG, a Cegeka company, is at the forefront of digital transformation, providing IT and business solutions that accelerate project momentum and deliver desired value. Over nearly 60 years, we have earned a reputation as a faster and more reliable, results-driven partner. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. CTG leverages the expertise of over 9,000 team members in 19 countries to provide innovative solutions. Together, we operate across the Americas, Europe, and India, working in close cooperation with over 3,000 clients in many of today's highest-growth industries. For more information, visit www.ctg.com .
Our culture is a direct result of the people who work at CTG, the values we hold, and the actions we take. In other words, our people define our culture. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. Part of our mission is to cultivate a workplace that attracts and develops the best people, reflected by our recognition as a Great Place to Work Certified™ company across many of our global operations.
CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.
CTG is an Equal Opportunity and Affirmative Action Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. Our Affirmative Action program serves to promote occupational equality and diversity through good faith efforts. CTG is fully committed to promoting employment opportunities for members of protected classes.
CTG
-
- CTG Jobs