Experience Inc. Jobs

Description We are offering a long term contract employment opportunity for a Data Engineer in the Apparel Manufacturing sector based in Broomfield, Colorado. This role primarily involves integrating and migrating orchestration jobs from Databricks into Apache Airflow, optimizing workflows for cost efficiency, and working with Azure cloud services and data platforms like Snowflake and Databricks.

Responsibilities:

• Lead the full implementation of Apache Airflow in a structured, phased approach.

• Migrate orchestration jobs out of Databricks into Apache Airflow with a focus on efficiency and scalability.

• Collaborate with cross-functional teams to write clear documentation, design migration strategies, and create scalable, optimized scheduling solutions.

• Set up cost-optimized schedules and workflows to ensure resource efficiency.

• Work with Azure Key Vault to manage authentication and ensure secure access.

• Utilize Azure DevOps and GitHub for version control, including configurations and setup.

• Build and manage DevOps pipelines (Azure Pipelines/GitHub Actions) for continuous integration and deployment.

• Migrate and manage data pipelines from Databricks to Airflow while maintaining seamless integration with Azure Blob Storage.

• Collaborate with data engineers to ensure smooth data flow from APIs and other data sources into cloud data platforms such as Snowflake.

• Set up Sumo Logic for monitoring workflows, system health, and performance in Airflow and integrated platforms.

• Perform regular cost reviews and optimize schedules to ensure budgetary compliance. Requirements • Possesses a minimum of 10 years of experience as a Data Engineer

• Holds extensive knowledge and experience in Cloud Technologies

• Demonstrates proficiency in Database management and API Development

• Familiarity with GitHub for version control is essential

• Experience working with Apache Airflow for workflow management

• Skilled in using Azure Blob Storage and Azure DevOps for data storage and operations

• Has experience in using Snowflake for data warehousing

• Proficiency in Databricks and Azure Databricks for big data analytics

• Familiarity with Sumo Logic for log management and analytics

• Must possess excellent problem-solving skills and attention to detail

• Strong verbal and written communication skills

• Shows a commitment to staying updated with the latest industry trends and advancements

• Able to work independently and as part of a team

• Demonstrates strong project management and organizational skills. Technology Doesn't Change the World, People Do.®

Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .