Job Information
Financial Insight Technology, Inc. dba SmartAsset Senior Data Engineering Manager in New York, New York
Senior Data Engineering Manager (Financial Insight Technology, Inc. dba SmartAsset, New York, NY)Lead data engineering efforts and play a vital role in turning data into a strategic asset by ensuring that data platforms are scalable, secure, and efficient. Lead and mentor a high-performing team of data engineers, fostering innovation and collaboration. Oversee the development of scalable, high-performance data platforms using current technology and best practices. Develop and maintain advanced ETL pipelines in Python. Implement real-time streaming data pipelines. Optimize SQL queries for data retrieval. Utilize AWS services for efficient data storage and processing. Manage cloud storage systems for data storage efficiency. Implement Docker containerization for scalable ETL pipelines. Apply advanced statistical methods for data analysis and modeling. Utilize Snowflake data warehouse for data loading and query optimization. Facilitate data exchange with external vendors and organizations via APIs. Ensure data deliverables adhere to regulatory and security requirements. Establish CI/CD pipelines for automated deployment and testing. Leverage Spark for distributed data processing tasks. Utilize data modeling techniques to guarantee data accuracy. Enhance data pipelines for quality, security, efficiency, and scalability. Use proficient written and verbal communication skills to collaborate with cross-functional teams, facilitating the delivery of data for analytics and machine learning purposes. Position allows telecommuting from anywhere in the U.S. Salary: $176,000 - $230,000 per year.MINIMUM REQUIREMENTS: Bachelor’s degree or U.S. equivalent in Computer Science, Computer Engineering, Information Management, or related field, plus 5 years of professional experience as a Data Engineer, Information Architect, or any occupation/position/job title involving leading data engineering projects in a production environment.In lieu of a Bachelor's degree plus 5 years of experience, the employer will accept a Master's degree or U.S. equivalent in Computer Science, Computer Engineering, Information Management, or related field, plus 3 years of professional experience as a Data Engineer, Information Architect, or any occupation/position/job title involving leading data engineering projects in a production environment.Must also have experience in the following: 2 years of professional experience processing data utilizing Snowflake, Redshift, Spark, or Hadoop; 2 years of professional experience prototyping Python-based ETL solutions and translating complex requirements into actionable tools; 2 years of professional experience utilizing SQL including advanced query optimization; 2 years of professional experience utilizing data modeling and relational database technologies and data warehousing systems including Snowflake or Redshift; 2 years of professional experience utilizing cloud platforms including AWS or GCP; and 2 years of professional experience utilizing Spark for distributed data processing.CONTACT: Apply online at https://smartasset.com/careers
Minimum Salary: 176000 Maximum Salary: 230000 Salary Unit: Yearly