Job Information
News Corp Data Engineer in Bangalore, India
Job Description :
Data Engineer
About the Role
We are looking for a Data Engineer with experience in analytical abilities in GCP BigQuery, ETL/BI, Python, Composer /Airflow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 3+ years of working experience as a hands-on data engineering is a must
➔ Advanced Degree in the field of Computer Science, Data Engineering, Data Analytics or equivalent discipline
➔ Strong programming experience with Python, SQL, ETL and efficiently querying big datasets using SQL
➔ Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
➔ Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
➔ Experience in working with Front end technologies such as React, Angular, Flask, Javascript, HTML, CSS is a plus.
➔ Domain knowledge on News, Media & Communications is an added advantage.
R E S P O N S I B I L I T I E S
Design, implement, and maintain the scalable and reliable GCP cloud-based data infrastructure and BI - ELT processes
Collaborate with cross-functional teams to define data architecture and data warehouse requirements
Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools
➔ Deliver production quality, modular, reproducible code in Python, SQL
➔ Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
➔ Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
● Google Cloud Platform is IaaS
● BigQuery, GCS, Python, SQL
● Composer / Airflow - orchestration tools
● Terraform, CircleCI, CI/CD, GIthub, Jira, Confluence
This job is posted with NTS Technology Services Pvt. Ltd.
Job Category:
News Corp is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content to consumers throughout the world. The company comprises businesses across a range of media, including: news and information services, book publishing, digital real estate services, cable network programming in Australia, and pay-tv distribution in Australia.
Headquartered in New York, the activities of News Corp are conducted primarily in the United States, Australia, and the United Kingdom.