CafeMedia Tech - Data Engineer, Data Platform Team in New York City, New York
Skills and Experience
3+ years of post graduate experience working with Big Data technologies (e.g., Hadoop, Hive, Spark, Presto, Kafka, etc).
Understanding of serverless architectures (AWS, Lambda, Kubernetes, etc)
Skilled at crafting and building robust backend data services.
Expertise in object-oriented and/or functional programming languages (e.g., Python, Typescript).
Strong dedication to code quality, automation and operational excellence: unit/integration tests, scripts, workflows.
Expertise developing and tuning SQL or other query languages.
Excellent written and verbal communication and social skills enabling effective collaboration with internal and external partners.
Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience.
Work with other data engineers to build out our data lake and platform to process 100s of terabytes of data.
Optimize performance of these systems by profiling and identifying bottlenecks
Build systems that are secure and compliant
Improve observability and understandability of the various systems
Design and develop data ingestion pipelines of data from in-house OLTP systems and third-party data.
Design and develop ETL pipelines to process data in data lake for descriptive and prescriptive reporting and analysis
Design, develop, and test robust, scalable data platform components.
Work with a variety of teams and individuals to understand their data pipeline needs and come up with innovative solutions.
The position reports directly to the VP of Technical Operations.
Beyond experience in a software engineering role, we focus on the qualities we feel are important to success on our team. These include:
Pragmatic -- able to view the big picture and create the simplest solution. You spend effort for impact.
Adaptable -- you jump in, learn, and help where needed; you thrive in an agile team and pivot when necessary
Ownership - you take end-to-end responsibility for your work, from understanding the “why” behind requirements to owning the result of your work in production
Leadership -- Ability and willingness to contribute to technical direction. Improves the entire team and shares in team success. You consider where we need to be in the future.
Detail Oriented -- you obsess over data integrity, and pursue a deep understanding of data semantics
Curious -- you actively seek industry and technical knowledge and share what you’ve learned with the team; you like to learn something out of your comfort zone
Continuous Improvement -- you leave things in a better state than how you found them; you strive for incremental improvement. You consider where we need to be in the future.
Open Minded - you’re not fixated on your own ideas or approaches, and accept ideas from others; you seek context rather than taking something on without external input
Proactive -- you take initiative with tasks, both big and small
CafeMedia’s mission is to build a creator-first future. We empower the world’s best creators and independent publishers to grow thriving businesses for the long term. Under our CafeMedia and AdThrive brands, we manage digital advertising sales and technology and a growing number of services for more than 3,000 creators and independent publishers. We make it easy for them to focus on what they do best — produce great content.
Our passion and expertise have made us a leader in advertising and creator services. Today we rank as the 10th largest digital property in the U.S. and #1 in Food, Family, Home, and Lifestyle--with a reach of nearly 175M monthly unique visitors in the U.S. alone.
To learn more about working at CafeMedia, visit: https://cafemedia.com/careers/
CafeMedia is committed to diversity, equity, and inclusion. We believe we are most impactful when people with a wide range of backgrounds, experiences, and identities come together with common purpose. We encourage candidates from all backgrounds to apply. CafeMedia is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please reach out to a member of our recruiting team.
Powered by JazzHR