Experience Inc. Jobs

Job Description

• Design, develop, and maintain scalable data pipelines using Apache Spark (with Scala or Python) on Google Cloud Dataproc.

• Develop and manage real-time data streaming solutions using Apache Kafka.

• Orchestrate complex data workflows and pipelines with Airflow scheduler.

• Optimize and improve existing data pipelines and architecture for performance, scalability, and cost-effectiveness.

• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and ensure the availability and accuracy of data.

• Implement data quality, governance, and security measures to ensure the integrity of data.

• Develop and maintain data models and schemas in BigQuery and other cloud-based data stores.

• Collaborate with cross-functional teams to support data-driven decision-making processes.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

• Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.

• Proven experience (5+ years) in data engineering, software engineering, or a similar role.

• Strong proficiency in Apache Spark and Scala or Python.

• Experience with Apache Kafka for real-time data streaming.

• Hands-on experience with Airflow for orchestration and scheduling of workflows.

• Solid understanding of cloud platforms, especially Google Cloud Platform (GCP), including services like Dataproc, BigQuery, Cloud Storage, and Cloud Pub/Sub.

• Proficiency in SQL and experience with data warehousing solutions like BigQuery.

• Familiarity with data modeling, ETL processes, and data warehousing concepts.

• Strong problem-solving skills and the ability to work in a fast-paced environment.

• Excellent communication and collaboration skills.

• Software engineering with knowledge on building Data service APIs using Java Springboot is a plus null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.