Hewlett Packard Enterprise Company Senior Data Engineer - Scala/Spark/SQL in San Jose, California
Senior Data Engineer - Scala/Spark/SQL San Jose, California
What you need to know about the job
At Hewlett Packard Enterprise, we bring together the brightest minds to create breakthrough technology solutions that advance the way people live and work. What sets us apart? Our people and our relentless dedication to helping our customers make their mark on the world.
We are a team of doers, dreamers and visionaries; inspired by our purpose and driven by our strategy. We live by our three values: partner, innovate and act.
Our legacy inspires us as we forge ahead, always pushing to discover what’s next. Every day is a new opportunity to advance and grow ourselves, our company and the industry. Some people call it an obsession, we call it a way of life.
What you need to know about the job
Primary Location:San Jose, California
Other Locations:Andover, Massachusetts, United States of America; Durham, North Carolina, United States of America; Teleworker, California, United States of America; Teleworker, Massachusetts, United States of America; Teleworker, North Carolina, United States of America; Teleworker, Oregon, United States of America; Teleworker, Texas, United States of America; Teleworker, Washington, United States of America
Shift:No shift premium (United States of America)
We are currently looking for a Data Engineer to join our growing Infosight Data engineering team within HPE to take on Data engineering and cross-stack analytics challenges.
HPE InfoSight collects hundreds of terabytes of operational and diagnostic telemetry from our customers, which enables us to help them get the most out of their IT infrastructure. As part of the Infosight team, you will work on cutting-edge projects, with high visibility.
If you have the relevant experience, have a passion for quality and good software engineering practices, and enjoy working in a fast-paced, highly rewarding environment, then HPE is the place for you.
In this role you will:
Innovate, design, develop data extraction, transfer and load programs for large data warehouse to achieve near real-time speeds
Automate data collection, pre-processing, governance, and analysis.
Work closely with data scientists, platform, and UI teams to implement the data processing logic using Scala, Spark batch, Spark Streaming, Pulsar/kafka,, Kubernetes and akka on AWS.
Communicate findings clearly and succinctly to technical and non-technical audience.
Education and Experience Required:
Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent.
Typically 6-10 years experience.
Strong programming skills in Scala.
Proficient in distributed computing frameworks such as Spark, micro-services, and Kafka.
Expertise in writing and understanding complex SQL queries
Demonstrates strong attention to detail.
Experience with database architecture and design including scalability, performance and high availability .
Experience in data cleaning techniques, ETL, and data visualizations.
Ability to work independently in a fast-paced, iterative development environment.
Strong communication skills and team player
What We Can Offer You:
Extensive benefits, a competitive salary and participation in the shared values and purpose that make Hewlett Packard Enterprise one of the world´s most attractive employers! At HPE, our goal is to provide equal opportunities, flexible work-life balance, and constantly evolving career growth.
If you are looking for challenges in an exciting, supportive and international work environment, then we definitely want to hear from you.
Continue the conversation by clicking apply now below, or directly via our Careers Portal at www.hpe.com/careers.
Join us and make your mark! Find out more about us and follow us on:
HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT and Affirmative Action employer. We are committed to diversity and building a team that represents a variety of backgrounds, perspectives, and skills. We do not discriminate and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global diverse team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together
HPE is an equal opportunity employer/Female/Minority/Individual with Disabilities/Protected Veteran Status