Senior Data Engineer
Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic and technology-proficient Senior Data Engineer, who is eager to participate in design and implementation of a top-notch big data solution that will be deployed at a massive scale.
Responsibilities :
- Build data pipelines to enable training of LLMs
- Work with technical and non-technical stakeholders to collect requirements, integrate with data systems and deliver large-scale datasets
- Operate in a complex multi-cloud data lakehouse, building end-to-end integrated workflows
- Work with privacy, security, and other policy stakeholders to design, review and implement solutions to automate compliant ETL for downstream teams
Requirements :
- Strong understanding of machine learning principles, especially in the context of LLMs.
- 5+ years of experience in big data engineering
- Proficiency in Java, Scala, Spark
- Proficiency in PySpark and Golang(preferred)
- Experience building and leveraging large scale data infrastructure, map-reduce/hadoop , cloud-native deployments
- Experience with alerting, monitoring and remediation automation in a large scale distributed environment
- BS/BA or equivalent degree in computer science or similar (preferred)
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
Don’t see the right opportunity?
Contact us anyway and let’s talk! To apply, send your resume and cover letter to jobs@griddynamics.com
Grid Dynamics is an equal opportunity employer. We are committed to creating an inclusive environment for all employees during their employment and for all candidates during the application process.
All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. All employment is decided on the basis of qualifications, merit, and business need.
Get in touch
Let's connect! How can we reach you?
Thank you!
It is very important to be in touch with you.
We will get back to you soon. Have a great day!
Something went wrong...
There are possible difficulties with connection or other issues.
Please try again after some time.