Senior Data Scientist

Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic and technology-proficient Senior Data Scientist, who is eager to participate in design and implementation of a top-notch big data solution that will be deployed at a massive scale. 

Responsibilities : 

• Work with technical and non-technical stakeholders to design and execute research testing how humans evaluate LLM features.
• Conduct research with humans to validate and create automated benchmarks for LLM evaluations.

Requirements : 

• Strong understanding of machine learning principles, especially in the context of LLMs.
• Knowledgable about LLM evaluation techniques, such as human evaluation and automated benchmarks.
• Can own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out projects.
• Fluent in at least one statistical programming language such as Python (preferred) or R.
• Demonstrated background in collecting data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
• Strong verbal and written communications skills with the ability to work effectively across internal and external organizations and virtual teams.
• PhD or advanced degree in computer science, machine learning, cognitive science, psychology, economics, or similar (preferred).

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports 
• Corporate social events
• Professional development opportunities