Short Description
Pixalate is looking for a Big Data Engineer who can design, develop, and support of various big data solutions at scale (hundreds of Billions of transactions a day).Job Description
- Support existing processes running in production
- Design, develop, and support of various big data solutions at scale (hundreds of Billions of transactions a day)
- Find smart, fault-tolerant, self-healing, cost-efficient solutions to extremely hard data problems
- Take ownership of the various big data solutions, troubleshoot issues, and provide production support
- Conduct research on new technologies that can improve current processes
- Contribute to publications of case studies and white papers delivering cutting edge research in the ad fraud, security and measurement space
- Bachelors, Masters or Ph.D. in Computer Science, Computer Engineering, Software Engineering, or another related technical field.
- A minimum of 3 years of experience in a software or data engineering role
- Excellent teamwork and communication skills
- Extremely analytical, critical thinking, and problem-solving abilities
- Proficiency in Java
- Very strong knowledge of SQL and ability to implement advanced queries to extract information from very large datasets
- Experience in working with very large datasets using big data technologies such as Spark, BigQuery, Hive, Hadoop, Redshift, etc
- Ability to design, develop and deploy end-to-end data pipelines that meet business requirements.
- Strong experience in AWS and Google Cloud platforms is a big plus
- Deep understanding of computer science concepts such as data structures, algorithms, and algorithmic complexity
- Deep understanding of statistics and machine learning algorithms foundations is a huge plus
- Experience with Machine Learning big data technologies such as R, Spark ML, H2O, Mahout, etc is a plus
- Experienced leadership and founding team
- Casual environment
- Flexible hours
- High performing team who wants to win and have fun doing it
- Extremely Competitive Compensation
- OPPORTUNITY (Pixalate will be what you make it)
Big Data Engineer