Short Description
Foursquare is looking for a Data Engineer who can identify and implement performance improvements across all pipelines.Job Description
Responsibilities:
- Develop and maintain our data pipelines using Hadoop, Scalding, Luigi, Spark, Mongo and more
- Partner with the Data Science team to investigate and implement advanced statistical models and machine learning pipelines
- Identify and implement performance improvements across all pipelines
- Data investigations to validate assumptions or find the source of a problem
- Assist client support and sales with client integrations
Qualifications:
- 3+ years of experience working with Hadoop MapReduce and/or other big data technologies and pipelines
- You have a solid foundation in computer science fundamentals with particular expertise in data structures, algorithms, and design
- You obsess over data: everything needs to be accounted for and be thoroughly tested
- You are constantly thinking of ways to squeeze better performance out of the pipelines
- Strong Java or other object-oriented programming experience or, even better, experience and/or interest in functional languages (we use Scala!)
- Experience with Scala, Scalding, Luigi, Hive, machine learning pipelines, and model training is a plus
- Bachelors Degree or higher in Computer Science, Electrical Engineering or related field
Foursquare is proud to foster an inclusive environment that is free from discrimination. We strongly believe in order to build the best products, we need a diversity of perspectives and backgrounds. This leads to a more delightful experience for our users and team members. We value listening to every voice and we encourage everyone to come to be a part of building a company and products we love.
Data Engineer
Mid-Senior-level
Technology
|
Information Technology
|
Information
Full-time
Other
|
Information Technology
|
Engineering
Data Engineer
Since our inception in 2009, Foursquare has been a leading force in changing how location information enriches our real-world and digital lives. As a location intelligence company, Foursquare is comprised of two well-known consumer apps, Foursquare and Swarm, as well as thriving media and enterprise products. Our B2B offerings include Places (for developers), Pinpoint and Attribution (for marketers), and Place Insights (for analysts, based on the world's largest foot traffic panel). With more than 200 people across our offices in New York, San Francisco, and in sales offices around the globe, we?re dedicated to our trailblazing mission?enriching consumer experiences and informing business decisions with location intelligence.