Data Engineer
Foursquare |
NY,New York,USA
Short Description
Foursquare is seeking a Data Engineer who can develop and maintain our data pipelines using Hadoop, Scalding, Luigi, Spark, Mongo and more.Job Description
Responsibilities:
- Develop and maintain our data pipelines using Hadoop, Scalding, Luigi, Spark, Mongo and more
- Partner with the Data Science team to investigate and implement advanced statistical models and machine learning pipelines
- Identify and implement performance improvements across all pipelines
- Data investigations to validate assumptions or find the source of a problem
- Assist client support and sales with client integrations
Qualifications:
- 3+ years of experience working with Hadoop MapReduce and/or other big data technologies and pipelines
- You have a solid foundation in computer science fundamentals with particular expertise in data structures, algorithms, and design
- You obsess over data: everything needs to be accounted for and be thoroughly tested
- You are constantly thinking of ways to squeeze better performance out of the pipelines
- Strong Java or other object-oriented programming experience or, even better, experience and/or interest in functional languages (we use Scala!)
- Experience with Scala, Scalding, Luigi, Hive, machine learning pipelines and model training is a plus
- Bachelors Degree or higher in Computer Science, Electrical Engineering or related field
Data Engineer
Mid-Senior-level
Technology
|
Information
|
Information Technology
Full-time
Information Technology
|
Engineering
|
Other
Data Engineer
Since our inception in 2009, Foursquare has been a leading force in changing how location information enriches our real-world and digital lives. As a location intelligence company, Foursquare is comprised of two well-known consumer apps, Foursquare and Swarm, as well as thriving media and enterprise products. Our B2B offerings include Places (for developers), Pinpoint and Attribution (for marketers), and Place Insights (for analysts, based on the world's largest foot traffic panel). With more than 200 people across our offices in New York, San Francisco, and in sales offices around the globe, we?re dedicated to our trailblazing mission?enriching consumer experiences and informing business decisions with location intelligence.