Big Data Engineer

Short Description

American Express is looking for a Big Data Engineer who can Develop software in our technology stack which is constantly evolving but currently includes Python, Spark, Unix Shell Script, Tableau, JavaScript, etc.

Job Description

American Express has embarked on an exciting transformation driven by an energetic new team of high performers. This is a great opportunity to join the CTO organization within American Express Technologies become the driver of this exciting journey

What we're looking for:
You're a talented, creative, and motivated engineer who loves developing a powerful, stable, and intuitive apps and you're excited to work with a team of individuals with that same passion. You've accumulated years of experience, and you're excited about taking your mastery of Big Data to a new level. You enjoy challenging projects and are cool under pressure. You're no stranger to fast-paced environments and agile development methodologies in fact, you embrace them. With your strong analytical skills, your unwavering commitment to quality, your excellent technical skills, and your collaborative work ethic, you'll do great things here at American Express.

Purpose of the Role:
Cornerstone is the company's largest Big Data Platform, ideally suited for computationally and/or data intensive processing applications. Whether the data needs to be processed in batch, online, or streaming manner, Cornerstone provides robust capabilities to handle such workloads effectively, in a cost-efficient manner.

A hub of highly talented Big Data engineers providing production support and most exciting & upcoming technologies such as HBase, Couchbase, Spark, Structured Streaming, Kafka, Elasticsearch, Java APIs, Scala, Python, Pig, Hive, etc, Cornerstone platform offers an environment where Engineers are challenged every day to build world-class products
  • There are hundreds of opportunities to make your mark on technology and life at American Express. Here's just some of what you'll be doing:
  • As a part of our team, you will be developing innovative, high quality, and robust operational engineering capabilities.
  • Working to triage outages & defects and resolve them within established SLA's
  • Work with Application Developers and Solution Architects to identify areas to improve operational and supportability model as part of continuous improvement and maturing Cornerstone Production Operation function
  • Implement monitoring and alerting solutions to provide insight into overall platform health
  • Provide timely communication to stakeholders and users on issue status and resolution
  • Lead and mentor team members across our Operations Team by delegating routine and project tasks
  • Collaborate with other software engineering teams, design team, product owners and managers, and business stakeholders.
  • Develop software in our technology stack which is constantly evolving but currently includes Python, Spark, Unix Shell Script, Tableau, JavaScript, etc.

  • Education- Bachelor or Masters' Degree in Computer Science or related field
  • 4 to 14 years of software development experience with proven hands-on experience in Big Data technologies
  • Experience with design and coding across one or more platforms and languages as appropriate
  • Hands-on expertise with application design, software development, and automated testing
  • Ability to effectively interpret technical and business objectives and challenges, and articulate solutions
  • Strong programming knowledge in Java/Python
  • Experience working on any Hadoop distribution, such as Mapr, Cloudera, Hortonworks and have at least coded in Hive, Java M/R, Spark, SQL & No SQL databases for 2 years or more, will be an added advantage.
  • Solid understanding of data structures, Algorithms & Design Patterns will be an added advantage
  • Strong experience with UNIX / Shell / Python scripting
  • Understanding of different Algorithms & Machine Learning techniques (Neural Network, Deep Learning, Supervised & Unsupervised, Regression, Classification) and their application in batch/real-time will be an added advantage
  • Familiar with Agile or other rapid application development methods
  • Implementation or working experience of Continuous Integration and Continues Delivery using tools and automation capabilities such as JUnit, Mocking, TestNG, Jenkins, Git, Stash and Jira
  • Experience in Cloud technologies (AWS, GCP, Dockerization, etc) , will be an added advantage.
  • Strong analytical ability
  • Excellent communication skills
  • Excellent team player with the ability to work with a global team

Big Data Engineer
Mid-Senior-level Information | Technology | Information Technology Full-time Engineering | Other | Information Technology Data Engineer
American Express is a global service company, providing customers with exceptional access to products, insights and experiences that enrich lives and build business success.

Each day, American Express makes it easier, safer and more rewarding for consumers and businesses to purchase the things they need and for merchants to sell their goods and services. An engine of commerce, American Express provides innovative payment, travel and expense management solutions for individuals and businesses of all sizes. Most of all, we help our customers realize their dreams and aspirations through industry-leading benefits, access to unique experiences, business-building insights, and global customer care. We enable our customers to do and achieve more.