Data Engineer

Job description

DESCRIPTION

Are you eager to apply your data engineering skills in reshaping one of the world's largest data-driven logistics systems? Amazon's Modeling and Optimization team (MOP) is recruiting motivated individuals with strong data engineering skills to evolve the data infrastructure underlying one of the most sophisticated optimization decision-engines in the world.

Amazon’s extensive logistics system comprises thousands of fixed infrastructure nodes with millions of possible connections between them. Billions of packages flow through this network on a yearly basis, making the impact of decision improvements truly unparalleled. This magnificent challenge is a terrific opportunity for developing cutting-edge data infrastructures to support reshaping one of the world's most complex, automated, data-driven logistics systems.

In this role, you will drive the development of data engineering solutions from initial experimentation to production level deployment, including the followings. Identify gaps and improvement opportunities in existing data infrastructure. Design, implement, and maintain a cutting-edge cloud-based data-infrastructure for large data-sets. Migrate existing data pipelines to your newly developed solutions. Create and manage large datasets by extracting, transforming, combining, and loading data from various heterogeneous data sources. Maintain data integrity, availability, and auditability. Manage AWS resources. Drive the adoption of new technologies and new best practices.

The successful candidate will combine strong technical abilities and leadership skills to deliver business value in a fast-paced, collaborative development environment. You will be self-driven, communicate and collaborate effectively with different technical and non-technical stake-holders, mentor junior colleagues, propagate best practices, drive innovation, and deliver successfully against high operational standards.

PREFERRED QUALIFICATIONS

· Graduate degree in Computer Science, Applied Mathematics, Engineering, or related fields
· 5 years of industry experience as a Data Engineer or related specialty with demonstrable track record in delivering business value
· Experience in AWS technologies such as Redshift, S3, EC2, Data-pipeline, and other big data technologies
· Experience building data products incrementally and integrating and managing datasets from multiple source
· Experience providing technical leadership and mentoring other engineers
· Strong ability to interact, communicate, present, and influence within multiple levels of the organization
· Strong organizational skills with ability to balance competing priorities

Desired profile

BASIC QUALIFICATIONS

· Bachelor's degree in Computer Science, applied mathematics, engineering, or related fields
· 2 years of industry experience as a Data Engineer or related specialty with demonstrable track record in developing data solutions that are correct, stable, and high performing; provide business value; and use resources efficiently (e.g., system hardware, data storage, query optimization, AWS infrastructure etc.).
· Proficiency in understanding business processes, creating coherent Logical Data Models that drive physical design
· Coding proficiency in one or more language (e.g. Python, Scala, Ruby, Java), proficiency in one or more querying languages (e.g. SQL, HiveQL, SPARQL), and familiarity with one or more schema definition languages (e.g. DDL, SDL, XSD, RDF)
· Experience leveraging various strategies for ingesting, modelling, processing, and persisting data.
· Familiarity with distributed systems (e.g. Elastic Map Reduce, MPP architectures, and NoSQL databases)
· Familiarity with AWS technologies such as Redshift, S3, EC2, Data-pipeline, and other big data technologies
· Strong written and verbal communication skills
· Strong customer focus, ownership, sense of urgency, and self-drive