Data Engineer I

Job description

DESCRIPTION

Health, Safety, Sustainability, Security, and Compliance (HS3C) is responsible for keeping our Customers and partners safe, and ensuring we maintain WW compliance. We build scalable solutions that grow with the Amazon business. HS3C-Compliance team collects petabytes of data from thousands of data sources inside and outside Amazon including the Amazon catalog system, inventory system, customer order system, and page views on the website. We provide interfaces for our internal customers to access and query the data hundreds of thousands of times per day, using Amazon Web Service's (AWS) Redshift, Hive, and Spark.
HS3C-Compliance is growing, and the data processing landscape is shifting. Our data is consumed by teams across HS3C including Research Scientists, Machine Learning Specialists, Business Analysts, and Data Engineers. We are seeking an outstanding Data Engineer to join the HS3C-Compliance data technologies team. The HS3C-Compliance data technologies team manages the core HS3C business data from hundreds of source systems. Amazon has culture of data-driven decision-making, and demands business intelligence that is timely, accurate, and actionable. If you join the HS3C-Compliance data technologies team, your work will have an immediate influence on day-to-day decision making at Amazon.

As an Amazon Data Engineer II, you will be working in one of the world's largest cloud-based data lakes. You should be skilled in the architecture of data warehouse solutions for the Enterprise using multiple platforms (EMR, RDBMS, Columnar, Cloud). You should have extensive experience in the design, creation, management, and business use of extremely large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change.

As a Data Engineer II on the HS3C-Compliance data technologies team, you will design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for analytics and deep learning. Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions that work well within the overall data architecture. Analyze source data systems and drive best practices in source teams. Participate in the full development life cycle, end-to-end, from design, implementation and testing, to documentation, delivery, support, and maintenance. Produce comprehensive, usable dataset documentation and metadata. Evaluate and make decisions around dataset implementations designed and proposed by peer data engineers. Evaluate and make decisions around the use of new or existing software products and tools. Mentor junior data engineers.

Desired profile

BASIC QUALIFICATIONS

· A desire to work in a collaborative, intellectually curious environment.
· Degree in Computer Science, Engineering, Mathematics, or a related field and 4-5+ years industry experience
· One year of experience in the following skill(s):
· Developing and operating large-scale data structures for business intelligence analytics using: ETL/ELT processes; OLAP technologies; data modeling; SQL;
· Experience with at least one relational database technology such as Redshift, Oracle, MySQL or MS SQL
· Experience with at least one massively parallel processing data technology such as Redshift, Teradata, Netezza, Spark, or Hadoop based big data solution