Data Migration

Job description

·  Job Description:

Summary

Provides technical consulting services to the client in data and database architecture to include establishing information management direction for an enterprise and participating in the formulation of strategic direction for data management.

Essential Job Functions

· 
The Role

• Deliver and manage data platform(s) which include cloud data technologies, oracle data warehouse and data lake.

• Build distributed and highly parallelized Big Data ingestion and processing pipelines including near real time updates, management of provenance and lineage.

• Shape and drive data architecture, infrastructure, and visualization solutions.

• Accountable for data security in transit and at rest.

• Analyze, design and develop the data pipelines, frameworks and infrastructure for data transformation and consumption.

• Work with relevant parties on data quality and data governance.

• Automate ingest, process and consume data processes to for scalability and reliability.

• Investigate and introduce new data technologies that may benefit HGC’s data strategy.

• Work with the data scientists and BAs to provide data insights.

Experience and Expected Skills

• Degree holder in Computer Science or Engineering, minimum 5 years of experience in high data volume environments, preferably in software, internet industry.

• Must have experience with Python.

• Experience with data lake technology like Pandas, Spark, Nifi, Flink, Kafka, Hadoop, Hive Tensorflow

• Experience in SQL a must. No-SQL, and unstructured data preferred.

• Knowledge in design and implementation of data infrastructure on Azure, AWS or GCP.

• Experience in container technologies (Docker / Kubernetes).

• Experience in devops environments.

• Flexible, adaptive, quick learner - works well in a collaborative, communicative environment.

• Experience in implementing data security capabilities such as encryption, anonymization, and pseudonymization.

• Understanding of statistical models, machine learning, and graph analysis.

• Experience with deploying and running ML algorithms and experiments is a plus.

• Demonstrated experience with web architectures, scaling, debugging code, and performance analysis is a plus.

Basic Qualifications

·  Bachelor's degree or equivalent combination of education and experience
·  Bachelor's degree in computer science, management information systems, or related field preferred
·  Six or more years of experience in database design or maintenance
·  Experience working with computer hardware and software installation/upgrading procedures
·  Experience working with database and system maintenance procedures
·  Experience working with database creation techniques and database management systems (DBMS) features
·  Experience working with database performance tuning

Other Qualifications

·  Good analytical and problem solving skills
·  Good programming skills for database management and general software
·  Good communication skills
·  Leadership skills to guide work teams
·  Ability to work in a team environment
·  Ability to anticipate problems and take decisive action
·  Willingness to travel

Work Environment

·  Client or office environment
·  Weekend and evening work