Senior Data Engineer

n11.com

We are looking for individuals with a background in full life cycle data-implementation projects. We are interested in people who have a deep understanding of both big data and relational warehousing database technologies and are fluent in the use of such data management tools.

The ideal candidates should have experience in setting up and managing cloud (such as GCP) and on-premise infrastructures, and who are able to translate business needs into data architecture solutions and then drive implementation of solutions in production environments. The Data Engineer will support our teams on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. 

·       Gather requirements, design and roll out BI/AA solutions to end users,

·       Analyze, Design, Implement, Test, and Document all new or modified BI/AA systems and applications,

·       Confer and coordinate activities with other departments,

·       Plan and manage several complex projects at the same time,

·       Communicate with various levels of management on a business and technical level,

·       Integrating data management technologies and software engineering tools into existing structures

·       Building and managing data jobs with various data platforms,

·       Implementation of data orchestration pipelines, data sourcing, cleansing, augmentation and quality control processes,

·       Deployment of data pipelines in the Cloud in GCP/AWS,

·       DevOps and DataOps skills including “infrastructure as code” systems,

·       Leverage latest technologies to deliver better insights more quickly and cost effectively,

·       Training internal customers when necessary.

QUALIFICATIONS:

·       Academic degree in Data Engineering, Computer Engineering, Computer Science, Software Engineering, Applied Mathematics or similar background,

·       Minimum of 4 years work experience in Business Intelligence/Advanced Analytics,

·       An understanding of “big picture” business requirements that drive architecture and design decisions

·       Comprehensive data warehouse analysis and design experience, with full knowledge of data warehouse methodologies and data modeling,

·       Expertise in Database Scripting languages,

·       Expertise in Reporting Architecture and Deliverables (such as MicroStrategy, Tableau, Qlikview, SAP Business Objects, OBIEE, Power BI, etc.),

·       Experience with web technology to develop dashboards,

·       Expertise in Data Integration processes.(ODI,BODI,Informatica,Data Stage,Ab Initio),

·       Expertise in developing ETL/ELT workflows with Python or Scala or Java on premise and cloud data sources and external systems,

·       Expertise in open source data technologies,

·       Expertise in architecting, developing, and managing real-time data pipelines,

·       Ability to analyze user requirements and build front-end BI/AA applications according to specifications,

·       2+ years professional development experience with some of the GCP/AWS data stack,

·       Practical Knowledge of Linux/Unix shell scripting,

·       Expertise in columnar, distributed, row based databases

·       Intellectual curiosity and ability to handle multiple projects and challenging deadlines,

·       Strong analytical, interpersonal and communication skills,

·       Ability to communicate in English language.