Big Data Engineer

Doğuş Teknoloji

Are you ready to “Build the Future” with us?

We were established in 2012 to enlighten our customers’ path with the excitement of creating value in the technology world.

As we continue our way as an R&D center since 2017, we continue to be one of the new companies that value people, pursue new technologies with passion, and break grounds in the IT sector with our agile and reliable working culture, and we are looking for a “Big Data Engineer” for our  Business Intelligence & Data Warehouse Team.

QUALIFICATIONS

• Bachelor’s degree in Computer Science/Engineering, Mathematics, Information Systems or in other related fields
• Experience with relational SQL and NoSQL Databases; MS SQL, PostgreSQL, Oracle, ElasticSearch, MongoDB, MySQL
• Data Warehouse & ETL knowledge
• Strong Oracle background including Data Architecture, PL/SQL, ODI
• Expert level SQL and experience transforming business logic into ETL jobs is a must
• Experience with Stream and batch processing (e.g. Kafka, Apache NiFi,, Pub/Sub, Spark Streaming, Dataflow)
• Ability to gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
• Experience in cloud platforms (Amazon Web Services, Google Cloud Platform or Microsoft, Azure) with related tools Specifically: GCP Big Data products, including BigQuery, Pub/Sub, Cloud Composer, Dataflow, Cloud Storage, and related cloud technologies      
• Prior development or technical knowledge and skills with Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Strong hands-on experience in data processing technologies including data modeling, Data Lake, and large-scale data warehousing architecture
• Have a good command of written and spoken English

RESPONSIBILITIES

• Designing data engineering infrastructures, pipelines, data lakes, cloud architectures for Big Data applications
• Build, maintain, and tune highly scalable event streaming, and batch pipelines
• Manage and evolve our cloud based (Big Query) and on premise Data Warehouse which acts as the unique source of all relevant data and ingests high volume near-time data from various sources
• Design and evolve our Data Processing pipeline to feed BI needs
• Monitoring and ensure the integrity of data pipelines
• Designing, configuring, deploying, managing, and automating cloud infrastructure that is secure and scalable on GCP
• Automate the orchestration of workflows, deploy and schedule data pipelines
• Ensure compliance on the GCP operations