Senior Data Engineer || Big Data Engineer

Місто : , Kyiv,
Компанія : DCV Technologies
Зарплата :
Знайдено : 18 днів тому

Опис

Senior Data Engineer: Experienced in Scala, Python or Java and Unix/Linux environment on-premises Experience with developing RESTful APIs using Java Spring Boot Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL) Experience optimizing Spark jobs Experience with time-series/analytics db's such as Elasticsearch Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)Basic shell-scripting knowledge Understanding of big data modelling techniques using relational and non-relational techniques Needs to be a Self-starter, proactive and with a team focused attitude Willingness to learn and quick to adapt to changing requirements Experience and understanding of SDLC (Software Development Lifecycle) Good to have: Create/Update/Maintain shared Jenkins library Understanding or experience of Cloud design patterns Great communication skills Big Data Engineer (Hadoop) Experience in Python, pySpark and Unix/Linux environment on-premises Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Apache Spark, YARN, Hive, SQL) Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins) Experience optimizing Spark jobs Basic shell-scripting knowledge Understanding of big data modelling techniques using relational and non-relational techniques Needs to be a Self-starter, proactive and with a team focused attitude. Willingness to learn and quick to adapt to changing requirements. Experience and understanding of SDLC (Software Development Lifecycle) Ability to work with business users and the team stakeholders such as project managers and architects. Excellent data analysis skills with experience dealing with large and complex data sets. Good knowledge of Structured Query Language (SQL) Highly analytical with excellent attention to detail. Experienced in analysing business requirements and turning them into effective functional solutions. Excellent communication, both written and spoken (in English). Demonstrable track record of delivery. Strong interpersonal skills and ability to both lead and contribute within a small team. Nice To Have: Experience with time-series/analytics db's such as Elasticsearch Experience in Scala Experience with developing RESTful APIs using Java Spring Boot Familiar with Cloud technology components (preferred: GCP)

Схожі вакансії

    Customer Data Platforms Data Engineer

    • , Warsaw ,
    • 21 година тому

    ... + years of experience as a Data Engineer 5+ years of expertise in implementing and optimizing Customer Data Platforms 5+ years of exposure ...

    jobs.jti.com

    Consumer Data Product Manager

    • , Warsaw ,
    • 21 година тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    DC Service Delivery Manager

    • , Warsaw ,
    • день тому

    ... and escalate deviations to the data center service delivery lead Maximize ... employee referral program, your personal data will be processed until the ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Marketing Automation Product Manager

    • , Warsaw ,
    • 21 година тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    I&O DE Process Manager

    • , Warsaw ,
    • 21 година тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Process Analyst Manager (SAP PPM & SAP PS)

    • , WARSAW ,
    • 21 година тому

    ... . For that: you will assist senior team members in the analysis ... Business Intelligence groups assess master data and reporting requirements for key ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Business Expert Manager

    • , WARSAW ,
    • 21 година тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    SAP Program Delivery Manager

    • , Warsaw ,
    • 12 днів тому

    ... ). Coordinating and executing SAP yearly data archiving along with IT JTI ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 21 година тому

    ... similar field, experience with modern data governance concepts, data modelling, and data management, and familiarity with cloud-based Big Data platforms and practices. Basic knowledge ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 21 година тому

    ... similar field, experience with modern data governance concepts, data modelling, and data management, and familiarity with cloud-based Big Data platforms and practices. Basic knowledge ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 21 година тому

    ... similar field, experience with modern data governance concepts, data modelling, and data management, and familiarity with cloud-based Big Data platforms and practices. Basic knowledge ...

    jobs.jti.com

    IT Analyst - Corporate Sustainability

    • , Warsaw ,
    • 11 днів тому

    ... referral program, your personal data will be processed until the ... processing of your personal data may be extended each time ... recipients of your personal data?   The data may be transferred to entities processing personal data on behalf of the controller, ...

    jobs.jti.com

    Process Analyst Manager

    • , WARSAW ,
    • 21 година тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    DWH Architect Data Modeling

    • Kitopi
    • , Odesa,
    • день тому

    ... important business questions that the data models would be able to ... a plus.  Technologies we use: Data Warehouse Big Data: Snowflake, ADL, and Postgres  Reporting: Power BI  Data Pipelines: Kafka, Python, SQL, Airflow, ...

    ua.talent.com

    DWH Architect Data Modeling

    • Kitopi
    • , Kyiv,
    • день тому

    ... important business questions that the data models would be able to ... a plus.  Technologies we use: Data Warehouse Big Data: Snowflake, ADL, and Postgres  Reporting: Power BI  Data Pipelines: Kafka, Python, SQL, Airflow, ...

    ua.talent.com

    Data Governance Manager

    • , Bucharest ,
    • 21 година тому

    ... pertaining to the use of data assets to achieve efficiency and effectiveness in the business processes represent data as a strategic business asset at the Senior Management table • Facilitate Data Governance solutions evaluation from technical ...

    jobs.jti.com

    Senior Product Analyst

    • Travelist Sp. z o.o.
    • , Odesa,
    • 2 дні тому

    ... : Kirsten Grieve, Data Warehouse Engineer -  https: careers.secretescapes.com blog my-first-hack-day-kirsten-grieve-data-warehouse-engineer   The story behind Secret Escapes ... work with the Senior Leadership in Product and Data to shape and prioritise the ...

    ua.talent.com

    Senior Product Analyst

    • Travelist Sp. z o.o.
    • , Kyiv,
    • 2 дні тому

    ... : Kirsten Grieve, Data Warehouse Engineer -  https: careers.secretescapes.com blog my-first-hack-day-kirsten-grieve-data-warehouse-engineer   The story behind Secret Escapes ... work with the Senior Leadership in Product and Data to shape and prioritise the ...

    ua.talent.com

    Senior Data Scientist

    • , Manila ,
    • 21 година тому

    ... more: jti.com     Department: Data & A.I. Center Duty Post: Taguig City Hiring Manager: AI Expert Manager Role: Permanent   Senior Data Scientist AI Manager   What is ... ) Knowledge of major Big data storage (i.e. data lake), analytical engines (i.e. ...

    jobs.jti.com

    Data Engineer

    • TechnipFMC
    • , Kyiv,
    • 18 днів тому

    ... and roll-out of the Data Lake Data Warehouse we are recruiting Data Engineers into the Data Management Team. The Data Engineer will develop content in the Data Lake Data Warehouse for reporting USE Cases ...

    ua.talent.com
Top