Data Engineer Spark

Місто : , Kyiv,
Компанія : GetInData | Part of Xebia
Зарплата :
Знайдено : 7 днів тому

Опис

Who are GetInData | Part of Xebia?   GetInData | Part of Xebia  is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and large corporations that are industry leaders. In 2022, we joined forces with  Xebia Group  to broaden our horizons and bring new international opportunities. What about the projects we work with? We run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine Learning Models, Generative AI and more. We like working with top technologies and open-source solutions for Data & AI and ML/AI. In our portfolio, you can find Clients from many industries, e.g., media, e-commerce, retail, fintech, banking, and telcos, such as Truecaller, Spotify, ING, Acast, Volt, Play, and Allegro. You can read some customer stories  here . What else do we do besides working on projects? We conduct many initiatives like Guilds and Labs and other knowledge-sharing initiatives. We build a community around Data & AI, thanks to our conference  Big Data Technology Warsaw Summit ,  meetup Warsaw Data Tech Talks ,  Radio Data podcast , and  DATA Pill newsletter . Data & AI projects that we run and the company's philosophy of sharing knowledge and ideas in this field make GetInData | Part of Xebia not only a great place to work but also a place that provides you with a real opportunity to boost your career. If you want to be up to date with the latest news from us, please follow up on our  profile . About role We are working on developing a modern platform for the collection and analysis of lineage metadata. As a Data Engineer, you will work closely with the GetInData and client teams on building and maintaining specifications and integrations for tools like Apache Airflow, Flink, or Spark, as well as developing Marquez service for the collection, aggregation, and visualization of lineage metadata. Public GitHub environments and discussions open to the rest of the world limit the number of meetings to a minimum. Responsibilities Working with the GetInData and client teams and open source community to identify requirements and execute them Writing simple, understandable, testable, and efficient code with a focus on solid technical stability and great user experience Collaborating with stakeholders to understand project functional requirements and objectives from a data processing perspective Ensuring compliance with industry standards and regulations in terms of security, data privacy applied in the data processing layer Defining and implementing security measures according to best practices Ensuring compliance with industry standards and regulations Requirements Very good knowledge of Java or Python, or both Experience working with databases or data processing systems Good knowledge of SQL Experience working with Spark Knowledge of big data landscape Ability to work independently and focus on impactful features Strong B2/C1 English - ability to express complex ideas both in text and speech Experience as a contributor to an open-source community is a plus Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement We offer   Salary: 110-160 PLN net + VAT/h B2B (depending on knowledge and experience) 100% remote work Flexible working hours Possibility to work from the office located in the heart of Warsaw Opportunity to learn and develop with the best Big Data specialists in Poland International projects Possibility of conducting workshops and training. Certifications Co-financing sport card Co-financing health care All equipment needed for work

Схожі вакансії

    Customer Data Platforms Data Engineer

    • , Warsaw ,
    • 12 годин тому

    ... + years of experience as a Data Engineer 5+ years of expertise in implementing and optimizing Customer Data Platforms 5+ years of exposure ...

    jobs.jti.com

    Consumer Data Product Manager

    • , Warsaw ,
    • 12 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Marketing Automation Product Manager

    • , Warsaw ,
    • 12 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    I&O DE Process Manager

    • , Warsaw ,
    • 5 днів тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    IT Business Expert Manager

    • , WARSAW ,
    • 12 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    IT Process Analyst Manager (SAP PPM & SAP PS)

    • , WARSAW ,
    • 12 годин тому

    ... Business Intelligence groups assess master data and reporting requirements for key ... employee referral program, your personal data will be processed until the ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Business Expert Manager

    • , WARSAW ,
    • 14 днів тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Process Analyst Manager (SAP PPM & SAP PS)

    • , WARSAW ,
    • 14 днів тому

    ... Business Intelligence groups assess master data and reporting requirements for key ... employee referral program, your personal data will be processed until the ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 12 годин тому

    ... . Fabric Azure Synapse Analytics, Azure Data Lake Storage, Power BI, MS Purview, Databricks, Spark, etc.) • Knowledge of data governance practices, business, and technology ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 12 годин тому

    ... . Fabric Azure Synapse Analytics, Azure Data Lake Storage, Power BI, MS Purview, Databricks, Spark, etc.) • Knowledge of data governance practices, business, and technology ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 12 годин тому

    ... . Fabric Azure Synapse Analytics, Azure Data Lake Storage, Power BI, MS Purview, Databricks, Spark, etc.) • Knowledge of data governance practices, business, and technology ...

    jobs.jti.com

    IT Process Analyst Manager

    • , WARSAW ,
    • 12 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Process Analyst Manager

    • , WARSAW ,
    • 14 днів тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    DWH Architect Data Modeling

    • Kitopi
    • , Odesa,
    • 23 години тому

    ... working in data, with experience spanning multiple data disciplines, including data science, data engineering, data analysis, and data warehousing.   3+ years of experience in data modeling at a high-growth ... that the data models would be able to ...

    ua.talent.com

    DWH Architect Data Modeling

    • Kitopi
    • , Kyiv,
    • 23 години тому

    ... working in data, with experience spanning multiple data disciplines, including data science, data engineering, data analysis, and data warehousing.   3+ years of experience in data modeling at a high-growth ... that the data models would be able to ...

    ua.talent.com

    Data Governance Manager

    • , Bucharest ,
    • 12 годин тому

    ... ensuring adherence to an enterprise data governance  and data quality framework for data policies, standards and practices, both ... and technology to ensure that data related business requirements are clearly ...

    jobs.jti.com

    Data Architect

    • Balsam Brands
    • Mexico City, Mexico City, Mexico
    • 5 днів тому

    ... reports to the Senior Manager, Data Engineering and has been categorized ... coding standards, best practices and data governanceLocation and Travel: At Balsam ...

    jobs.smartrecruiters.com

    Senior Data Engineer

    • NielsenIQ
    • Bogotá, Bogota, Colombia
    • 6 днів тому

    ... a Senior Data Engineer to join our Data Team. We have to cover the three main specialties at the data field: Data Science, Data Analytics and Data Engineering. Today we have covered ... senior data engineer is also accountable for passing ...

    jobs.smartrecruiters.com

    Data Engineer

    • Inter IKEA Group
    • Delft, Netherlands
    • 5 днів тому

    ... our value chain.As a Data Engineer, you will be part of the Data Engineering and Analytics chapter while ... opportunities. As our new Insight Data Engineer colleague, you will be inspired ...

    jobs.smartrecruiters.com

    Lead Data Architect- Market Analytics

    • Bayer Sp. z o.o.
    • , Kyiv,
    • 2 дні тому

    ... . Generally, a good understanding of spark-based ETL processing, event-driven data processing, SQL, and cloud computing solutions in the area of data & analytics is needed. Profound data architecture & technology knowledge, data engineering skills, as well ...

    ua.talent.com
Top